Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence
New and emerging technologies, especially those based on non-invasive video and thermal infrared cameras, can be readily tested on robotic milking facilities. In this research, implemented non-invasive computer vision methods to estimate cow’s heart rate, respiration rate, and abrupt movements captu...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-10-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/21/20/6844 |
_version_ | 1797513137971265536 |
---|---|
author | Sigfredo Fuentes Claudia Gonzalez Viejo Eden Tongson Nir Lipovetzky Frank R. Dunshea |
author_facet | Sigfredo Fuentes Claudia Gonzalez Viejo Eden Tongson Nir Lipovetzky Frank R. Dunshea |
author_sort | Sigfredo Fuentes |
collection | DOAJ |
description | New and emerging technologies, especially those based on non-invasive video and thermal infrared cameras, can be readily tested on robotic milking facilities. In this research, implemented non-invasive computer vision methods to estimate cow’s heart rate, respiration rate, and abrupt movements captured using RGB cameras and machine learning modelling to predict eye temperature, milk production and quality are presented. RGB and infrared thermal videos (IRTV) were acquired from cows using a robotic milking facility. Results from 102 different cows with replicates (<i>n</i> = 150) showed that an artificial neural network (ANN) model using only inputs from RGB cameras presented high accuracy (R = 0.96) in predicting eye temperature (°C), using IRTV as ground truth, daily milk productivity (kg-milk-day<sup>−1</sup>), cow milk productivity (kg-milk-cow<sup>−1</sup>), milk fat (%) and milk protein (%) with no signs of overfitting. The ANN model developed was deployed using an independent 132 cow samples obtained on different days, which also rendered high accuracy and was similar to the model development (R = 0.93). This model can be easily applied using affordable RGB camera systems to obtain all the proposed targets, including eye temperature, which can also be used to model animal welfare and biotic/abiotic stress. Furthermore, these models can be readily deployed in conventional dairy farms. |
first_indexed | 2024-03-10T06:13:25Z |
format | Article |
id | doaj.art-7c2d48b2def747ce90b0a3e4df679c68 |
institution | Directory Open Access Journal |
issn | 1424-8220 |
language | English |
last_indexed | 2024-03-10T06:13:25Z |
publishDate | 2021-10-01 |
publisher | MDPI AG |
record_format | Article |
series | Sensors |
spelling | doaj.art-7c2d48b2def747ce90b0a3e4df679c682023-11-22T19:58:23ZengMDPI AGSensors1424-82202021-10-012120684410.3390/s21206844Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial IntelligenceSigfredo Fuentes0Claudia Gonzalez Viejo1Eden Tongson2Nir Lipovetzky3Frank R. Dunshea4Digital Agriculture Food and Wine Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, University of Melbourne, Parkville, VIC 3010, AustraliaDigital Agriculture Food and Wine Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, University of Melbourne, Parkville, VIC 3010, AustraliaDigital Agriculture Food and Wine Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, University of Melbourne, Parkville, VIC 3010, AustraliaSchool of Computing and Information Systems, Melbourne School of Engineering, University of Melbourne, Parkville, VIC 3010, AustraliaDigital Agriculture Food and Wine Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, University of Melbourne, Parkville, VIC 3010, AustraliaNew and emerging technologies, especially those based on non-invasive video and thermal infrared cameras, can be readily tested on robotic milking facilities. In this research, implemented non-invasive computer vision methods to estimate cow’s heart rate, respiration rate, and abrupt movements captured using RGB cameras and machine learning modelling to predict eye temperature, milk production and quality are presented. RGB and infrared thermal videos (IRTV) were acquired from cows using a robotic milking facility. Results from 102 different cows with replicates (<i>n</i> = 150) showed that an artificial neural network (ANN) model using only inputs from RGB cameras presented high accuracy (R = 0.96) in predicting eye temperature (°C), using IRTV as ground truth, daily milk productivity (kg-milk-day<sup>−1</sup>), cow milk productivity (kg-milk-cow<sup>−1</sup>), milk fat (%) and milk protein (%) with no signs of overfitting. The ANN model developed was deployed using an independent 132 cow samples obtained on different days, which also rendered high accuracy and was similar to the model development (R = 0.93). This model can be easily applied using affordable RGB camera systems to obtain all the proposed targets, including eye temperature, which can also be used to model animal welfare and biotic/abiotic stress. Furthermore, these models can be readily deployed in conventional dairy farms.https://www.mdpi.com/1424-8220/21/20/6844heart raterespiration rateabrupt movementsrobotic dairy farmartificial neural networks |
spellingShingle | Sigfredo Fuentes Claudia Gonzalez Viejo Eden Tongson Nir Lipovetzky Frank R. Dunshea Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence Sensors heart rate respiration rate abrupt movements robotic dairy farm artificial neural networks |
title | Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence |
title_full | Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence |
title_fullStr | Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence |
title_full_unstemmed | Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence |
title_short | Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence |
title_sort | biometric physiological responses from dairy cows measured by visible remote sensing are good predictors of milk productivity and quality through artificial intelligence |
topic | heart rate respiration rate abrupt movements robotic dairy farm artificial neural networks |
url | https://www.mdpi.com/1424-8220/21/20/6844 |
work_keys_str_mv | AT sigfredofuentes biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence AT claudiagonzalezviejo biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence AT edentongson biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence AT nirlipovetzky biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence AT frankrdunshea biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence |