Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence

New and emerging technologies, especially those based on non-invasive video and thermal infrared cameras, can be readily tested on robotic milking facilities. In this research, implemented non-invasive computer vision methods to estimate cow’s heart rate, respiration rate, and abrupt movements captu...

Full description

Bibliographic Details
Main Authors: Sigfredo Fuentes, Claudia Gonzalez Viejo, Eden Tongson, Nir Lipovetzky, Frank R. Dunshea
Format: Article
Language:English
Published: MDPI AG 2021-10-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/20/6844
_version_ 1797513137971265536
author Sigfredo Fuentes
Claudia Gonzalez Viejo
Eden Tongson
Nir Lipovetzky
Frank R. Dunshea
author_facet Sigfredo Fuentes
Claudia Gonzalez Viejo
Eden Tongson
Nir Lipovetzky
Frank R. Dunshea
author_sort Sigfredo Fuentes
collection DOAJ
description New and emerging technologies, especially those based on non-invasive video and thermal infrared cameras, can be readily tested on robotic milking facilities. In this research, implemented non-invasive computer vision methods to estimate cow’s heart rate, respiration rate, and abrupt movements captured using RGB cameras and machine learning modelling to predict eye temperature, milk production and quality are presented. RGB and infrared thermal videos (IRTV) were acquired from cows using a robotic milking facility. Results from 102 different cows with replicates (<i>n</i> = 150) showed that an artificial neural network (ANN) model using only inputs from RGB cameras presented high accuracy (R = 0.96) in predicting eye temperature (°C), using IRTV as ground truth, daily milk productivity (kg-milk-day<sup>−1</sup>), cow milk productivity (kg-milk-cow<sup>−1</sup>), milk fat (%) and milk protein (%) with no signs of overfitting. The ANN model developed was deployed using an independent 132 cow samples obtained on different days, which also rendered high accuracy and was similar to the model development (R = 0.93). This model can be easily applied using affordable RGB camera systems to obtain all the proposed targets, including eye temperature, which can also be used to model animal welfare and biotic/abiotic stress. Furthermore, these models can be readily deployed in conventional dairy farms.
first_indexed 2024-03-10T06:13:25Z
format Article
id doaj.art-7c2d48b2def747ce90b0a3e4df679c68
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T06:13:25Z
publishDate 2021-10-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-7c2d48b2def747ce90b0a3e4df679c682023-11-22T19:58:23ZengMDPI AGSensors1424-82202021-10-012120684410.3390/s21206844Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial IntelligenceSigfredo Fuentes0Claudia Gonzalez Viejo1Eden Tongson2Nir Lipovetzky3Frank R. Dunshea4Digital Agriculture Food and Wine Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, University of Melbourne, Parkville, VIC 3010, AustraliaDigital Agriculture Food and Wine Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, University of Melbourne, Parkville, VIC 3010, AustraliaDigital Agriculture Food and Wine Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, University of Melbourne, Parkville, VIC 3010, AustraliaSchool of Computing and Information Systems, Melbourne School of Engineering, University of Melbourne, Parkville, VIC 3010, AustraliaDigital Agriculture Food and Wine Group, School of Agriculture and Food, Faculty of Veterinary and Agricultural Sciences, University of Melbourne, Parkville, VIC 3010, AustraliaNew and emerging technologies, especially those based on non-invasive video and thermal infrared cameras, can be readily tested on robotic milking facilities. In this research, implemented non-invasive computer vision methods to estimate cow’s heart rate, respiration rate, and abrupt movements captured using RGB cameras and machine learning modelling to predict eye temperature, milk production and quality are presented. RGB and infrared thermal videos (IRTV) were acquired from cows using a robotic milking facility. Results from 102 different cows with replicates (<i>n</i> = 150) showed that an artificial neural network (ANN) model using only inputs from RGB cameras presented high accuracy (R = 0.96) in predicting eye temperature (°C), using IRTV as ground truth, daily milk productivity (kg-milk-day<sup>−1</sup>), cow milk productivity (kg-milk-cow<sup>−1</sup>), milk fat (%) and milk protein (%) with no signs of overfitting. The ANN model developed was deployed using an independent 132 cow samples obtained on different days, which also rendered high accuracy and was similar to the model development (R = 0.93). This model can be easily applied using affordable RGB camera systems to obtain all the proposed targets, including eye temperature, which can also be used to model animal welfare and biotic/abiotic stress. Furthermore, these models can be readily deployed in conventional dairy farms.https://www.mdpi.com/1424-8220/21/20/6844heart raterespiration rateabrupt movementsrobotic dairy farmartificial neural networks
spellingShingle Sigfredo Fuentes
Claudia Gonzalez Viejo
Eden Tongson
Nir Lipovetzky
Frank R. Dunshea
Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence
Sensors
heart rate
respiration rate
abrupt movements
robotic dairy farm
artificial neural networks
title Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence
title_full Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence
title_fullStr Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence
title_full_unstemmed Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence
title_short Biometric Physiological Responses from Dairy Cows Measured by Visible Remote Sensing Are Good Predictors of Milk Productivity and Quality through Artificial Intelligence
title_sort biometric physiological responses from dairy cows measured by visible remote sensing are good predictors of milk productivity and quality through artificial intelligence
topic heart rate
respiration rate
abrupt movements
robotic dairy farm
artificial neural networks
url https://www.mdpi.com/1424-8220/21/20/6844
work_keys_str_mv AT sigfredofuentes biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence
AT claudiagonzalezviejo biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence
AT edentongson biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence
AT nirlipovetzky biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence
AT frankrdunshea biometricphysiologicalresponsesfromdairycowsmeasuredbyvisibleremotesensingaregoodpredictorsofmilkproductivityandqualitythroughartificialintelligence