Machine vision-based automatic lamb identification and drinking activity in a commercial farm

Using ear tags, farmers can track specific data for individual lambs such as age, medical records, body condition scores, genetic abnormalities; to make data-based decisions. However, automatic reading of ear tags using Radio Frequency Identification requires (a) an antenna, (b) a reader, (c) compar...

Full description

Bibliographic Details
Main Authors: A. Alon, I. Shimshoni, A. Godo, R. Berenstein, J. Lepar, N. Bergman, I. Halachmi
Format: Article
Language:English
Published: Elsevier 2023-09-01
Series:Animal
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S1751731123002203
_version_ 1797682534219251712
author A. Alon
I. Shimshoni
A. Godo
R. Berenstein
J. Lepar
N. Bergman
I. Halachmi
author_facet A. Alon
I. Shimshoni
A. Godo
R. Berenstein
J. Lepar
N. Bergman
I. Halachmi
author_sort A. Alon
collection DOAJ
description Using ear tags, farmers can track specific data for individual lambs such as age, medical records, body condition scores, genetic abnormalities; to make data-based decisions. However, automatic reading of ear tags using Radio Frequency Identification requires (a) an antenna, (b) a reader, (c) comparable reading standards; consequently, such a system can be expensive and impractical for a large group of lambs, especially in situations where animals are not required to have a compulsory Electronic identification, contrary to the case in Europe, where it is mandatory. Therefore, this paper proposes a machine vision system for indoor animals to identify individual lambs using existing ear tags. Using a camera that is installed such that the trough is visible, the drinking behaviour of the lambs can be automatically monitored. Data from different lamb groups in two different pens were collected. The identification algorithm includes a number of steps: (1) Detecting the lambs' face, and its ear tags in each image; (2) Cropping each ear tag image and discerning the digits on it to obtain the tag number; (3) Tracking each lamb throughout the visit using a tracking algorithm; (4) Recovering the ear tag number using an algorithm that incorporates a list of the ear tag numbers of the lambs in each pen, and the predictions for each lamb in each frame. The You Only Look Once deep learning object detection algorithm was applied to locate and localise the lamb's face and the digits in an image. The models' datasets contained 1 160 and 2 165 images for the training set, and 325 and 616 images for the validation set, respectively. The algorithm output includes the identity of each lamb that came to drink, and its duration. The identification system resulted in a total accuracy of 93% for the data tested, which consisted of approximately 900 visits to the drinking stations, and was collected in real time in a natural environment. The ground truth of each video of a visit was obtained by human observation by studying the video. We checked if there was indeed a visit to the water trough and if so we registered the ear tag number of each lamb whose head was above the water trough. Thus, identifying lambs in a commercial pen using a relatively inexpensive and easily installed system consisting of a RGB camera and a computer vision-based algorithm has potential for farm management.
first_indexed 2024-03-12T00:01:09Z
format Article
id doaj.art-7f8686d5f13a44f4a64251aefe4d10c3
institution Directory Open Access Journal
issn 1751-7311
language English
last_indexed 2024-03-12T00:01:09Z
publishDate 2023-09-01
publisher Elsevier
record_format Article
series Animal
spelling doaj.art-7f8686d5f13a44f4a64251aefe4d10c32023-09-18T04:29:48ZengElsevierAnimal1751-73112023-09-01179100923Machine vision-based automatic lamb identification and drinking activity in a commercial farmA. Alon0I. Shimshoni1A. Godo2R. Berenstein3J. Lepar4N. Bergman5I. Halachmi6Precision livestock farming (PLF) Lab., Agricultural Engineering Institute, Agricultural Research Organization (A.R.O.) – Volcani Institute, 68 Hamaccabim Road, P.O.B. 15159, Rishon Lezion 7505101, Israel; Dept. of Information Systems, Haifa University, 199 Abba Khoushy Ave, Haifa 3498838, IsraelDept. of Information Systems, Haifa University, 199 Abba Khoushy Ave, Haifa 3498838, IsraelPrecision livestock farming (PLF) Lab., Agricultural Engineering Institute, Agricultural Research Organization (A.R.O.) – Volcani Institute, 68 Hamaccabim Road, P.O.B. 15159, Rishon Lezion 7505101, IsraelPrecision livestock farming (PLF) Lab., Agricultural Engineering Institute, Agricultural Research Organization (A.R.O.) – Volcani Institute, 68 Hamaccabim Road, P.O.B. 15159, Rishon Lezion 7505101, IsraelPrecision livestock farming (PLF) Lab., Agricultural Engineering Institute, Agricultural Research Organization (A.R.O.) – Volcani Institute, 68 Hamaccabim Road, P.O.B. 15159, Rishon Lezion 7505101, IsraelPrecision livestock farming (PLF) Lab., Agricultural Engineering Institute, Agricultural Research Organization (A.R.O.) – Volcani Institute, 68 Hamaccabim Road, P.O.B. 15159, Rishon Lezion 7505101, IsraelPrecision livestock farming (PLF) Lab., Agricultural Engineering Institute, Agricultural Research Organization (A.R.O.) – Volcani Institute, 68 Hamaccabim Road, P.O.B. 15159, Rishon Lezion 7505101, Israel; Corresponding author.Using ear tags, farmers can track specific data for individual lambs such as age, medical records, body condition scores, genetic abnormalities; to make data-based decisions. However, automatic reading of ear tags using Radio Frequency Identification requires (a) an antenna, (b) a reader, (c) comparable reading standards; consequently, such a system can be expensive and impractical for a large group of lambs, especially in situations where animals are not required to have a compulsory Electronic identification, contrary to the case in Europe, where it is mandatory. Therefore, this paper proposes a machine vision system for indoor animals to identify individual lambs using existing ear tags. Using a camera that is installed such that the trough is visible, the drinking behaviour of the lambs can be automatically monitored. Data from different lamb groups in two different pens were collected. The identification algorithm includes a number of steps: (1) Detecting the lambs' face, and its ear tags in each image; (2) Cropping each ear tag image and discerning the digits on it to obtain the tag number; (3) Tracking each lamb throughout the visit using a tracking algorithm; (4) Recovering the ear tag number using an algorithm that incorporates a list of the ear tag numbers of the lambs in each pen, and the predictions for each lamb in each frame. The You Only Look Once deep learning object detection algorithm was applied to locate and localise the lamb's face and the digits in an image. The models' datasets contained 1 160 and 2 165 images for the training set, and 325 and 616 images for the validation set, respectively. The algorithm output includes the identity of each lamb that came to drink, and its duration. The identification system resulted in a total accuracy of 93% for the data tested, which consisted of approximately 900 visits to the drinking stations, and was collected in real time in a natural environment. The ground truth of each video of a visit was obtained by human observation by studying the video. We checked if there was indeed a visit to the water trough and if so we registered the ear tag number of each lamb whose head was above the water trough. Thus, identifying lambs in a commercial pen using a relatively inexpensive and easily installed system consisting of a RGB camera and a computer vision-based algorithm has potential for farm management.http://www.sciencedirect.com/science/article/pii/S1751731123002203Animal identificationArtificial IntelligenceDeep learningObject detectionSheep and goats
spellingShingle A. Alon
I. Shimshoni
A. Godo
R. Berenstein
J. Lepar
N. Bergman
I. Halachmi
Machine vision-based automatic lamb identification and drinking activity in a commercial farm
Animal
Animal identification
Artificial Intelligence
Deep learning
Object detection
Sheep and goats
title Machine vision-based automatic lamb identification and drinking activity in a commercial farm
title_full Machine vision-based automatic lamb identification and drinking activity in a commercial farm
title_fullStr Machine vision-based automatic lamb identification and drinking activity in a commercial farm
title_full_unstemmed Machine vision-based automatic lamb identification and drinking activity in a commercial farm
title_short Machine vision-based automatic lamb identification and drinking activity in a commercial farm
title_sort machine vision based automatic lamb identification and drinking activity in a commercial farm
topic Animal identification
Artificial Intelligence
Deep learning
Object detection
Sheep and goats
url http://www.sciencedirect.com/science/article/pii/S1751731123002203
work_keys_str_mv AT aalon machinevisionbasedautomaticlambidentificationanddrinkingactivityinacommercialfarm
AT ishimshoni machinevisionbasedautomaticlambidentificationanddrinkingactivityinacommercialfarm
AT agodo machinevisionbasedautomaticlambidentificationanddrinkingactivityinacommercialfarm
AT rberenstein machinevisionbasedautomaticlambidentificationanddrinkingactivityinacommercialfarm
AT jlepar machinevisionbasedautomaticlambidentificationanddrinkingactivityinacommercialfarm
AT nbergman machinevisionbasedautomaticlambidentificationanddrinkingactivityinacommercialfarm
AT ihalachmi machinevisionbasedautomaticlambidentificationanddrinkingactivityinacommercialfarm