Inter-Rater Reliability of Scoring Systems for Abomasal Lesions in Quebec Veal Calves
The objective of this study was to determine the inter-rater reliability of current scoring systems used to detect abomasal lesions in veal calves. In addition, macroscopic lesions were compared with corresponding histological lesions. For this, 76 abomasa were retrieved from veal calves in a slaugh...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-05-01
|
| Series: | Animals |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-2615/13/10/1664 |
| _version_ | 1797601435677884416 |
|---|---|
| author | Laura Van Driessche Gilles Fecteau Julie Arsenault Léa Miana Younes Chorfi Marianne Villettaz-Robichaud Pierre Hélie Sébastien Buczinski |
| author_facet | Laura Van Driessche Gilles Fecteau Julie Arsenault Léa Miana Younes Chorfi Marianne Villettaz-Robichaud Pierre Hélie Sébastien Buczinski |
| author_sort | Laura Van Driessche |
| collection | DOAJ |
| description | The objective of this study was to determine the inter-rater reliability of current scoring systems used to detect abomasal lesions in veal calves. In addition, macroscopic lesions were compared with corresponding histological lesions. For this, 76 abomasa were retrieved from veal calves in a slaughterhouse in Quebec and scored by four independent raters using current scoring systems. The localisations of the lesions were separated into pyloric, fundic, or torus pyloricus areas. Lesions were classified into three different types, i.e., erosions, ulcers, and scars. To estimate the inter-rater reliability, the coefficient type 1 of Gwet’s agreement and Fleiss <i>κ</i> were used for the presence or absence of a lesion, and the intra-class correlation coefficient was used for the number of lesions. All veal calves had at least one abomasal lesion detected. Most lesions were erosions, and most of them were located in the pyloric area. Overall, a poor to very good inter-rater agreement was seen for the pyloric area and the torus pyloricus regarding the presence or absence of a lesion (Fleiss <i>κ</i>: 0.00–0.34; Gwet’s AC1: 0.12–0.83), although a higher agreement was observed when combining all lesions in the pyloric area (Fleiss <i>κ</i>: 0.09–0.12; Gwet’s AC1: 0.43–0.93). For the fundic area, a poor to very good agreement was also observed (Fleiss <i>κ</i>: 0.17–0.70; Gwet’s AC1: 0.90–0.97). Regarding the inter-rater agreement for the number of lesions, a poor to moderate agreement was found (ICC: 0.11–0.73). When using the scoring system developed in the European Welfare Quality Protocol, a poor single random rater agreement (ICC: 0.42; 95% CI: 0.31–0.56) but acceptable average random rater agreement (ICC: 0.75; 95% CI: 0.64–0.83) was determined. Microscopic scar lesions were often mistaken as ulcers macroscopically. These results show that the scoring of abomasal lesions is challenging and highlight the need for a reliable scoring system. A fast, simple, and reliable scoring system would allow for large scale studies which investigate possible risk factors and hopefully help to prevent these lesions, which can compromise veal calves’ health and welfare. |
| first_indexed | 2024-03-11T04:00:52Z |
| format | Article |
| id | doaj.art-adaca7ced15141bd8d24c2dcfd475ab8 |
| institution | Directory Open Access Journal |
| issn | 2076-2615 |
| language | English |
| last_indexed | 2024-03-11T04:00:52Z |
| publishDate | 2023-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Animals |
| spelling | doaj.art-adaca7ced15141bd8d24c2dcfd475ab82023-11-18T00:10:26ZengMDPI AGAnimals2076-26152023-05-011310166410.3390/ani13101664Inter-Rater Reliability of Scoring Systems for Abomasal Lesions in Quebec Veal CalvesLaura Van Driessche0Gilles Fecteau1Julie Arsenault2Léa Miana3Younes Chorfi4Marianne Villettaz-Robichaud5Pierre Hélie6Sébastien Buczinski7Department of Clinical Science, Faculty of Veterinary Medicine, Université de Montréal, St-Hyacinthe, QC J2S 2M2, CanadaDepartment of Clinical Science, Faculty of Veterinary Medicine, Université de Montréal, St-Hyacinthe, QC J2S 2M2, CanadaDepartment of Veterinary Biomedicine, Faculty of Veterinary Medicine, Université de Montréal, St-Hyacinthe, QC J2S 2M2, CanadaÉcole Nationale Vétérinaire de Toulouse (ENVT), 31076 Toulouse, FranceDepartment of Veterinary Biomedicine, Faculty of Veterinary Medicine, Université de Montréal, St-Hyacinthe, QC J2S 2M2, CanadaDepartment of Clinical Science, Faculty of Veterinary Medicine, Université de Montréal, St-Hyacinthe, QC J2S 2M2, CanadaDepartment of Pathology and Microbiology, Faculty of Veterinary Medicine, Université de Montréal, St-Hyacinthe, QC J2S 2M2, CanadaDepartment of Clinical Science, Faculty of Veterinary Medicine, Université de Montréal, St-Hyacinthe, QC J2S 2M2, CanadaThe objective of this study was to determine the inter-rater reliability of current scoring systems used to detect abomasal lesions in veal calves. In addition, macroscopic lesions were compared with corresponding histological lesions. For this, 76 abomasa were retrieved from veal calves in a slaughterhouse in Quebec and scored by four independent raters using current scoring systems. The localisations of the lesions were separated into pyloric, fundic, or torus pyloricus areas. Lesions were classified into three different types, i.e., erosions, ulcers, and scars. To estimate the inter-rater reliability, the coefficient type 1 of Gwet’s agreement and Fleiss <i>κ</i> were used for the presence or absence of a lesion, and the intra-class correlation coefficient was used for the number of lesions. All veal calves had at least one abomasal lesion detected. Most lesions were erosions, and most of them were located in the pyloric area. Overall, a poor to very good inter-rater agreement was seen for the pyloric area and the torus pyloricus regarding the presence or absence of a lesion (Fleiss <i>κ</i>: 0.00–0.34; Gwet’s AC1: 0.12–0.83), although a higher agreement was observed when combining all lesions in the pyloric area (Fleiss <i>κ</i>: 0.09–0.12; Gwet’s AC1: 0.43–0.93). For the fundic area, a poor to very good agreement was also observed (Fleiss <i>κ</i>: 0.17–0.70; Gwet’s AC1: 0.90–0.97). Regarding the inter-rater agreement for the number of lesions, a poor to moderate agreement was found (ICC: 0.11–0.73). When using the scoring system developed in the European Welfare Quality Protocol, a poor single random rater agreement (ICC: 0.42; 95% CI: 0.31–0.56) but acceptable average random rater agreement (ICC: 0.75; 95% CI: 0.64–0.83) was determined. Microscopic scar lesions were often mistaken as ulcers macroscopically. These results show that the scoring of abomasal lesions is challenging and highlight the need for a reliable scoring system. A fast, simple, and reliable scoring system would allow for large scale studies which investigate possible risk factors and hopefully help to prevent these lesions, which can compromise veal calves’ health and welfare.https://www.mdpi.com/2076-2615/13/10/1664abomasal lesionsveal calvesscoring systemreliability |
| spellingShingle | Laura Van Driessche Gilles Fecteau Julie Arsenault Léa Miana Younes Chorfi Marianne Villettaz-Robichaud Pierre Hélie Sébastien Buczinski Inter-Rater Reliability of Scoring Systems for Abomasal Lesions in Quebec Veal Calves Animals abomasal lesions veal calves scoring system reliability |
| title | Inter-Rater Reliability of Scoring Systems for Abomasal Lesions in Quebec Veal Calves |
| title_full | Inter-Rater Reliability of Scoring Systems for Abomasal Lesions in Quebec Veal Calves |
| title_fullStr | Inter-Rater Reliability of Scoring Systems for Abomasal Lesions in Quebec Veal Calves |
| title_full_unstemmed | Inter-Rater Reliability of Scoring Systems for Abomasal Lesions in Quebec Veal Calves |
| title_short | Inter-Rater Reliability of Scoring Systems for Abomasal Lesions in Quebec Veal Calves |
| title_sort | inter rater reliability of scoring systems for abomasal lesions in quebec veal calves |
| topic | abomasal lesions veal calves scoring system reliability |
| url | https://www.mdpi.com/2076-2615/13/10/1664 |
| work_keys_str_mv | AT lauravandriessche interraterreliabilityofscoringsystemsforabomasallesionsinquebecvealcalves AT gillesfecteau interraterreliabilityofscoringsystemsforabomasallesionsinquebecvealcalves AT juliearsenault interraterreliabilityofscoringsystemsforabomasallesionsinquebecvealcalves AT leamiana interraterreliabilityofscoringsystemsforabomasallesionsinquebecvealcalves AT youneschorfi interraterreliabilityofscoringsystemsforabomasallesionsinquebecvealcalves AT mariannevillettazrobichaud interraterreliabilityofscoringsystemsforabomasallesionsinquebecvealcalves AT pierrehelie interraterreliabilityofscoringsystemsforabomasallesionsinquebecvealcalves AT sebastienbuczinski interraterreliabilityofscoringsystemsforabomasallesionsinquebecvealcalves |