Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imaging

Background Our aim is to determine the interobserver reliability for surgeons to detect Hill-Sachs lesions on magnetic resonance imaging (MRI), the certainty of judgement, and the effects of surgeon characteristics on agreement. Methods Twenty-nine patients with Hill-Sachs lesions or other lesions w...

Full description

Bibliographic Details
Main Authors: Hassanin Alkaduhimi, Aïmane Saarig, Ihsan Amajjar, Just A. van der Linde, Marieke F. van Wier, Nienke W. Willigenburg, Michel P.J. van den Bekerom
Format: Article
Language:English
Published: Korean Shoulder and Elbow Society 2021-06-01
Series:Clinics in Shoulder and Elbow
Subjects:
Online Access:http://www.cisejournal.org/upload/pdf/cise-2021-00115.pdf
_version_ 1797329561730416640
author Hassanin Alkaduhimi
Aïmane Saarig
Ihsan Amajjar
Just A. van der Linde
Marieke F. van Wier
Nienke W. Willigenburg
Michel P.J. van den Bekerom
author_facet Hassanin Alkaduhimi
Aïmane Saarig
Ihsan Amajjar
Just A. van der Linde
Marieke F. van Wier
Nienke W. Willigenburg
Michel P.J. van den Bekerom
author_sort Hassanin Alkaduhimi
collection DOAJ
description Background Our aim is to determine the interobserver reliability for surgeons to detect Hill-Sachs lesions on magnetic resonance imaging (MRI), the certainty of judgement, and the effects of surgeon characteristics on agreement. Methods Twenty-nine patients with Hill-Sachs lesions or other lesions with a similar appearance on MRIs were presented to 20 surgeons without any patient characteristics. The surgeons answered questions on the presence of Hill-Sachs lesions and the certainty of diagnosis. Interobserver agreement was assessed using the Fleiss’ kappa (κ) and percentage of agreement. Agreement between surgeons was compared using a technique similar to the pairwise t-test for means, based on large-sample linear approximation of Fleiss' kappa, with Bonferroni correction. Results The agreement between surgeons in detecting Hill-Sachs lesions on MRI was fair (69% agreement; κ, 0.304; p<0.001). In 84% of the cases, surgeons were certain or highly certain about the presence of a Hill-Sachs lesion. Conclusions Although surgeons reported high levels of certainty for their ability to detect Hill-Sachs lesions, there was only a fair amount of agreement between surgeons in detecting Hill-Sachs lesions on MRI. This indicates that clear criteria for defining Hill-Sachs lesions are lacking, which hampers accurate diagnosis and can compromise treatment.
first_indexed 2024-03-08T07:07:24Z
format Article
id doaj.art-10623737e78841a3a89b89342cee9e95
institution Directory Open Access Journal
issn 2288-8721
language English
last_indexed 2024-03-08T07:07:24Z
publishDate 2021-06-01
publisher Korean Shoulder and Elbow Society
record_format Article
series Clinics in Shoulder and Elbow
spelling doaj.art-10623737e78841a3a89b89342cee9e952024-02-03T04:08:53ZengKorean Shoulder and Elbow SocietyClinics in Shoulder and Elbow2288-87212021-06-012429810510.5397/cise.2021.00115798Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imagingHassanin Alkaduhimi0Aïmane Saarig1Ihsan Amajjar2Just A. van der Linde3Marieke F. van Wier4Nienke W. Willigenburg5Michel P.J. van den Bekerom6 Shoulder and Elbow Unit, Joint Research, OLVG Hospital, Amsterdam, Netherlands Shoulder and Elbow Unit, Joint Research, OLVG Hospital, Amsterdam, Netherlands Shoulder and Elbow Unit, Joint Research, OLVG Hospital, Amsterdam, Netherlands Department of Orthopedic Surgery and Traumatology, Reinier Haga Orthopedisch Centrum, Zoetermeer, Netherlands Shoulder and Elbow Unit, Joint Research, OLVG Hospital, Amsterdam, Netherlands Shoulder and Elbow Unit, Joint Research, OLVG Hospital, Amsterdam, Netherlands Shoulder and Elbow Unit, Joint Research, OLVG Hospital, Amsterdam, NetherlandsBackground Our aim is to determine the interobserver reliability for surgeons to detect Hill-Sachs lesions on magnetic resonance imaging (MRI), the certainty of judgement, and the effects of surgeon characteristics on agreement. Methods Twenty-nine patients with Hill-Sachs lesions or other lesions with a similar appearance on MRIs were presented to 20 surgeons without any patient characteristics. The surgeons answered questions on the presence of Hill-Sachs lesions and the certainty of diagnosis. Interobserver agreement was assessed using the Fleiss’ kappa (κ) and percentage of agreement. Agreement between surgeons was compared using a technique similar to the pairwise t-test for means, based on large-sample linear approximation of Fleiss' kappa, with Bonferroni correction. Results The agreement between surgeons in detecting Hill-Sachs lesions on MRI was fair (69% agreement; κ, 0.304; p<0.001). In 84% of the cases, surgeons were certain or highly certain about the presence of a Hill-Sachs lesion. Conclusions Although surgeons reported high levels of certainty for their ability to detect Hill-Sachs lesions, there was only a fair amount of agreement between surgeons in detecting Hill-Sachs lesions on MRI. This indicates that clear criteria for defining Hill-Sachs lesions are lacking, which hampers accurate diagnosis and can compromise treatment.http://www.cisejournal.org/upload/pdf/cise-2021-00115.pdfobserver variationshoulderjoint instabilitybankart lesionshill-sachs
spellingShingle Hassanin Alkaduhimi
Aïmane Saarig
Ihsan Amajjar
Just A. van der Linde
Marieke F. van Wier
Nienke W. Willigenburg
Michel P.J. van den Bekerom
Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imaging
Clinics in Shoulder and Elbow
observer variation
shoulder
joint instability
bankart lesions
hill-sachs
title Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imaging
title_full Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imaging
title_fullStr Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imaging
title_full_unstemmed Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imaging
title_short Interobserver agreement for detecting Hill-Sachs lesions on magnetic resonance imaging
title_sort interobserver agreement for detecting hill sachs lesions on magnetic resonance imaging
topic observer variation
shoulder
joint instability
bankart lesions
hill-sachs
url http://www.cisejournal.org/upload/pdf/cise-2021-00115.pdf
work_keys_str_mv AT hassaninalkaduhimi interobserveragreementfordetectinghillsachslesionsonmagneticresonanceimaging
AT aimanesaarig interobserveragreementfordetectinghillsachslesionsonmagneticresonanceimaging
AT ihsanamajjar interobserveragreementfordetectinghillsachslesionsonmagneticresonanceimaging
AT justavanderlinde interobserveragreementfordetectinghillsachslesionsonmagneticresonanceimaging
AT mariekefvanwier interobserveragreementfordetectinghillsachslesionsonmagneticresonanceimaging
AT nienkewwilligenburg interobserveragreementfordetectinghillsachslesionsonmagneticresonanceimaging
AT michelpjvandenbekerom interobserveragreementfordetectinghillsachslesionsonmagneticresonanceimaging