Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary study
Purpose The purpose of this study was to record and evaluate interobserver agreement as quality control for the modified categorization of screening breast ultrasound developed by the Alliance for Breast Cancer Screening in Korea (ABCS-K) for the Mammography and Ultrasonography Study for Breast Canc...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korean Society of Ultrasound in Medicine
2019-04-01
|
| Series: | Ultrasonography |
| Subjects: | |
| Online Access: | http://www.e-ultrasonography.org/upload/usg-18012.pdf |
| _version_ | 1811341124549214208 |
|---|---|
| author | Eun Jung Choi Eun Hye Lee You Me Kim Yun-Woo Chang Jin Hwa Lee Young Mi Park Keum Won Kim Young Joong Kim Jae Kwan Jun Seri Hong |
| author_facet | Eun Jung Choi Eun Hye Lee You Me Kim Yun-Woo Chang Jin Hwa Lee Young Mi Park Keum Won Kim Young Joong Kim Jae Kwan Jun Seri Hong |
| author_sort | Eun Jung Choi |
| collection | DOAJ |
| description | Purpose The purpose of this study was to record and evaluate interobserver agreement as quality control for the modified categorization of screening breast ultrasound developed by the Alliance for Breast Cancer Screening in Korea (ABCS-K) for the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial. Methods Eight breast radiologists with 4-16 years of experience participated in 2 rounds of quality control testing for the MUST-BE trial. Two investigators randomly selected 125 and 100 cases of breast lesions with different ratios of malignant and benign lesions. Two versions of the modified categorization were tested. The initially modified classification was developed after the first quality control workshop, and the re-modified classification was developed after the second workshop. The re-modified categorization established by ABCS-K added size criteria and the anterior-posterior ratio compared with the initially modified classification. After a brief lecture on the modified categorization system prior to each quality control test, the eight radiologists independently categorized the lesions using the modified categorization. Interobserver agreement was measured using kappa statistics. Results The overall kappa values for the modified categorizations indicated moderate to substantial degrees of agreement (initially modified categorization and re-modified categorization: κ=0.52 and κ=0.63, respectively). The kappa values for the subcategories of category 4 were 0.37 (95% confidence interval [CI], 0.24 to 0.52) and 0.39 (95% CI, 0.31 to 0.49), respectively. The overall kappa values for both the initially modified categorization and the re-modified categorization indicated a substantial degree of agreement when dichotomizing the interpretation as benign or suspicious. Conclusion The preliminary results demonstrated acceptable interobserver agreement for the modified categorization. |
| first_indexed | 2024-04-13T18:52:07Z |
| format | Article |
| id | doaj.art-cb11db489da94732bfa1b492f20b5bac |
| institution | Directory Open Access Journal |
| issn | 2288-5919 2288-5943 |
| language | English |
| last_indexed | 2024-04-13T18:52:07Z |
| publishDate | 2019-04-01 |
| publisher | Korean Society of Ultrasound in Medicine |
| record_format | Article |
| series | Ultrasonography |
| spelling | doaj.art-cb11db489da94732bfa1b492f20b5bac2022-12-22T02:34:23ZengKorean Society of Ultrasound in MedicineUltrasonography2288-59192288-59432019-04-0138217218010.14366/usg.180121038Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary studyEun Jung Choi0Eun Hye Lee1You Me Kim2Yun-Woo Chang3Jin Hwa Lee4Young Mi Park5Keum Won Kim6Young Joong Kim7Jae Kwan Jun8Seri Hong9 Department of Radiology and Research Institute of Clinical Medicine of Chonbuk National University-Biomedical Research Institute of Chonbuk National University Hospital, Chonbuk National University Medical School, Jeonju, Korea Department of Radiology, Soonchunhyang University Bucheon Hospital, Soonchunhyang University College of Medicine, Bucheon, Korea Department of Radiology, Dankook University Hospital, Dankook University College of Medicine, Cheonan, Korea Department of Radiology, Soonchunhyang University Seoul Hospital, Soonchunhyang University College of Medicine, Seoul, Korea Department of Radiology, Dong-A University Hospital, Dong-A University College of Medicine, Busan, Korea Department of Radiology, Inje University Busan Paik Hospital, Busan, Korea Department of Radiology, Konyang University Hospital, Konyang University College of Medicine, Daejeon, Korea Department of Radiology, Konyang University Hospital, Konyang University College of Medicine, Daejeon, Korea National Cancer Control Institute, National Cancer Center, Goyang, Korea National Cancer Control Institute, National Cancer Center, Goyang, KoreaPurpose The purpose of this study was to record and evaluate interobserver agreement as quality control for the modified categorization of screening breast ultrasound developed by the Alliance for Breast Cancer Screening in Korea (ABCS-K) for the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial. Methods Eight breast radiologists with 4-16 years of experience participated in 2 rounds of quality control testing for the MUST-BE trial. Two investigators randomly selected 125 and 100 cases of breast lesions with different ratios of malignant and benign lesions. Two versions of the modified categorization were tested. The initially modified classification was developed after the first quality control workshop, and the re-modified classification was developed after the second workshop. The re-modified categorization established by ABCS-K added size criteria and the anterior-posterior ratio compared with the initially modified classification. After a brief lecture on the modified categorization system prior to each quality control test, the eight radiologists independently categorized the lesions using the modified categorization. Interobserver agreement was measured using kappa statistics. Results The overall kappa values for the modified categorizations indicated moderate to substantial degrees of agreement (initially modified categorization and re-modified categorization: κ=0.52 and κ=0.63, respectively). The kappa values for the subcategories of category 4 were 0.37 (95% confidence interval [CI], 0.24 to 0.52) and 0.39 (95% CI, 0.31 to 0.49), respectively. The overall kappa values for both the initially modified categorization and the re-modified categorization indicated a substantial degree of agreement when dichotomizing the interpretation as benign or suspicious. Conclusion The preliminary results demonstrated acceptable interobserver agreement for the modified categorization.http://www.e-ultrasonography.org/upload/usg-18012.pdfScreeningNeoplasmsBreast neoplasmsUltrasonographyInterobserver variability |
| spellingShingle | Eun Jung Choi Eun Hye Lee You Me Kim Yun-Woo Chang Jin Hwa Lee Young Mi Park Keum Won Kim Young Joong Kim Jae Kwan Jun Seri Hong Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary study Ultrasonography Screening Neoplasms Breast neoplasms Ultrasonography Interobserver variability |
| title | Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary study |
| title_full | Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary study |
| title_fullStr | Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary study |
| title_full_unstemmed | Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary study |
| title_short | Interobserver agreement in breast ultrasound categorization in the Mammography and Ultrasonography Study for Breast Cancer Screening Effectiveness (MUST-BE) trial: results of a preliminary study |
| title_sort | interobserver agreement in breast ultrasound categorization in the mammography and ultrasonography study for breast cancer screening effectiveness must be trial results of a preliminary study |
| topic | Screening Neoplasms Breast neoplasms Ultrasonography Interobserver variability |
| url | http://www.e-ultrasonography.org/upload/usg-18012.pdf |
| work_keys_str_mv | AT eunjungchoi interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT eunhyelee interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT youmekim interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT yunwoochang interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT jinhwalee interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT youngmipark interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT keumwonkim interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT youngjoongkim interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT jaekwanjun interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy AT serihong interobserveragreementinbreastultrasoundcategorizationinthemammographyandultrasonographystudyforbreastcancerscreeningeffectivenessmustbetrialresultsofapreliminarystudy |