Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration
Purpose: To determine the interreader agreement for reticular pseudodrusen (RPD) assessment on combined infrared reflectance (IR) and OCT imaging in the early stages of age-related macular degeneration across a range of different criteria to define their presence. Design: Interreader agreement study...
| Main Authors: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-12-01
|
| Series: | Ophthalmology Science |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S266691452300057X |
| _version_ | 1797377756419325952 |
|---|---|
| author | Zhichao Wu, BAppSc(Optom), PhD Steffen Schmitz-Valckenberg, MD Barbara A. Blodi, MD Frank G. Holz, MD Glenn J. Jaffe, MD Sandra Liakopoulos, MD Srinivas R. Sadda, MD Mari Bonse, BSc Tyler Brown, COA John Choong, BS Bailey Clifton, COA Giulia Corradetti, MD Federico Corvi, MD Andrew C. Dieu, MD Vivienne Dooling, MD Jeong W. Pak, PhD Marlene Saßmannshausen, MD Cindy Skalak, RN, COT Sarah Thiele, MD Robyn H. Guymer, MBBS, PhD |
| author_facet | Zhichao Wu, BAppSc(Optom), PhD Steffen Schmitz-Valckenberg, MD Barbara A. Blodi, MD Frank G. Holz, MD Glenn J. Jaffe, MD Sandra Liakopoulos, MD Srinivas R. Sadda, MD Mari Bonse, BSc Tyler Brown, COA John Choong, BS Bailey Clifton, COA Giulia Corradetti, MD Federico Corvi, MD Andrew C. Dieu, MD Vivienne Dooling, MD Jeong W. Pak, PhD Marlene Saßmannshausen, MD Cindy Skalak, RN, COT Sarah Thiele, MD Robyn H. Guymer, MBBS, PhD |
| author_sort | Zhichao Wu, BAppSc(Optom), PhD |
| collection | DOAJ |
| description | Purpose: To determine the interreader agreement for reticular pseudodrusen (RPD) assessment on combined infrared reflectance (IR) and OCT imaging in the early stages of age-related macular degeneration across a range of different criteria to define their presence. Design: Interreader agreement study. Participants: Twelve readers from 6 reading centers. Methods: All readers evaluated 100 eyes from individuals with bilateral large drusen for the following: (1) the presence of RPD across a range of different criteria and (2) the number of Stage 2 or 3 RPD lesions (from 0 to ≥ 5 lesions) on an entire OCT volume scan and on a selected OCT B-scan. Supportive information was available from the corresponding IR image. Main Outcome Measures: Interreader agreement, as assessed by Gwet’s first-order agreement coefficient (AC1). Results: When evaluating an entire OCT volume scan, there was substantial interreader agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions, and ≥ 5 definite lesions on en face IR images corresponding to Stage 2 or 3 lesions (AC1 = 0.60–0.72). On selected OCT B-scans, there was also moderate-to-substantial agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions (AC1 = 0.58–0.65) and increasing levels of agreement with increasing RPD stage (AC1 = 0.08, 0.56, 0.78, and 0.99 for the presence of any Stage 1, 2, 3, and 4 lesions, respectively). There was substantial agreement regarding the number of Stage 2 or 3 lesions on an entire OCT volume scan (AC1 = 0.68), but only fair agreement for this evaluation on selected B-scans (AC1 = 0.30). Conclusions: There was generally substantial or near-substantial—but not near-perfect—agreement for assessing the presence of RPD on entire OCT volume scans or selected B-scans across a range of differing RPD criteria. These findings underscore how interreader variability would likely contribute to the variability of findings related to the clinical associations of RPD. The low levels of agreement for assessing RPD number on OCT B-scans underscore the likely challenges of quantifying RPD extent with manual grading. Financial Disclosure(s): Proprietary or commercial disclosure may be found after the references. |
| first_indexed | 2024-03-08T19:58:06Z |
| format | Article |
| id | doaj.art-5dcf29c8a3ea4d1ab991270969b70160 |
| institution | Directory Open Access Journal |
| issn | 2666-9145 |
| language | English |
| last_indexed | 2024-03-08T19:58:06Z |
| publishDate | 2023-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Ophthalmology Science |
| spelling | doaj.art-5dcf29c8a3ea4d1ab991270969b701602023-12-24T04:47:02ZengElsevierOphthalmology Science2666-91452023-12-0134100325Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular DegenerationZhichao Wu, BAppSc(Optom), PhD0Steffen Schmitz-Valckenberg, MD1Barbara A. Blodi, MD2Frank G. Holz, MD3Glenn J. Jaffe, MD4Sandra Liakopoulos, MD5Srinivas R. Sadda, MD6Mari Bonse, BSc7Tyler Brown, COA8John Choong, BS9Bailey Clifton, COA10Giulia Corradetti, MD11Federico Corvi, MD12Andrew C. Dieu, MD13Vivienne Dooling, MD14Jeong W. Pak, PhD15Marlene Saßmannshausen, MD16Cindy Skalak, RN, COT17Sarah Thiele, MD18Robyn H. Guymer, MBBS, PhD19Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Australia; Ophthalmology, Department of Surgery, The University of Melbourne, Melbourne, Australia; Correspondence: Zhichao Wu, BAppSc(Optom), PhD, Centre for Eye Research Australia, Level 7, 32 Gisborne Street, East Melbourne, VIC 3002, Australia.Department of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, Germany; Utah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, UtahDepartment of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, WisconsinDepartment of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, GermanyDepartment of Ophthalmology, Duke University, Durham, North CarolinaCologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany; Department of Ophthalmology, Goethe-University Frankfurt, GermanyDoheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, CaliforniaCologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, GermanyUtah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, UtahDepartment of Ophthalmology, Duke University, Durham, North CarolinaUtah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, UtahDoheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, CaliforniaDoheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, CaliforniaDepartment of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, WisconsinCologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, GermanyDepartment of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, WisconsinDepartment of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, GermanyDepartment of Ophthalmology, Duke University, Durham, North CarolinaDepartment of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, GermanyCentre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Australia; Ophthalmology, Department of Surgery, The University of Melbourne, Melbourne, AustraliaPurpose: To determine the interreader agreement for reticular pseudodrusen (RPD) assessment on combined infrared reflectance (IR) and OCT imaging in the early stages of age-related macular degeneration across a range of different criteria to define their presence. Design: Interreader agreement study. Participants: Twelve readers from 6 reading centers. Methods: All readers evaluated 100 eyes from individuals with bilateral large drusen for the following: (1) the presence of RPD across a range of different criteria and (2) the number of Stage 2 or 3 RPD lesions (from 0 to ≥ 5 lesions) on an entire OCT volume scan and on a selected OCT B-scan. Supportive information was available from the corresponding IR image. Main Outcome Measures: Interreader agreement, as assessed by Gwet’s first-order agreement coefficient (AC1). Results: When evaluating an entire OCT volume scan, there was substantial interreader agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions, and ≥ 5 definite lesions on en face IR images corresponding to Stage 2 or 3 lesions (AC1 = 0.60–0.72). On selected OCT B-scans, there was also moderate-to-substantial agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions (AC1 = 0.58–0.65) and increasing levels of agreement with increasing RPD stage (AC1 = 0.08, 0.56, 0.78, and 0.99 for the presence of any Stage 1, 2, 3, and 4 lesions, respectively). There was substantial agreement regarding the number of Stage 2 or 3 lesions on an entire OCT volume scan (AC1 = 0.68), but only fair agreement for this evaluation on selected B-scans (AC1 = 0.30). Conclusions: There was generally substantial or near-substantial—but not near-perfect—agreement for assessing the presence of RPD on entire OCT volume scans or selected B-scans across a range of differing RPD criteria. These findings underscore how interreader variability would likely contribute to the variability of findings related to the clinical associations of RPD. The low levels of agreement for assessing RPD number on OCT B-scans underscore the likely challenges of quantifying RPD extent with manual grading. Financial Disclosure(s): Proprietary or commercial disclosure may be found after the references.http://www.sciencedirect.com/science/article/pii/S266691452300057XAge-related macular degenerationDrusenOCTReticular pseudodrusenSubretinal drusenoid deposits |
| spellingShingle | Zhichao Wu, BAppSc(Optom), PhD Steffen Schmitz-Valckenberg, MD Barbara A. Blodi, MD Frank G. Holz, MD Glenn J. Jaffe, MD Sandra Liakopoulos, MD Srinivas R. Sadda, MD Mari Bonse, BSc Tyler Brown, COA John Choong, BS Bailey Clifton, COA Giulia Corradetti, MD Federico Corvi, MD Andrew C. Dieu, MD Vivienne Dooling, MD Jeong W. Pak, PhD Marlene Saßmannshausen, MD Cindy Skalak, RN, COT Sarah Thiele, MD Robyn H. Guymer, MBBS, PhD Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration Ophthalmology Science Age-related macular degeneration Drusen OCT Reticular pseudodrusen Subretinal drusenoid deposits |
| title | Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration |
| title_full | Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration |
| title_fullStr | Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration |
| title_full_unstemmed | Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration |
| title_short | Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration |
| title_sort | reticular pseudodrusen interreader agreement of evaluation on oct imaging in age related macular degeneration |
| topic | Age-related macular degeneration Drusen OCT Reticular pseudodrusen Subretinal drusenoid deposits |
| url | http://www.sciencedirect.com/science/article/pii/S266691452300057X |
| work_keys_str_mv | AT zhichaowubappscoptomphd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT steffenschmitzvalckenbergmd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT barbaraablodimd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT frankgholzmd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT glennjjaffemd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT sandraliakopoulosmd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT srinivasrsaddamd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT maribonsebsc reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT tylerbrowncoa reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT johnchoongbs reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT baileycliftoncoa reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT giuliacorradettimd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT federicocorvimd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT andrewcdieumd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT viviennedoolingmd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT jeongwpakphd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT marlenesaßmannshausenmd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT cindyskalakrncot reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT sarahthielemd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration AT robynhguymermbbsphd reticularpseudodruseninterreaderagreementofevaluationonoctimaginginagerelatedmaculardegeneration |