Reliability among central readers in the evaluation of endoscopic disease activity in pouchitis
<h4>Background and Aims</h4> <p>Pouchitis is a common adverse event after proctocolectomy with ileal pouch anal anastomosis for ulcerative colitis. Evaluation of pouchitis disease activity and response to treatment requires use of validated indices. We assessed the reliability of...
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Elsevier
2018
|
| _version_ | 1797076035703930880 |
|---|---|
| author | Samaan, MA Shen, B Mosli, MH Zou, G Sandborn, WJ Shackelton, LM Nelson, S Stitt, L Bloom, S Pardi, DS Gionchetti, P Lindsay, J Travis, S Hart, A Silverberg, MS Feagan, BG D'Haens, GR Jairath, V |
| author_facet | Samaan, MA Shen, B Mosli, MH Zou, G Sandborn, WJ Shackelton, LM Nelson, S Stitt, L Bloom, S Pardi, DS Gionchetti, P Lindsay, J Travis, S Hart, A Silverberg, MS Feagan, BG D'Haens, GR Jairath, V |
| author_sort | Samaan, MA |
| collection | OXFORD |
| description | <h4>Background and Aims</h4> <p>Pouchitis is a common adverse event after proctocolectomy with ileal pouch anal anastomosis for ulcerative colitis. Evaluation of pouchitis disease activity and response to treatment requires use of validated indices. We assessed the reliability of items evaluating endoscopic pouchitis disease activity.</p> <h4>Methods</h4> <p>Twelve panelists used a modified RAND appropriateness methodology to rate the appropriateness of items evaluating endoscopic pouchitis disease activity derived from a systematic review and also identified additional potential endoscopic items based on expert opinion. Four central readers then evaluated 50 pouchoscopy videos in triplicate, in random order. Intra- and inter-rater reliability for each item was assessed by calculating and comparing intraclass correlation coefficients (ICCs). A Delphi process identified common sources of disagreement among the readers.</p> <h4>Results</h4> <p>Ten existing endoscopic items were identified from the systematic review and an additional 7 exploratory items from the panelists. ICCs for inter-rater reliability were highest for the existing item of pouch ulceration (.72; 95% confidence interval [CI], .60-.82) and for the exploratory item of ulcerated surface in the pouch body (.67; 95% CI, .53-.75). Inter-rater reliability for all other existing and exploratory items was “moderate” (ICC < .60). The item “ulcerated surface in the pouch body” demonstrated the best correlation with a global evaluation of lesion severity (r = .80; 95% CI, .73-.85).</p> <h4>Conclusion</h4> <p>Substantial reliability was observed only for the endoscopic items of ulceration and ulcerated surface in the pouch body. Future studies should assess responsiveness to treatment in the next stage toward development of an endoscopic pouchitis disease activity index.</p> |
| first_indexed | 2024-03-06T23:58:30Z |
| format | Journal article |
| id | oxford-uuid:7512725f-ce36-4473-b324-45354e01a0d6 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T23:58:30Z |
| publishDate | 2018 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | oxford-uuid:7512725f-ce36-4473-b324-45354e01a0d62022-03-26T20:07:16ZReliability among central readers in the evaluation of endoscopic disease activity in pouchitisJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:7512725f-ce36-4473-b324-45354e01a0d6EnglishSymplectic Elements at OxfordElsevier2018Samaan, MAShen, BMosli, MHZou, GSandborn, WJShackelton, LMNelson, SStitt, LBloom, SPardi, DSGionchetti, PLindsay, JTravis, SHart, ASilverberg, MSFeagan, BGD'Haens, GRJairath, V <h4>Background and Aims</h4> <p>Pouchitis is a common adverse event after proctocolectomy with ileal pouch anal anastomosis for ulcerative colitis. Evaluation of pouchitis disease activity and response to treatment requires use of validated indices. We assessed the reliability of items evaluating endoscopic pouchitis disease activity.</p> <h4>Methods</h4> <p>Twelve panelists used a modified RAND appropriateness methodology to rate the appropriateness of items evaluating endoscopic pouchitis disease activity derived from a systematic review and also identified additional potential endoscopic items based on expert opinion. Four central readers then evaluated 50 pouchoscopy videos in triplicate, in random order. Intra- and inter-rater reliability for each item was assessed by calculating and comparing intraclass correlation coefficients (ICCs). A Delphi process identified common sources of disagreement among the readers.</p> <h4>Results</h4> <p>Ten existing endoscopic items were identified from the systematic review and an additional 7 exploratory items from the panelists. ICCs for inter-rater reliability were highest for the existing item of pouch ulceration (.72; 95% confidence interval [CI], .60-.82) and for the exploratory item of ulcerated surface in the pouch body (.67; 95% CI, .53-.75). Inter-rater reliability for all other existing and exploratory items was “moderate” (ICC < .60). The item “ulcerated surface in the pouch body” demonstrated the best correlation with a global evaluation of lesion severity (r = .80; 95% CI, .73-.85).</p> <h4>Conclusion</h4> <p>Substantial reliability was observed only for the endoscopic items of ulceration and ulcerated surface in the pouch body. Future studies should assess responsiveness to treatment in the next stage toward development of an endoscopic pouchitis disease activity index.</p> |
| spellingShingle | Samaan, MA Shen, B Mosli, MH Zou, G Sandborn, WJ Shackelton, LM Nelson, S Stitt, L Bloom, S Pardi, DS Gionchetti, P Lindsay, J Travis, S Hart, A Silverberg, MS Feagan, BG D'Haens, GR Jairath, V Reliability among central readers in the evaluation of endoscopic disease activity in pouchitis |
| title | Reliability among central readers in the evaluation of endoscopic disease activity in pouchitis |
| title_full | Reliability among central readers in the evaluation of endoscopic disease activity in pouchitis |
| title_fullStr | Reliability among central readers in the evaluation of endoscopic disease activity in pouchitis |
| title_full_unstemmed | Reliability among central readers in the evaluation of endoscopic disease activity in pouchitis |
| title_short | Reliability among central readers in the evaluation of endoscopic disease activity in pouchitis |
| title_sort | reliability among central readers in the evaluation of endoscopic disease activity in pouchitis |
| work_keys_str_mv | AT samaanma reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT shenb reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT moslimh reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT zoug reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT sandbornwj reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT shackeltonlm reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT nelsons reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT stittl reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT blooms reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT pardids reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT gionchettip reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT lindsayj reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT traviss reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT harta reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT silverbergms reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT feaganbg reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT dhaensgr reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis AT jairathv reliabilityamongcentralreadersintheevaluationofendoscopicdiseaseactivityinpouchitis |