Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol
<h4>Background</h4> Measurement of care quality and safety mainly relies on abstracted administrative data. However, it is well studied that administrative data-based adverse event (AE) detection methods are suboptimal due to lack of clinical information. Electronic medical records (EMR)...
| Main Authors: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2022-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9534418/?tool=EBI |
| _version_ | 1811195915255414784 |
|---|---|
| author | Guosong Wu Cathy Eastwood Yong Zeng Hude Quan Quan Long Zilong Zhang William A. Ghali Jeffrey Bakal Bastien Boussat Ward Flemons Alan Forster Danielle A. Southern Søren Knudsen Brittany Popowich Yuan Xu |
| author_facet | Guosong Wu Cathy Eastwood Yong Zeng Hude Quan Quan Long Zilong Zhang William A. Ghali Jeffrey Bakal Bastien Boussat Ward Flemons Alan Forster Danielle A. Southern Søren Knudsen Brittany Popowich Yuan Xu |
| author_sort | Guosong Wu |
| collection | DOAJ |
| description | <h4>Background</h4> Measurement of care quality and safety mainly relies on abstracted administrative data. However, it is well studied that administrative data-based adverse event (AE) detection methods are suboptimal due to lack of clinical information. Electronic medical records (EMR) have been widely implemented and contain detailed and comprehensive information regarding all aspects of patient care, offering a valuable complement to administrative data. Harnessing the rich clinical data in EMRs offers a unique opportunity to improve detection, identify possible risk factors of AE and enhance surveillance. However, the methodological tools for detection of AEs within EMR need to be developed and validated. The objectives of this study are to develop EMR-based AE algorithms from hospital EMR data and assess AE algorithm’s validity in Canadian EMR data. <h4>Methods</h4> Patient EMR structured and text data from acute care hospitals in Calgary, Alberta, Canada will be linked with discharge abstract data (DAD) between 2010 and 2020 (n~1.5 million). AE algorithms development. First, a comprehensive list of AEs will be generated through a systematic literature review and expert recommendations. Second, these AEs will be mapped to EMR free texts using Natural Language Processing (NLP) technologies. Finally, an expert panel will assess the clinical relevance of the developed NLP algorithms. AE algorithms validation: We will test the newly developed AE algorithms on 10,000 randomly selected EMRs between 2010 to 2020 from Calgary, Alberta. Trained reviewers will review the selected 10,000 EMR charts to identify AEs that had occurred during hospitalization. Performance indicators (e.g., sensitivity, specificity, positive predictive value, negative predictive value, F1 score, etc.) of the developed AE algorithms will be assessed using chart review data as the reference standard. <h4>Discussion</h4> The results of this project can be widely implemented in EMR based healthcare system to accurately and timely detect in-hospital AEs. |
| first_indexed | 2024-04-12T00:51:34Z |
| format | Article |
| id | doaj.art-61ba1d7c6e11487cad83b349b49f7ed6 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-04-12T00:51:34Z |
| publishDate | 2022-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-61ba1d7c6e11487cad83b349b49f7ed62022-12-22T03:54:44ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-011710Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocolGuosong WuCathy EastwoodYong ZengHude QuanQuan LongZilong ZhangWilliam A. GhaliJeffrey BakalBastien BoussatWard FlemonsAlan ForsterDanielle A. SouthernSøren KnudsenBrittany PopowichYuan Xu<h4>Background</h4> Measurement of care quality and safety mainly relies on abstracted administrative data. However, it is well studied that administrative data-based adverse event (AE) detection methods are suboptimal due to lack of clinical information. Electronic medical records (EMR) have been widely implemented and contain detailed and comprehensive information regarding all aspects of patient care, offering a valuable complement to administrative data. Harnessing the rich clinical data in EMRs offers a unique opportunity to improve detection, identify possible risk factors of AE and enhance surveillance. However, the methodological tools for detection of AEs within EMR need to be developed and validated. The objectives of this study are to develop EMR-based AE algorithms from hospital EMR data and assess AE algorithm’s validity in Canadian EMR data. <h4>Methods</h4> Patient EMR structured and text data from acute care hospitals in Calgary, Alberta, Canada will be linked with discharge abstract data (DAD) between 2010 and 2020 (n~1.5 million). AE algorithms development. First, a comprehensive list of AEs will be generated through a systematic literature review and expert recommendations. Second, these AEs will be mapped to EMR free texts using Natural Language Processing (NLP) technologies. Finally, an expert panel will assess the clinical relevance of the developed NLP algorithms. AE algorithms validation: We will test the newly developed AE algorithms on 10,000 randomly selected EMRs between 2010 to 2020 from Calgary, Alberta. Trained reviewers will review the selected 10,000 EMR charts to identify AEs that had occurred during hospitalization. Performance indicators (e.g., sensitivity, specificity, positive predictive value, negative predictive value, F1 score, etc.) of the developed AE algorithms will be assessed using chart review data as the reference standard. <h4>Discussion</h4> The results of this project can be widely implemented in EMR based healthcare system to accurately and timely detect in-hospital AEs.https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9534418/?tool=EBI |
| spellingShingle | Guosong Wu Cathy Eastwood Yong Zeng Hude Quan Quan Long Zilong Zhang William A. Ghali Jeffrey Bakal Bastien Boussat Ward Flemons Alan Forster Danielle A. Southern Søren Knudsen Brittany Popowich Yuan Xu Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol PLoS ONE |
| title | Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol |
| title_full | Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol |
| title_fullStr | Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol |
| title_full_unstemmed | Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol |
| title_short | Developing EMR-based algorithms to Identify hospital adverse events for health system performance evaluation and improvement: Study protocol |
| title_sort | developing emr based algorithms to identify hospital adverse events for health system performance evaluation and improvement study protocol |
| url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9534418/?tool=EBI |
| work_keys_str_mv | AT guosongwu developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT cathyeastwood developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT yongzeng developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT hudequan developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT quanlong developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT zilongzhang developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT williamaghali developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT jeffreybakal developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT bastienboussat developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT wardflemons developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT alanforster developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT danielleasouthern developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT sørenknudsen developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT brittanypopowich developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol AT yuanxu developingemrbasedalgorithmstoidentifyhospitaladverseeventsforhealthsystemperformanceevaluationandimprovementstudyprotocol |