Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study
BackgroundIt is assumed that the implementation of health information technology introduces new vulnerabilities within a complex sociotechnical health care system, but no international consensus exists on a standardized format for enhancing the collection, analysis, and inter...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
JMIR Publications
2021-08-01
|
Series: | JMIR Medical Informatics |
Online Access: | https://medinform.jmir.org/2021/8/e30470 |
_version_ | 1797735722779672576 |
---|---|
author | Sari Palojoki Kaija Saranto Elina Reponen Noora Skants Anne Vakkuri Riikka Vuokko |
author_facet | Sari Palojoki Kaija Saranto Elina Reponen Noora Skants Anne Vakkuri Riikka Vuokko |
author_sort | Sari Palojoki |
collection | DOAJ |
description |
BackgroundIt is assumed that the implementation of health information technology introduces new vulnerabilities within a complex sociotechnical health care system, but no international consensus exists on a standardized format for enhancing the collection, analysis, and interpretation of technology-induced errors.
ObjectiveThis study aims to develop a classification for patient safety incident reporting associated with the use of mature electronic health records (EHRs). It also aims to validate the classification by using a data set of incidents during a 6-month period immediately after the implementation of a new EHR system.
MethodsThe starting point of the classification development was the Finnish Technology-Induced Error Risk Assessment Scale tool, based on research on commonly recognized error types. A multiprofessional research team used iterative tests on consensus building to develop a classification system. The final classification, with preliminary descriptions of classes, was validated by applying it to analyze EHR-related error incidents (n=428) during the implementation phase of a new EHR system and also to evaluate this classification’s characteristics and applicability for reporting incidents. Interrater agreement was applied.
ResultsThe number of EHR-related patient safety incidents during the implementation period (n=501) was five-fold when compared with the preimplementation period (n=82). The literature identified new error types that were added to the emerging classification. Error types were adapted iteratively after several test rounds to develop a classification for reporting patient safety incidents in the clinical use of a high-maturity EHR system. Of the 427 classified patient safety incidents, interface problems accounted for 96 (22.5%) incident reports, usability problems for 73 (17.1%), documentation problems for 60 (14.1%), and clinical workflow problems for 33 (7.7%). Altogether, 20.8% (89/427) of reports were related to medication section problems, and downtime problems were rare (n=8). During the classification work, 14.8% (74/501) of reports of the original sample were rejected because of insufficient information, even though the reports were deemed to be related to EHRs. The interrater agreement during the blinded review was 97.7%.
ConclusionsThis study presents a new classification for EHR-related patient safety incidents applicable to mature EHRs. The number of EHR-related patient safety incidents during the implementation period may reflect patient safety challenges during the implementation of a new type of high-maturity EHR system. The results indicate that the types of errors previously identified in the literature change with the EHR development cycle. |
first_indexed | 2024-03-12T13:03:11Z |
format | Article |
id | doaj.art-324c9a10a1ba4482bbd6801c44398d8d |
institution | Directory Open Access Journal |
issn | 2291-9694 |
language | English |
last_indexed | 2024-03-12T13:03:11Z |
publishDate | 2021-08-01 |
publisher | JMIR Publications |
record_format | Article |
series | JMIR Medical Informatics |
spelling | doaj.art-324c9a10a1ba4482bbd6801c44398d8d2023-08-28T18:42:38ZengJMIR PublicationsJMIR Medical Informatics2291-96942021-08-0198e3047010.2196/30470Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation StudySari Palojokihttps://orcid.org/0000-0003-3047-9713Kaija Sarantohttps://orcid.org/0000-0002-3195-1955Elina Reponenhttps://orcid.org/0000-0003-2974-9683Noora Skantshttps://orcid.org/0000-0002-1470-4397Anne Vakkurihttps://orcid.org/0000-0003-4708-1779Riikka Vuokkohttps://orcid.org/0000-0003-3495-2336 BackgroundIt is assumed that the implementation of health information technology introduces new vulnerabilities within a complex sociotechnical health care system, but no international consensus exists on a standardized format for enhancing the collection, analysis, and interpretation of technology-induced errors. ObjectiveThis study aims to develop a classification for patient safety incident reporting associated with the use of mature electronic health records (EHRs). It also aims to validate the classification by using a data set of incidents during a 6-month period immediately after the implementation of a new EHR system. MethodsThe starting point of the classification development was the Finnish Technology-Induced Error Risk Assessment Scale tool, based on research on commonly recognized error types. A multiprofessional research team used iterative tests on consensus building to develop a classification system. The final classification, with preliminary descriptions of classes, was validated by applying it to analyze EHR-related error incidents (n=428) during the implementation phase of a new EHR system and also to evaluate this classification’s characteristics and applicability for reporting incidents. Interrater agreement was applied. ResultsThe number of EHR-related patient safety incidents during the implementation period (n=501) was five-fold when compared with the preimplementation period (n=82). The literature identified new error types that were added to the emerging classification. Error types were adapted iteratively after several test rounds to develop a classification for reporting patient safety incidents in the clinical use of a high-maturity EHR system. Of the 427 classified patient safety incidents, interface problems accounted for 96 (22.5%) incident reports, usability problems for 73 (17.1%), documentation problems for 60 (14.1%), and clinical workflow problems for 33 (7.7%). Altogether, 20.8% (89/427) of reports were related to medication section problems, and downtime problems were rare (n=8). During the classification work, 14.8% (74/501) of reports of the original sample were rejected because of insufficient information, even though the reports were deemed to be related to EHRs. The interrater agreement during the blinded review was 97.7%. ConclusionsThis study presents a new classification for EHR-related patient safety incidents applicable to mature EHRs. The number of EHR-related patient safety incidents during the implementation period may reflect patient safety challenges during the implementation of a new type of high-maturity EHR system. The results indicate that the types of errors previously identified in the literature change with the EHR development cycle.https://medinform.jmir.org/2021/8/e30470 |
spellingShingle | Sari Palojoki Kaija Saranto Elina Reponen Noora Skants Anne Vakkuri Riikka Vuokko Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study JMIR Medical Informatics |
title | Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study |
title_full | Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study |
title_fullStr | Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study |
title_full_unstemmed | Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study |
title_short | Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study |
title_sort | classification of electronic health record related patient safety incidents development and validation study |
url | https://medinform.jmir.org/2021/8/e30470 |
work_keys_str_mv | AT saripalojoki classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy AT kaijasaranto classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy AT elinareponen classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy AT nooraskants classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy AT annevakkuri classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy AT riikkavuokko classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy |