Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study

BackgroundIt is assumed that the implementation of health information technology introduces new vulnerabilities within a complex sociotechnical health care system, but no international consensus exists on a standardized format for enhancing the collection, analysis, and inter...

Full description

Bibliographic Details
Main Authors: Sari Palojoki, Kaija Saranto, Elina Reponen, Noora Skants, Anne Vakkuri, Riikka Vuokko
Format: Article
Language:English
Published: JMIR Publications 2021-08-01
Series:JMIR Medical Informatics
Online Access:https://medinform.jmir.org/2021/8/e30470
_version_ 1797735722779672576
author Sari Palojoki
Kaija Saranto
Elina Reponen
Noora Skants
Anne Vakkuri
Riikka Vuokko
author_facet Sari Palojoki
Kaija Saranto
Elina Reponen
Noora Skants
Anne Vakkuri
Riikka Vuokko
author_sort Sari Palojoki
collection DOAJ
description BackgroundIt is assumed that the implementation of health information technology introduces new vulnerabilities within a complex sociotechnical health care system, but no international consensus exists on a standardized format for enhancing the collection, analysis, and interpretation of technology-induced errors. ObjectiveThis study aims to develop a classification for patient safety incident reporting associated with the use of mature electronic health records (EHRs). It also aims to validate the classification by using a data set of incidents during a 6-month period immediately after the implementation of a new EHR system. MethodsThe starting point of the classification development was the Finnish Technology-Induced Error Risk Assessment Scale tool, based on research on commonly recognized error types. A multiprofessional research team used iterative tests on consensus building to develop a classification system. The final classification, with preliminary descriptions of classes, was validated by applying it to analyze EHR-related error incidents (n=428) during the implementation phase of a new EHR system and also to evaluate this classification’s characteristics and applicability for reporting incidents. Interrater agreement was applied. ResultsThe number of EHR-related patient safety incidents during the implementation period (n=501) was five-fold when compared with the preimplementation period (n=82). The literature identified new error types that were added to the emerging classification. Error types were adapted iteratively after several test rounds to develop a classification for reporting patient safety incidents in the clinical use of a high-maturity EHR system. Of the 427 classified patient safety incidents, interface problems accounted for 96 (22.5%) incident reports, usability problems for 73 (17.1%), documentation problems for 60 (14.1%), and clinical workflow problems for 33 (7.7%). Altogether, 20.8% (89/427) of reports were related to medication section problems, and downtime problems were rare (n=8). During the classification work, 14.8% (74/501) of reports of the original sample were rejected because of insufficient information, even though the reports were deemed to be related to EHRs. The interrater agreement during the blinded review was 97.7%. ConclusionsThis study presents a new classification for EHR-related patient safety incidents applicable to mature EHRs. The number of EHR-related patient safety incidents during the implementation period may reflect patient safety challenges during the implementation of a new type of high-maturity EHR system. The results indicate that the types of errors previously identified in the literature change with the EHR development cycle.
first_indexed 2024-03-12T13:03:11Z
format Article
id doaj.art-324c9a10a1ba4482bbd6801c44398d8d
institution Directory Open Access Journal
issn 2291-9694
language English
last_indexed 2024-03-12T13:03:11Z
publishDate 2021-08-01
publisher JMIR Publications
record_format Article
series JMIR Medical Informatics
spelling doaj.art-324c9a10a1ba4482bbd6801c44398d8d2023-08-28T18:42:38ZengJMIR PublicationsJMIR Medical Informatics2291-96942021-08-0198e3047010.2196/30470Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation StudySari Palojokihttps://orcid.org/0000-0003-3047-9713Kaija Sarantohttps://orcid.org/0000-0002-3195-1955Elina Reponenhttps://orcid.org/0000-0003-2974-9683Noora Skantshttps://orcid.org/0000-0002-1470-4397Anne Vakkurihttps://orcid.org/0000-0003-4708-1779Riikka Vuokkohttps://orcid.org/0000-0003-3495-2336 BackgroundIt is assumed that the implementation of health information technology introduces new vulnerabilities within a complex sociotechnical health care system, but no international consensus exists on a standardized format for enhancing the collection, analysis, and interpretation of technology-induced errors. ObjectiveThis study aims to develop a classification for patient safety incident reporting associated with the use of mature electronic health records (EHRs). It also aims to validate the classification by using a data set of incidents during a 6-month period immediately after the implementation of a new EHR system. MethodsThe starting point of the classification development was the Finnish Technology-Induced Error Risk Assessment Scale tool, based on research on commonly recognized error types. A multiprofessional research team used iterative tests on consensus building to develop a classification system. The final classification, with preliminary descriptions of classes, was validated by applying it to analyze EHR-related error incidents (n=428) during the implementation phase of a new EHR system and also to evaluate this classification’s characteristics and applicability for reporting incidents. Interrater agreement was applied. ResultsThe number of EHR-related patient safety incidents during the implementation period (n=501) was five-fold when compared with the preimplementation period (n=82). The literature identified new error types that were added to the emerging classification. Error types were adapted iteratively after several test rounds to develop a classification for reporting patient safety incidents in the clinical use of a high-maturity EHR system. Of the 427 classified patient safety incidents, interface problems accounted for 96 (22.5%) incident reports, usability problems for 73 (17.1%), documentation problems for 60 (14.1%), and clinical workflow problems for 33 (7.7%). Altogether, 20.8% (89/427) of reports were related to medication section problems, and downtime problems were rare (n=8). During the classification work, 14.8% (74/501) of reports of the original sample were rejected because of insufficient information, even though the reports were deemed to be related to EHRs. The interrater agreement during the blinded review was 97.7%. ConclusionsThis study presents a new classification for EHR-related patient safety incidents applicable to mature EHRs. The number of EHR-related patient safety incidents during the implementation period may reflect patient safety challenges during the implementation of a new type of high-maturity EHR system. The results indicate that the types of errors previously identified in the literature change with the EHR development cycle.https://medinform.jmir.org/2021/8/e30470
spellingShingle Sari Palojoki
Kaija Saranto
Elina Reponen
Noora Skants
Anne Vakkuri
Riikka Vuokko
Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study
JMIR Medical Informatics
title Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study
title_full Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study
title_fullStr Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study
title_full_unstemmed Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study
title_short Classification of Electronic Health Record–Related Patient Safety Incidents: Development and Validation Study
title_sort classification of electronic health record related patient safety incidents development and validation study
url https://medinform.jmir.org/2021/8/e30470
work_keys_str_mv AT saripalojoki classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy
AT kaijasaranto classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy
AT elinareponen classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy
AT nooraskants classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy
AT annevakkuri classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy
AT riikkavuokko classificationofelectronichealthrecordrelatedpatientsafetyincidentsdevelopmentandvalidationstudy