Excellent agreement of Norwegian trauma registry data compared to corresponding data in electronic patient records
Abstract Background The Norwegian Trauma Registry (NTR) is designed to monitor and improve the quality and outcome of trauma care delivered by Norwegian trauma hospitals. Patient care is evaluated through specific quality indicators, which are constructed of variables reported to the registry by cer...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-09-01
|
| Series: | Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s13049-023-01118-5 |
| _version_ | 1827708780348964864 |
|---|---|
| author | N Naberezhneva Oddvar Uleberg M Dahlhaug V Giil-Jensen K G Ringdal O Røise |
| author_facet | N Naberezhneva Oddvar Uleberg M Dahlhaug V Giil-Jensen K G Ringdal O Røise |
| author_sort | N Naberezhneva |
| collection | DOAJ |
| description | Abstract Background The Norwegian Trauma Registry (NTR) is designed to monitor and improve the quality and outcome of trauma care delivered by Norwegian trauma hospitals. Patient care is evaluated through specific quality indicators, which are constructed of variables reported to the registry by certified registrars. Having high-quality data recorded in the registry is essential for the validity, trust and use of data. This study aims to perform a data quality check of a subset of core data elements in the registry by assessing agreement between data in the NTR and corresponding data in electronic patient records (EPRs). Methods We validated 49 of the 118 variables registered in the NTR by comparing those with the corresponding ones in electronic patient records for 180 patients with a trauma diagnosis admitted in 2019 at eight public hospitals. Agreement was quantified by calculating observed agreement, Cohen’s Kappa and Gwet’s first agreement coefficient (AC1) with 95% confidence intervals (CIs) for 27 nominal variables, quadratic weighted Cohen’s Kappa and Gwet’s second agreement coefficient (AC2) for five ordinal variables. For nine continuous, one date and seven time variables, we calculated intraclass correlation coefficient (ICC). Results Almost perfect agreement (AC1 /AC2/ ICC > 0.80) was observed for all examined variables. Nominal and ordinal variables showed Gwet’s agreement coefficients ranging from 0.85 (95% CI: 0.79–0.91) to 1.00 (95% CI: 1.00–1.00). For continuous and time variables there were detected high values of intraclass correlation coefficients (ICC) between 0.88 (95% CI: 0.83–0.91) and 1.00 (CI 95%: 1.00–1.00). While missing values in both the NTR and EPRs were in general negligeable, we found a substantial amount of missing registrations for a continuous “Base excess” in the NTR. For some of the time variables missing values both in the NTR and EPRs were high. Conclusion All tested variables in the Norwegian Trauma Registry displayed excellent agreement with the corresponding variables in electronic patient records. Variables in the registry that showed missing data need further examination. |
| first_indexed | 2024-03-10T17:09:27Z |
| format | Article |
| id | doaj.art-ec63b071b7cf4dca9fe90dadb973ad16 |
| institution | Directory Open Access Journal |
| issn | 1757-7241 |
| language | English |
| last_indexed | 2024-03-10T17:09:27Z |
| publishDate | 2023-09-01 |
| publisher | BMC |
| record_format | Article |
| series | Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine |
| spelling | doaj.art-ec63b071b7cf4dca9fe90dadb973ad162023-11-20T10:43:29ZengBMCScandinavian Journal of Trauma, Resuscitation and Emergency Medicine1757-72412023-09-0131111010.1186/s13049-023-01118-5Excellent agreement of Norwegian trauma registry data compared to corresponding data in electronic patient recordsN Naberezhneva0Oddvar Uleberg1M Dahlhaug2V Giil-Jensen3K G Ringdal4O Røise5Biobank and Registry Support Department, Division for medical quality registries for South- Eastern Norway Regional Health Authority, Oslo University HospitalDepartment of Research and Development, Division of Emergencies and Critical Care, Oslo University HospitalNorwegian Trauma Registry, Division of Orthopedics, Oslo University HospitalNorwegian Trauma Registry, Division of Orthopedics, Oslo University HospitalNorwegian Trauma Registry, Division of Orthopedics, Oslo University HospitalNorwegian Trauma Registry, Division of Orthopedics, Oslo University HospitalAbstract Background The Norwegian Trauma Registry (NTR) is designed to monitor and improve the quality and outcome of trauma care delivered by Norwegian trauma hospitals. Patient care is evaluated through specific quality indicators, which are constructed of variables reported to the registry by certified registrars. Having high-quality data recorded in the registry is essential for the validity, trust and use of data. This study aims to perform a data quality check of a subset of core data elements in the registry by assessing agreement between data in the NTR and corresponding data in electronic patient records (EPRs). Methods We validated 49 of the 118 variables registered in the NTR by comparing those with the corresponding ones in electronic patient records for 180 patients with a trauma diagnosis admitted in 2019 at eight public hospitals. Agreement was quantified by calculating observed agreement, Cohen’s Kappa and Gwet’s first agreement coefficient (AC1) with 95% confidence intervals (CIs) for 27 nominal variables, quadratic weighted Cohen’s Kappa and Gwet’s second agreement coefficient (AC2) for five ordinal variables. For nine continuous, one date and seven time variables, we calculated intraclass correlation coefficient (ICC). Results Almost perfect agreement (AC1 /AC2/ ICC > 0.80) was observed for all examined variables. Nominal and ordinal variables showed Gwet’s agreement coefficients ranging from 0.85 (95% CI: 0.79–0.91) to 1.00 (95% CI: 1.00–1.00). For continuous and time variables there were detected high values of intraclass correlation coefficients (ICC) between 0.88 (95% CI: 0.83–0.91) and 1.00 (CI 95%: 1.00–1.00). While missing values in both the NTR and EPRs were in general negligeable, we found a substantial amount of missing registrations for a continuous “Base excess” in the NTR. For some of the time variables missing values both in the NTR and EPRs were high. Conclusion All tested variables in the Norwegian Trauma Registry displayed excellent agreement with the corresponding variables in electronic patient records. Variables in the registry that showed missing data need further examination.https://doi.org/10.1186/s13049-023-01118-5Data QualityData AccuracyData CollectionHealth Care Evaluation MechanismsWounds and InjuriesRegistries |
| spellingShingle | N Naberezhneva Oddvar Uleberg M Dahlhaug V Giil-Jensen K G Ringdal O Røise Excellent agreement of Norwegian trauma registry data compared to corresponding data in electronic patient records Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine Data Quality Data Accuracy Data Collection Health Care Evaluation Mechanisms Wounds and Injuries Registries |
| title | Excellent agreement of Norwegian trauma registry data compared to corresponding data in electronic patient records |
| title_full | Excellent agreement of Norwegian trauma registry data compared to corresponding data in electronic patient records |
| title_fullStr | Excellent agreement of Norwegian trauma registry data compared to corresponding data in electronic patient records |
| title_full_unstemmed | Excellent agreement of Norwegian trauma registry data compared to corresponding data in electronic patient records |
| title_short | Excellent agreement of Norwegian trauma registry data compared to corresponding data in electronic patient records |
| title_sort | excellent agreement of norwegian trauma registry data compared to corresponding data in electronic patient records |
| topic | Data Quality Data Accuracy Data Collection Health Care Evaluation Mechanisms Wounds and Injuries Registries |
| url | https://doi.org/10.1186/s13049-023-01118-5 |
| work_keys_str_mv | AT nnaberezhneva excellentagreementofnorwegiantraumaregistrydatacomparedtocorrespondingdatainelectronicpatientrecords AT oddvaruleberg excellentagreementofnorwegiantraumaregistrydatacomparedtocorrespondingdatainelectronicpatientrecords AT mdahlhaug excellentagreementofnorwegiantraumaregistrydatacomparedtocorrespondingdatainelectronicpatientrecords AT vgiiljensen excellentagreementofnorwegiantraumaregistrydatacomparedtocorrespondingdatainelectronicpatientrecords AT kgringdal excellentagreementofnorwegiantraumaregistrydatacomparedtocorrespondingdatainelectronicpatientrecords AT orøise excellentagreementofnorwegiantraumaregistrydatacomparedtocorrespondingdatainelectronicpatientrecords |