Validating a transnational fracture treatment registry using a standardized method

Abstract Aim Subsequent to a three-month pilot phase, recruiting patients for the newly established BFCC (Baltic Fracture Competence Centre) transnational fracture registry, a validation of the data quality needed to be carried out, applying a standardized method. Method During the literature resear...

Full description

Bibliographic Details
Main Authors: Jasper Frese, Annalice Gode, Gerhard Heinrichs, Armin Will, Arndt-Peter Schulz
Format: Article
Language:English
Published: BMC 2019-12-01
Series:BMC Medical Research Methodology
Subjects:
Online Access:https://doi.org/10.1186/s12874-019-0862-1
_version_ 1818589641863856128
author Jasper Frese
Annalice Gode
Gerhard Heinrichs
Armin Will
Arndt-Peter Schulz
author_facet Jasper Frese
Annalice Gode
Gerhard Heinrichs
Armin Will
Arndt-Peter Schulz
author_sort Jasper Frese
collection DOAJ
description Abstract Aim Subsequent to a three-month pilot phase, recruiting patients for the newly established BFCC (Baltic Fracture Competence Centre) transnational fracture registry, a validation of the data quality needed to be carried out, applying a standardized method. Method During the literature research, the method of “adaptive monitoring” fulfilled the requirements of the registry and was applied. It consisted of a three-step audit process; firstly, scoring of the overall data quality, followed by source data verification of a sample size, relative to the scoring result, and finally, feedback to the registry on measures to improve data quality. Statistical methods for scoring of data quality and visualisation of discrepancies between registry data and source data were developed and applied. Results Initially, the data quality of the registry scored as medium. During source data verification, missing items in the registry, causing medium data quality, turned out to be absent in the source as well. A subsequent adaptation of the score evaluated the registry’s data quality as good. It was suggested to add variables to some items in order to improve the accuracy of the registry. Discussion The application of the method of adaptive monitoring has only been published by Jacke et al., with a similar improvement of the scoring result following the audit process. Displaying data from the registry in graphs helped to find missing items and discover issues with data formats. Graphically comparing the degree of agreement between the registry and source data allowed to discover systematic faults. Conclusions The method of adaptive monitoring gives a substantiated guideline for systematically evaluating and monitoring a registry’s data quality and is currently second to none. The resulting transparency of the registry’s data quality could be helpful in annual reports, as published by most major registries. As the method has been rarely applied, further successive applications in established registries would be desirable.
first_indexed 2024-12-16T09:43:53Z
format Article
id doaj.art-07f06c73e4d04e8ab372f3b01f9ac788
institution Directory Open Access Journal
issn 1471-2288
language English
last_indexed 2024-12-16T09:43:53Z
publishDate 2019-12-01
publisher BMC
record_format Article
series BMC Medical Research Methodology
spelling doaj.art-07f06c73e4d04e8ab372f3b01f9ac7882022-12-21T22:36:12ZengBMCBMC Medical Research Methodology1471-22882019-12-0119111110.1186/s12874-019-0862-1Validating a transnational fracture treatment registry using a standardized methodJasper Frese0Annalice Gode1Gerhard Heinrichs2Armin Will3Arndt-Peter Schulz4UKSH Campus Lübeck, Orthopaedics and TraumatologyUKSH Campus Lübeck, Orthopaedics and TraumatologyUKSH Campus Lübeck, Orthopaedics and TraumatologyUKSH Campus Lübeck, Stabsstelle InformationstechnologieKlinik für Orthopädie und Unfallchirurgie, BG Klinikum HamburgAbstract Aim Subsequent to a three-month pilot phase, recruiting patients for the newly established BFCC (Baltic Fracture Competence Centre) transnational fracture registry, a validation of the data quality needed to be carried out, applying a standardized method. Method During the literature research, the method of “adaptive monitoring” fulfilled the requirements of the registry and was applied. It consisted of a three-step audit process; firstly, scoring of the overall data quality, followed by source data verification of a sample size, relative to the scoring result, and finally, feedback to the registry on measures to improve data quality. Statistical methods for scoring of data quality and visualisation of discrepancies between registry data and source data were developed and applied. Results Initially, the data quality of the registry scored as medium. During source data verification, missing items in the registry, causing medium data quality, turned out to be absent in the source as well. A subsequent adaptation of the score evaluated the registry’s data quality as good. It was suggested to add variables to some items in order to improve the accuracy of the registry. Discussion The application of the method of adaptive monitoring has only been published by Jacke et al., with a similar improvement of the scoring result following the audit process. Displaying data from the registry in graphs helped to find missing items and discover issues with data formats. Graphically comparing the degree of agreement between the registry and source data allowed to discover systematic faults. Conclusions The method of adaptive monitoring gives a substantiated guideline for systematically evaluating and monitoring a registry’s data quality and is currently second to none. The resulting transparency of the registry’s data quality could be helpful in annual reports, as published by most major registries. As the method has been rarely applied, further successive applications in established registries would be desirable.https://doi.org/10.1186/s12874-019-0862-1Data validationRegistryQuality assessmentScoringData quality
spellingShingle Jasper Frese
Annalice Gode
Gerhard Heinrichs
Armin Will
Arndt-Peter Schulz
Validating a transnational fracture treatment registry using a standardized method
BMC Medical Research Methodology
Data validation
Registry
Quality assessment
Scoring
Data quality
title Validating a transnational fracture treatment registry using a standardized method
title_full Validating a transnational fracture treatment registry using a standardized method
title_fullStr Validating a transnational fracture treatment registry using a standardized method
title_full_unstemmed Validating a transnational fracture treatment registry using a standardized method
title_short Validating a transnational fracture treatment registry using a standardized method
title_sort validating a transnational fracture treatment registry using a standardized method
topic Data validation
Registry
Quality assessment
Scoring
Data quality
url https://doi.org/10.1186/s12874-019-0862-1
work_keys_str_mv AT jasperfrese validatingatransnationalfracturetreatmentregistryusingastandardizedmethod
AT annalicegode validatingatransnationalfracturetreatmentregistryusingastandardizedmethod
AT gerhardheinrichs validatingatransnationalfracturetreatmentregistryusingastandardizedmethod
AT arminwill validatingatransnationalfracturetreatmentregistryusingastandardizedmethod
AT arndtpeterschulz validatingatransnationalfracturetreatmentregistryusingastandardizedmethod