Data accuracy in the Ontario birth Registry: a chart re-abstraction study

Abstract Background Ontario’s birth Registry (BORN) was established in 2009 to collect, interpret, and share critical data about pregnancy, birth and the early childhood period to facilitate and improve the provision of healthcare. Since the use of routinely-collected health data has been prioritize...

Full description

Bibliographic Details
Main Authors: Sandra Dunn, Andrea Lanes, Ann E. Sprague, Deshayne B. Fell, Deborah Weiss, Jessica Reszel, Monica Taljaard, Elizabeth K. Darling, Ian D. Graham, Jeremy M. Grimshaw, JoAnn Harrold, Graeme N. Smith, Wendy Peterson, Mark Walker
Format: Article
Language:English
Published: BMC 2019-12-01
Series:BMC Health Services Research
Subjects:
Online Access:https://doi.org/10.1186/s12913-019-4825-3
_version_ 1818665682680676352
author Sandra Dunn
Andrea Lanes
Ann E. Sprague
Deshayne B. Fell
Deborah Weiss
Jessica Reszel
Monica Taljaard
Elizabeth K. Darling
Ian D. Graham
Jeremy M. Grimshaw
JoAnn Harrold
Graeme N. Smith
Wendy Peterson
Mark Walker
author_facet Sandra Dunn
Andrea Lanes
Ann E. Sprague
Deshayne B. Fell
Deborah Weiss
Jessica Reszel
Monica Taljaard
Elizabeth K. Darling
Ian D. Graham
Jeremy M. Grimshaw
JoAnn Harrold
Graeme N. Smith
Wendy Peterson
Mark Walker
author_sort Sandra Dunn
collection DOAJ
description Abstract Background Ontario’s birth Registry (BORN) was established in 2009 to collect, interpret, and share critical data about pregnancy, birth and the early childhood period to facilitate and improve the provision of healthcare. Since the use of routinely-collected health data has been prioritized internationally by governments and funding agencies to improve patient care, support health system planning, and facilitate epidemiological surveillance and research, high quality data is essential. The purpose of this study was to verify the accuracy of a selection of data elements that are entered in the Registry. Methods Data quality was assessed by comparing data re-abstracted from patient records to data entered into the Ontario birth Registry. A purposive sample of 10 hospitals representative of hospitals in Ontario based on level of care, birth volume and geography was selected and a random sample of 100 linked mother and newborn charts were audited for each site. Data for 29 data elements were compared to the corresponding data entered in the Ontario birth Registry using percent agreement, kappa statistics for categorical data elements and intra-class correlation coefficients (ICCs) for continuous data elements. Results Agreement ranged from 56.9 to 99.8%, but 76% of the data elements (22 of 29) had greater than 90% agreement. There was almost perfect (kappa 0.81–0.99) or substantial (kappa 0.61–0.80) agreement for 12 of the categorical elements. Six elements showed fair-to-moderate agreement (kappa <0.60). We found moderate-to-excellent agreement for four continuous data elements (ICC >0.50). Conclusion Overall, the data elements we evaluated in the birth Registry were found to have good agreement with data from the patients’ charts. Data elements that showed moderate kappa or low ICC require further investigation.
first_indexed 2024-12-17T05:52:31Z
format Article
id doaj.art-45bae12abaec4853a050ff61e8941b30
institution Directory Open Access Journal
issn 1472-6963
language English
last_indexed 2024-12-17T05:52:31Z
publishDate 2019-12-01
publisher BMC
record_format Article
series BMC Health Services Research
spelling doaj.art-45bae12abaec4853a050ff61e8941b302022-12-21T22:01:07ZengBMCBMC Health Services Research1472-69632019-12-0119111110.1186/s12913-019-4825-3Data accuracy in the Ontario birth Registry: a chart re-abstraction studySandra Dunn0Andrea Lanes1Ann E. Sprague2Deshayne B. Fell3Deborah Weiss4Jessica Reszel5Monica Taljaard6Elizabeth K. Darling7Ian D. Graham8Jeremy M. Grimshaw9JoAnn Harrold10Graeme N. Smith11Wendy Peterson12Mark Walker13Better Outcomes Registry & NetworkBetter Outcomes Registry & NetworkBetter Outcomes Registry & NetworkChildren’s Hospital of Eastern Ontario Research InstituteBetter Outcomes Registry & NetworkBetter Outcomes Registry & NetworkUniversity of OttawaMcMaster UniversityUniversity of OttawaUniversity of OttawaChildren’s Hospital of Eastern Ontario Research InstituteKingston General Hospital and Queen’s UniversityUniversity of OttawaBetter Outcomes Registry & NetworkAbstract Background Ontario’s birth Registry (BORN) was established in 2009 to collect, interpret, and share critical data about pregnancy, birth and the early childhood period to facilitate and improve the provision of healthcare. Since the use of routinely-collected health data has been prioritized internationally by governments and funding agencies to improve patient care, support health system planning, and facilitate epidemiological surveillance and research, high quality data is essential. The purpose of this study was to verify the accuracy of a selection of data elements that are entered in the Registry. Methods Data quality was assessed by comparing data re-abstracted from patient records to data entered into the Ontario birth Registry. A purposive sample of 10 hospitals representative of hospitals in Ontario based on level of care, birth volume and geography was selected and a random sample of 100 linked mother and newborn charts were audited for each site. Data for 29 data elements were compared to the corresponding data entered in the Ontario birth Registry using percent agreement, kappa statistics for categorical data elements and intra-class correlation coefficients (ICCs) for continuous data elements. Results Agreement ranged from 56.9 to 99.8%, but 76% of the data elements (22 of 29) had greater than 90% agreement. There was almost perfect (kappa 0.81–0.99) or substantial (kappa 0.61–0.80) agreement for 12 of the categorical elements. Six elements showed fair-to-moderate agreement (kappa <0.60). We found moderate-to-excellent agreement for four continuous data elements (ICC >0.50). Conclusion Overall, the data elements we evaluated in the birth Registry were found to have good agreement with data from the patients’ charts. Data elements that showed moderate kappa or low ICC require further investigation.https://doi.org/10.1186/s12913-019-4825-3Data accuracyRe-abstractionData quality assessmentBORN Ontario
spellingShingle Sandra Dunn
Andrea Lanes
Ann E. Sprague
Deshayne B. Fell
Deborah Weiss
Jessica Reszel
Monica Taljaard
Elizabeth K. Darling
Ian D. Graham
Jeremy M. Grimshaw
JoAnn Harrold
Graeme N. Smith
Wendy Peterson
Mark Walker
Data accuracy in the Ontario birth Registry: a chart re-abstraction study
BMC Health Services Research
Data accuracy
Re-abstraction
Data quality assessment
BORN Ontario
title Data accuracy in the Ontario birth Registry: a chart re-abstraction study
title_full Data accuracy in the Ontario birth Registry: a chart re-abstraction study
title_fullStr Data accuracy in the Ontario birth Registry: a chart re-abstraction study
title_full_unstemmed Data accuracy in the Ontario birth Registry: a chart re-abstraction study
title_short Data accuracy in the Ontario birth Registry: a chart re-abstraction study
title_sort data accuracy in the ontario birth registry a chart re abstraction study
topic Data accuracy
Re-abstraction
Data quality assessment
BORN Ontario
url https://doi.org/10.1186/s12913-019-4825-3
work_keys_str_mv AT sandradunn dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT andrealanes dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT annesprague dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT deshaynebfell dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT deborahweiss dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT jessicareszel dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT monicataljaard dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT elizabethkdarling dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT iandgraham dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT jeremymgrimshaw dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT joannharrold dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT graemensmith dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT wendypeterson dataaccuracyintheontariobirthregistryachartreabstractionstudy
AT markwalker dataaccuracyintheontariobirthregistryachartreabstractionstudy