Accuracy of International Classification of Diseases, 10th Revision Codes for Identifying Sepsis: A Systematic Review and Meta-Analysis

OBJECTIVES:. Administrative databases are increasingly used in research studies to capture clinical outcomes such as sepsis. This systematic review and meta-analysis examines the accuracy of International Classification of Diseases, 10th revision (ICD-10), codes for identifying sepsis in adult and p...

Full description

Bibliographic Details
Main Authors: Bonnie Liu, BHSc, Milena Hadzi-Tosev, MSc, Yang Liu, MMath, Kayla J. Lucier, MPH, Anchit Garg, BHSc, Sophie Li, BHSc, Nancy M. Heddle, MSc, Bram Rochwerg, MD, MSc, Shuoyan Ning, MD
Format: Article
Language:English
Published: Wolters Kluwer 2022-11-01
Series:Critical Care Explorations
Online Access:http://journals.lww.com/10.1097/CCE.0000000000000788
_version_ 1828184084504903680
author Bonnie Liu, BHSc
Milena Hadzi-Tosev, MSc
Yang Liu, MMath
Kayla J. Lucier, MPH
Anchit Garg, BHSc
Sophie Li, BHSc
Nancy M. Heddle, MSc
Bram Rochwerg, MD, MSc
Shuoyan Ning, MD
author_facet Bonnie Liu, BHSc
Milena Hadzi-Tosev, MSc
Yang Liu, MMath
Kayla J. Lucier, MPH
Anchit Garg, BHSc
Sophie Li, BHSc
Nancy M. Heddle, MSc
Bram Rochwerg, MD, MSc
Shuoyan Ning, MD
author_sort Bonnie Liu, BHSc
collection DOAJ
description OBJECTIVES:. Administrative databases are increasingly used in research studies to capture clinical outcomes such as sepsis. This systematic review and meta-analysis examines the accuracy of International Classification of Diseases, 10th revision (ICD-10), codes for identifying sepsis in adult and pediatric patients. DATA SOURCES:. We searched MEDLINE, EMBASE, Web of Science, CENTRAL, Epistemonikos, and McMaster Superfilters from inception to September 7, 2021. STUDY SELECTION:. We included studies that validated the accuracy of sepsis ICD-10 codes against any reference standard. DATA EXTRACTION:. Three authors, working in duplicate, independently extracted data. We conducted meta-analysis using a random effects model to pool sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). We evaluated individual study risk of bias using the Quality Assessment of Diagnostic Accuracy Studies tool and assessed certainty in pooled diagnostic effect measures using the Grading of Recommendations Assessment, Development, and Evaluation framework. DATA SYNTHESIS:. Thirteen eligible studies were included in the qualitative synthesis and the meta-analysis. Eleven studies used manual chart review as the reference standard, and four studies used registry databases. Only one study evaluated pediatric patients exclusively. Compared with the reference standard of detailed chart review and/or registry databases, the pooled sensitivity for sepsis ICD-10 codes was 35% (95% CI, 22–48, low certainty), whereas the pooled specificity was 98% (95% CI: 98–99, low certainty). The PPV for ICD-10 codes ranged from 9.8% to 100% (median, 72.0%; interquartile range [IQR], 50.0–84.7%). NPV ranged from 54.7% to 99.1% (median, 95.9%; interquartile range, 85.5–98.3%). CONCLUSIONS:. Sepsis is undercoded in administrative databases. Future research is needed to explore if greater consistency in ICD-10 code definitions and enhanced quality measures for ICD-10 coders can improve the coding accuracy of sepsis in large databases.
first_indexed 2024-04-12T06:42:56Z
format Article
id doaj.art-c5149728caf0422ab11440c987e0e6c7
institution Directory Open Access Journal
issn 2639-8028
language English
last_indexed 2024-04-12T06:42:56Z
publishDate 2022-11-01
publisher Wolters Kluwer
record_format Article
series Critical Care Explorations
spelling doaj.art-c5149728caf0422ab11440c987e0e6c72022-12-22T03:43:40ZengWolters KluwerCritical Care Explorations2639-80282022-11-01411e078810.1097/CCE.0000000000000788202211000-00007Accuracy of International Classification of Diseases, 10th Revision Codes for Identifying Sepsis: A Systematic Review and Meta-AnalysisBonnie Liu, BHSc0Milena Hadzi-Tosev, MSc1Yang Liu, MMath2Kayla J. Lucier, MPH3Anchit Garg, BHSc4Sophie Li, BHSc5Nancy M. Heddle, MSc6Bram Rochwerg, MD, MSc7Shuoyan Ning, MD81 Department of Medicine, McMaster Centre for Transfusion Research, McMaster University, Hamilton, ON, Canada.1 Department of Medicine, McMaster Centre for Transfusion Research, McMaster University, Hamilton, ON, Canada.1 Department of Medicine, McMaster Centre for Transfusion Research, McMaster University, Hamilton, ON, Canada.1 Department of Medicine, McMaster Centre for Transfusion Research, McMaster University, Hamilton, ON, Canada.1 Department of Medicine, McMaster Centre for Transfusion Research, McMaster University, Hamilton, ON, Canada.1 Department of Medicine, McMaster Centre for Transfusion Research, McMaster University, Hamilton, ON, Canada.1 Department of Medicine, McMaster Centre for Transfusion Research, McMaster University, Hamilton, ON, Canada.2 Department of Medicine, Michael G. DeGroote School of Medicine, McMaster University, Hamilton, ON, Canada.1 Department of Medicine, McMaster Centre for Transfusion Research, McMaster University, Hamilton, ON, Canada.OBJECTIVES:. Administrative databases are increasingly used in research studies to capture clinical outcomes such as sepsis. This systematic review and meta-analysis examines the accuracy of International Classification of Diseases, 10th revision (ICD-10), codes for identifying sepsis in adult and pediatric patients. DATA SOURCES:. We searched MEDLINE, EMBASE, Web of Science, CENTRAL, Epistemonikos, and McMaster Superfilters from inception to September 7, 2021. STUDY SELECTION:. We included studies that validated the accuracy of sepsis ICD-10 codes against any reference standard. DATA EXTRACTION:. Three authors, working in duplicate, independently extracted data. We conducted meta-analysis using a random effects model to pool sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). We evaluated individual study risk of bias using the Quality Assessment of Diagnostic Accuracy Studies tool and assessed certainty in pooled diagnostic effect measures using the Grading of Recommendations Assessment, Development, and Evaluation framework. DATA SYNTHESIS:. Thirteen eligible studies were included in the qualitative synthesis and the meta-analysis. Eleven studies used manual chart review as the reference standard, and four studies used registry databases. Only one study evaluated pediatric patients exclusively. Compared with the reference standard of detailed chart review and/or registry databases, the pooled sensitivity for sepsis ICD-10 codes was 35% (95% CI, 22–48, low certainty), whereas the pooled specificity was 98% (95% CI: 98–99, low certainty). The PPV for ICD-10 codes ranged from 9.8% to 100% (median, 72.0%; interquartile range [IQR], 50.0–84.7%). NPV ranged from 54.7% to 99.1% (median, 95.9%; interquartile range, 85.5–98.3%). CONCLUSIONS:. Sepsis is undercoded in administrative databases. Future research is needed to explore if greater consistency in ICD-10 code definitions and enhanced quality measures for ICD-10 coders can improve the coding accuracy of sepsis in large databases.http://journals.lww.com/10.1097/CCE.0000000000000788
spellingShingle Bonnie Liu, BHSc
Milena Hadzi-Tosev, MSc
Yang Liu, MMath
Kayla J. Lucier, MPH
Anchit Garg, BHSc
Sophie Li, BHSc
Nancy M. Heddle, MSc
Bram Rochwerg, MD, MSc
Shuoyan Ning, MD
Accuracy of International Classification of Diseases, 10th Revision Codes for Identifying Sepsis: A Systematic Review and Meta-Analysis
Critical Care Explorations
title Accuracy of International Classification of Diseases, 10th Revision Codes for Identifying Sepsis: A Systematic Review and Meta-Analysis
title_full Accuracy of International Classification of Diseases, 10th Revision Codes for Identifying Sepsis: A Systematic Review and Meta-Analysis
title_fullStr Accuracy of International Classification of Diseases, 10th Revision Codes for Identifying Sepsis: A Systematic Review and Meta-Analysis
title_full_unstemmed Accuracy of International Classification of Diseases, 10th Revision Codes for Identifying Sepsis: A Systematic Review and Meta-Analysis
title_short Accuracy of International Classification of Diseases, 10th Revision Codes for Identifying Sepsis: A Systematic Review and Meta-Analysis
title_sort accuracy of international classification of diseases 10th revision codes for identifying sepsis a systematic review and meta analysis
url http://journals.lww.com/10.1097/CCE.0000000000000788
work_keys_str_mv AT bonnieliubhsc accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis
AT milenahadzitosevmsc accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis
AT yangliummath accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis
AT kaylajluciermph accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis
AT anchitgargbhsc accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis
AT sophielibhsc accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis
AT nancymheddlemsc accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis
AT bramrochwergmdmsc accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis
AT shuoyanningmd accuracyofinternationalclassificationofdiseases10threvisioncodesforidentifyingsepsisasystematicreviewandmetaanalysis