Clinical prediction models for serious infections in children: external validation in ambulatory care
Abstract Background Early distinction between mild and serious infections (SI) is challenging in children in ambulatory care. Clinical prediction models (CPMs), developed to aid physicians in clinical decision-making, require broad external validation before clinical use. We aimed to externally vali...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-04-01
|
| Series: | BMC Medicine |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12916-023-02860-4 |
| _version_ | 1797840986041221120 |
|---|---|
| author | David A. G. Bos Tine De Burghgraeve An De Sutter Frank Buntinx Jan Y. Verbakel |
| author_facet | David A. G. Bos Tine De Burghgraeve An De Sutter Frank Buntinx Jan Y. Verbakel |
| author_sort | David A. G. Bos |
| collection | DOAJ |
| description | Abstract Background Early distinction between mild and serious infections (SI) is challenging in children in ambulatory care. Clinical prediction models (CPMs), developed to aid physicians in clinical decision-making, require broad external validation before clinical use. We aimed to externally validate four CPMs, developed in emergency departments, in ambulatory care. Methods We applied the CPMs in a prospective cohort of acutely ill children presenting to general practices, outpatient paediatric practices or emergency departments in Flanders, Belgium. For two multinomial regression models, Feverkidstool and Craig model, discriminative ability and calibration were assessed, and a model update was performed by re-estimation of coefficients with correction for overfitting. For two risk scores, the SBI score and PAWS, the diagnostic test accuracy was assessed. Results A total of 8211 children were included, comprising 498 SI and 276 serious bacterial infections (SBI). Feverkidstool had a C-statistic of 0.80 (95% confidence interval 0.77–0.84) with good calibration for pneumonia and 0.74 (0.70–0.79) with poor calibration for other SBI. The Craig model had a C-statistic of 0.80 (0.77–0.83) for pneumonia, 0.75 (0.70–0.80) for complicated urinary tract infections and 0.63 (0.39–0.88) for bacteraemia, with poor calibration. The model update resulted in improved C-statistics for all outcomes and good overall calibration for Feverkidstool and the Craig model. SBI score and PAWS performed extremely weak with sensitivities of 0.12 (0.09–0.15) and 0.32 (0.28–0.37). Conclusions Feverkidstool and the Craig model show good discriminative ability for predicting SBI and a potential for early recognition of SBI, confirming good external validity in a low prevalence setting of SBI. The SBI score and PAWS showed poor diagnostic performance. Trial registration ClinicalTrials.gov, NCT02024282. Registered on 31 December 2013. |
| first_indexed | 2024-04-09T16:23:35Z |
| format | Article |
| id | doaj.art-1a89d73d0e0b45cb84ae6cd767fc7576 |
| institution | Directory Open Access Journal |
| issn | 1741-7015 |
| language | English |
| last_indexed | 2024-04-09T16:23:35Z |
| publishDate | 2023-04-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medicine |
| spelling | doaj.art-1a89d73d0e0b45cb84ae6cd767fc75762023-04-23T11:19:48ZengBMCBMC Medicine1741-70152023-04-0121111210.1186/s12916-023-02860-4Clinical prediction models for serious infections in children: external validation in ambulatory careDavid A. G. Bos0Tine De Burghgraeve1An De Sutter2Frank Buntinx3Jan Y. Verbakel4EPI-Centre, Department of Public Health and Primary CareEPI-Centre, Department of Public Health and Primary CareDepartment of Family Practice and Primary Health Care, Ghent UniversityDepartment of Public Health and Primary Care, KU LeuvenEPI-Centre, Department of Public Health and Primary CareAbstract Background Early distinction between mild and serious infections (SI) is challenging in children in ambulatory care. Clinical prediction models (CPMs), developed to aid physicians in clinical decision-making, require broad external validation before clinical use. We aimed to externally validate four CPMs, developed in emergency departments, in ambulatory care. Methods We applied the CPMs in a prospective cohort of acutely ill children presenting to general practices, outpatient paediatric practices or emergency departments in Flanders, Belgium. For two multinomial regression models, Feverkidstool and Craig model, discriminative ability and calibration were assessed, and a model update was performed by re-estimation of coefficients with correction for overfitting. For two risk scores, the SBI score and PAWS, the diagnostic test accuracy was assessed. Results A total of 8211 children were included, comprising 498 SI and 276 serious bacterial infections (SBI). Feverkidstool had a C-statistic of 0.80 (95% confidence interval 0.77–0.84) with good calibration for pneumonia and 0.74 (0.70–0.79) with poor calibration for other SBI. The Craig model had a C-statistic of 0.80 (0.77–0.83) for pneumonia, 0.75 (0.70–0.80) for complicated urinary tract infections and 0.63 (0.39–0.88) for bacteraemia, with poor calibration. The model update resulted in improved C-statistics for all outcomes and good overall calibration for Feverkidstool and the Craig model. SBI score and PAWS performed extremely weak with sensitivities of 0.12 (0.09–0.15) and 0.32 (0.28–0.37). Conclusions Feverkidstool and the Craig model show good discriminative ability for predicting SBI and a potential for early recognition of SBI, confirming good external validity in a low prevalence setting of SBI. The SBI score and PAWS showed poor diagnostic performance. Trial registration ClinicalTrials.gov, NCT02024282. Registered on 31 December 2013.https://doi.org/10.1186/s12916-023-02860-4Serious infectionsChildrenClinical prediction modelsExternal validationGeneral practicePaediatrics |
| spellingShingle | David A. G. Bos Tine De Burghgraeve An De Sutter Frank Buntinx Jan Y. Verbakel Clinical prediction models for serious infections in children: external validation in ambulatory care BMC Medicine Serious infections Children Clinical prediction models External validation General practice Paediatrics |
| title | Clinical prediction models for serious infections in children: external validation in ambulatory care |
| title_full | Clinical prediction models for serious infections in children: external validation in ambulatory care |
| title_fullStr | Clinical prediction models for serious infections in children: external validation in ambulatory care |
| title_full_unstemmed | Clinical prediction models for serious infections in children: external validation in ambulatory care |
| title_short | Clinical prediction models for serious infections in children: external validation in ambulatory care |
| title_sort | clinical prediction models for serious infections in children external validation in ambulatory care |
| topic | Serious infections Children Clinical prediction models External validation General practice Paediatrics |
| url | https://doi.org/10.1186/s12916-023-02860-4 |
| work_keys_str_mv | AT davidagbos clinicalpredictionmodelsforseriousinfectionsinchildrenexternalvalidationinambulatorycare AT tinedeburghgraeve clinicalpredictionmodelsforseriousinfectionsinchildrenexternalvalidationinambulatorycare AT andesutter clinicalpredictionmodelsforseriousinfectionsinchildrenexternalvalidationinambulatorycare AT frankbuntinx clinicalpredictionmodelsforseriousinfectionsinchildrenexternalvalidationinambulatorycare AT janyverbakel clinicalpredictionmodelsforseriousinfectionsinchildrenexternalvalidationinambulatorycare |