Defining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models.
BACKGROUND: Culture remains the diagnostic gold standard for many bacterial infections, and the method against which other tests are often evaluated. Specificity of culture is 100% if the pathogenic organism is not found in healthy subjects, but the sensitivity of culture is more difficult to deter...
Main Authors: | , , , , , , , , , , , |
---|---|
Format: | Journal article |
Language: | English |
Published: |
Public Library of Science
2010
|
_version_ | 1797080780718997504 |
---|---|
author | Limmathurotsakul, D Jamsen, K Arayawichanont, A Simpson, J White, L Lee, S Wuthiekanun, V Chantratita, N Cheng, A Day, N Verzilli, C Peacock, S |
author_facet | Limmathurotsakul, D Jamsen, K Arayawichanont, A Simpson, J White, L Lee, S Wuthiekanun, V Chantratita, N Cheng, A Day, N Verzilli, C Peacock, S |
author_sort | Limmathurotsakul, D |
collection | OXFORD |
description | BACKGROUND: Culture remains the diagnostic gold standard for many bacterial infections, and the method against which other tests are often evaluated. Specificity of culture is 100% if the pathogenic organism is not found in healthy subjects, but the sensitivity of culture is more difficult to determine and may be low. Here, we apply Bayesian latent class models (LCMs) to data from patients with a single Gram-negative bacterial infection and define the true sensitivity of culture together with the impact of misclassification by culture on the reported accuracy of alternative diagnostic tests. METHODS/PRINCIPAL FINDINGS: Data from published studies describing the application of five diagnostic tests (culture and four serological tests) to a patient cohort with suspected melioidosis were re-analysed using several Bayesian LCMs. Sensitivities, specificities, and positive and negative predictive values (PPVs and NPVs) were calculated. Of 320 patients with suspected melioidosis, 119 (37%) had culture confirmed melioidosis. Using the final model (Bayesian LCM with conditional dependence between serological tests), the sensitivity of culture was estimated to be 60.2%. Prediction accuracy of the final model was assessed using a classification tool to grade patients according to the likelihood of melioidosis, which indicated that an estimated disease prevalence of 61.6% was credible. Estimates of sensitivities, specificities, PPVs and NPVs of four serological tests were significantly different from previously published values in which culture was used as the gold standard. CONCLUSIONS/SIGNIFICANCE: Culture has low sensitivity and low NPV for the diagnosis of melioidosis and is an imperfect gold standard against which to evaluate alternative tests. Models should be used to support the evaluation of diagnostic tests with an imperfect gold standard. It is likely that the poor sensitivity/specificity of culture is not specific for melioidosis, but rather a generic problem for many bacterial and fungal infections. |
first_indexed | 2024-03-07T01:05:05Z |
format | Journal article |
id | oxford-uuid:8b0e922c-60c4-4bb5-94c7-f7ba4dcc65da |
institution | University of Oxford |
language | English |
last_indexed | 2024-03-07T01:05:05Z |
publishDate | 2010 |
publisher | Public Library of Science |
record_format | dspace |
spelling | oxford-uuid:8b0e922c-60c4-4bb5-94c7-f7ba4dcc65da2022-03-26T22:35:38ZDefining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models.Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:8b0e922c-60c4-4bb5-94c7-f7ba4dcc65daEnglishSymplectic Elements at OxfordPublic Library of Science2010Limmathurotsakul, DJamsen, KArayawichanont, ASimpson, JWhite, LLee, SWuthiekanun, VChantratita, NCheng, ADay, NVerzilli, CPeacock, S BACKGROUND: Culture remains the diagnostic gold standard for many bacterial infections, and the method against which other tests are often evaluated. Specificity of culture is 100% if the pathogenic organism is not found in healthy subjects, but the sensitivity of culture is more difficult to determine and may be low. Here, we apply Bayesian latent class models (LCMs) to data from patients with a single Gram-negative bacterial infection and define the true sensitivity of culture together with the impact of misclassification by culture on the reported accuracy of alternative diagnostic tests. METHODS/PRINCIPAL FINDINGS: Data from published studies describing the application of five diagnostic tests (culture and four serological tests) to a patient cohort with suspected melioidosis were re-analysed using several Bayesian LCMs. Sensitivities, specificities, and positive and negative predictive values (PPVs and NPVs) were calculated. Of 320 patients with suspected melioidosis, 119 (37%) had culture confirmed melioidosis. Using the final model (Bayesian LCM with conditional dependence between serological tests), the sensitivity of culture was estimated to be 60.2%. Prediction accuracy of the final model was assessed using a classification tool to grade patients according to the likelihood of melioidosis, which indicated that an estimated disease prevalence of 61.6% was credible. Estimates of sensitivities, specificities, PPVs and NPVs of four serological tests were significantly different from previously published values in which culture was used as the gold standard. CONCLUSIONS/SIGNIFICANCE: Culture has low sensitivity and low NPV for the diagnosis of melioidosis and is an imperfect gold standard against which to evaluate alternative tests. Models should be used to support the evaluation of diagnostic tests with an imperfect gold standard. It is likely that the poor sensitivity/specificity of culture is not specific for melioidosis, but rather a generic problem for many bacterial and fungal infections. |
spellingShingle | Limmathurotsakul, D Jamsen, K Arayawichanont, A Simpson, J White, L Lee, S Wuthiekanun, V Chantratita, N Cheng, A Day, N Verzilli, C Peacock, S Defining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models. |
title | Defining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models. |
title_full | Defining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models. |
title_fullStr | Defining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models. |
title_full_unstemmed | Defining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models. |
title_short | Defining the true sensitivity of culture for the diagnosis of melioidosis using Bayesian latent class models. |
title_sort | defining the true sensitivity of culture for the diagnosis of melioidosis using bayesian latent class models |
work_keys_str_mv | AT limmathurotsakuld definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT jamsenk definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT arayawichanonta definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT simpsonj definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT whitel definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT lees definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT wuthiekanunv definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT chantratitan definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT chenga definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT dayn definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT verzillic definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels AT peacocks definingthetruesensitivityofcultureforthediagnosisofmelioidosisusingbayesianlatentclassmodels |