Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.

<h4>Background</h4>Postmarketing surveillance is routinely conducted to monitor performance of pharmaceuticals and testing devices in the marketplace. However, these surveillance methods are often done retrospectively and, as a result, are not designed to detect issues with performance i...

Full description

Bibliographic Details
Main Authors: Joseph R Egger, Kevin J Konty, Jessica M Borrelli, Julia Cummiskey, Susan Blank
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2010-08-01
Series:PLoS ONE
Online Access:https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/20811502/pdf/?tool=EBI
_version_ 1818742837294923776
author Joseph R Egger
Kevin J Konty
Jessica M Borrelli
Julia Cummiskey
Susan Blank
author_facet Joseph R Egger
Kevin J Konty
Jessica M Borrelli
Julia Cummiskey
Susan Blank
author_sort Joseph R Egger
collection DOAJ
description <h4>Background</h4>Postmarketing surveillance is routinely conducted to monitor performance of pharmaceuticals and testing devices in the marketplace. However, these surveillance methods are often done retrospectively and, as a result, are not designed to detect issues with performance in real-time.<h4>Methods and findings</h4>Using HIV antibody screening test data from New York City STD clinics, we developed a formal, statistical method of prospectively detecting temporal clusters of poor performance of a screening test. From 2005 to 2008, New York City, as well as other states, observed unexpectedly high false-positive (FP) rates in an oral fluid-based rapid test used for screening HIV. We attempted to formally assess whether the performance of this HIV screening test statistically deviated from both local expectation and the manufacturer's claim for the test. Results indicate that there were two significant temporal clusters in the FP rate of the oral HIV test, both of which exceeded the manufacturer's upper limit of the 95% CI for the product. Furthermore, the FP rate of the test varied significantly by both STD clinic and test lot, though not by test operator.<h4>Conclusions</h4>Continuous monitoring of surveillance data has the benefit of providing information regarding test performance, and if conducted in real-time, it can enable programs to examine reasons for poor test performance in close proximity to the occurrence. Techniques used in this study could be a valuable addition for postmarketing surveillance of test performance and may become particularly important with the increase in rapid testing methods.
first_indexed 2024-12-18T02:18:52Z
format Article
id doaj.art-7e84f4f1727f4fcf9b36f2ba50c0b343
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-12-18T02:18:52Z
publishDate 2010-08-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-7e84f4f1727f4fcf9b36f2ba50c0b3432022-12-21T21:24:19ZengPublic Library of Science (PLoS)PLoS ONE1932-62032010-08-0158e1223110.1371/journal.pone.0012231Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.Joseph R EggerKevin J KontyJessica M BorrelliJulia CummiskeySusan Blank<h4>Background</h4>Postmarketing surveillance is routinely conducted to monitor performance of pharmaceuticals and testing devices in the marketplace. However, these surveillance methods are often done retrospectively and, as a result, are not designed to detect issues with performance in real-time.<h4>Methods and findings</h4>Using HIV antibody screening test data from New York City STD clinics, we developed a formal, statistical method of prospectively detecting temporal clusters of poor performance of a screening test. From 2005 to 2008, New York City, as well as other states, observed unexpectedly high false-positive (FP) rates in an oral fluid-based rapid test used for screening HIV. We attempted to formally assess whether the performance of this HIV screening test statistically deviated from both local expectation and the manufacturer's claim for the test. Results indicate that there were two significant temporal clusters in the FP rate of the oral HIV test, both of which exceeded the manufacturer's upper limit of the 95% CI for the product. Furthermore, the FP rate of the test varied significantly by both STD clinic and test lot, though not by test operator.<h4>Conclusions</h4>Continuous monitoring of surveillance data has the benefit of providing information regarding test performance, and if conducted in real-time, it can enable programs to examine reasons for poor test performance in close proximity to the occurrence. Techniques used in this study could be a valuable addition for postmarketing surveillance of test performance and may become particularly important with the increase in rapid testing methods.https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/20811502/pdf/?tool=EBI
spellingShingle Joseph R Egger
Kevin J Konty
Jessica M Borrelli
Julia Cummiskey
Susan Blank
Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.
PLoS ONE
title Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.
title_full Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.
title_fullStr Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.
title_full_unstemmed Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.
title_short Monitoring temporal changes in the specificity of an oral HIV test: a novel application for use in postmarketing surveillance.
title_sort monitoring temporal changes in the specificity of an oral hiv test a novel application for use in postmarketing surveillance
url https://www.ncbi.nlm.nih.gov/pmc/articles/pmid/20811502/pdf/?tool=EBI
work_keys_str_mv AT josephregger monitoringtemporalchangesinthespecificityofanoralhivtestanovelapplicationforuseinpostmarketingsurveillance
AT kevinjkonty monitoringtemporalchangesinthespecificityofanoralhivtestanovelapplicationforuseinpostmarketingsurveillance
AT jessicamborrelli monitoringtemporalchangesinthespecificityofanoralhivtestanovelapplicationforuseinpostmarketingsurveillance
AT juliacummiskey monitoringtemporalchangesinthespecificityofanoralhivtestanovelapplicationforuseinpostmarketingsurveillance
AT susanblank monitoringtemporalchangesinthespecificityofanoralhivtestanovelapplicationforuseinpostmarketingsurveillance