Establishment and Characterization of an Empirical Biomarker SS/PV-ROC Plot Using Results of the UBC<sup>®</sup> <i>Rapid</i> Test in Bladder Cancer
Background: This investigation included both a study of potential non-invasive diagnostic approaches for the bladder cancer biomarker UBC<sup>®</sup> <i>Rapid</i> Test and a study including comparative methods about sensitivity–specificity characteristic (SS-ROC) and predicti...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-06-01
|
| Series: | Entropy |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1099-4300/22/7/729 |
| _version_ | 1797563631191195648 |
|---|---|
| author | Peter Oehr Thorsten Ecke |
| author_facet | Peter Oehr Thorsten Ecke |
| author_sort | Peter Oehr |
| collection | DOAJ |
| description | Background: This investigation included both a study of potential non-invasive diagnostic approaches for the bladder cancer biomarker UBC<sup>®</sup> <i>Rapid</i> Test and a study including comparative methods about sensitivity–specificity characteristic (SS-ROC) and predictive receiver operating characteristic (PV-ROC) curves that used bladder cancer as a useful example. Methods: The study included 289 urine samples from patients with tumors of the urinary bladder, patients with non-evidence of disease (NED) and healthy controls. The UBC<sup>®</sup> <i>Rapid</i> Test is a qualitative point of care assay. Using a photometric reader, quantitative data can also be obtained. Data for pairs of sensitivity/specificity as well as positive/negative predictive values were created by variation of threshold values for the whole patient cohort, as well as for the tumor-free control group. Based on these data, sensitivity–specificity and predictive value threshold distribution curves were constructed and transformed into SS-ROC and PV-ROC curves, which were included in a single SS/PV-ROC plot. Results: The curves revealed TPP-asymmetric improper curves which cross the diagonal from above. Evaluation of the PV-ROC curve showed that two or more distinct positive predictive values (PPV) can correspond to the same value of a negative predictive value (NPV) and vice versa, indicating a complexity in PV-ROC curves which did not exist in SS-ROC curves. In contrast to the SS-ROC curve, the PV-ROC curve had neither an area under the curve (AUC) nor a range from 0% to 100%. Sensitivity of the qualitative assay was 58.5% and specificity 88.2%, PPV was 75.6% and NPV 77.3%, at a threshold value of approximately 12.5 µg/L. Conclusions: The SS/PV-ROC plot is a new diagnostic approach which can be used for direct judgement of gain and loss of predictive values, sensitivity and specificity according to varied threshold value changes, enabling characterization, comparison and evaluation of qualitative and quantitative bioassays. |
| first_indexed | 2024-03-10T18:46:15Z |
| format | Article |
| id | doaj.art-3a5e97ece2b848f8b1200d7ec39a5a1f |
| institution | Directory Open Access Journal |
| issn | 1099-4300 |
| language | English |
| last_indexed | 2024-03-10T18:46:15Z |
| publishDate | 2020-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Entropy |
| spelling | doaj.art-3a5e97ece2b848f8b1200d7ec39a5a1f2023-11-20T05:29:25ZengMDPI AGEntropy1099-43002020-06-0122772910.3390/e22070729Establishment and Characterization of an Empirical Biomarker SS/PV-ROC Plot Using Results of the UBC<sup>®</sup> <i>Rapid</i> Test in Bladder CancerPeter Oehr0Thorsten Ecke1Faculty of Medicine, Rheinische Friedrich-Wilhelms-Universität Bonn, 53113 Bonn, GermanyDepartment of Urology, HELIOS Hospital, 15526 Bad Saarow, GermanyBackground: This investigation included both a study of potential non-invasive diagnostic approaches for the bladder cancer biomarker UBC<sup>®</sup> <i>Rapid</i> Test and a study including comparative methods about sensitivity–specificity characteristic (SS-ROC) and predictive receiver operating characteristic (PV-ROC) curves that used bladder cancer as a useful example. Methods: The study included 289 urine samples from patients with tumors of the urinary bladder, patients with non-evidence of disease (NED) and healthy controls. The UBC<sup>®</sup> <i>Rapid</i> Test is a qualitative point of care assay. Using a photometric reader, quantitative data can also be obtained. Data for pairs of sensitivity/specificity as well as positive/negative predictive values were created by variation of threshold values for the whole patient cohort, as well as for the tumor-free control group. Based on these data, sensitivity–specificity and predictive value threshold distribution curves were constructed and transformed into SS-ROC and PV-ROC curves, which were included in a single SS/PV-ROC plot. Results: The curves revealed TPP-asymmetric improper curves which cross the diagonal from above. Evaluation of the PV-ROC curve showed that two or more distinct positive predictive values (PPV) can correspond to the same value of a negative predictive value (NPV) and vice versa, indicating a complexity in PV-ROC curves which did not exist in SS-ROC curves. In contrast to the SS-ROC curve, the PV-ROC curve had neither an area under the curve (AUC) nor a range from 0% to 100%. Sensitivity of the qualitative assay was 58.5% and specificity 88.2%, PPV was 75.6% and NPV 77.3%, at a threshold value of approximately 12.5 µg/L. Conclusions: The SS/PV-ROC plot is a new diagnostic approach which can be used for direct judgement of gain and loss of predictive values, sensitivity and specificity according to varied threshold value changes, enabling characterization, comparison and evaluation of qualitative and quantitative bioassays.https://www.mdpi.com/1099-4300/22/7/729predictive ROC curveROC curvePV-ROC curveSS-ROC curveSS/PV-ROC plotempirical |
| spellingShingle | Peter Oehr Thorsten Ecke Establishment and Characterization of an Empirical Biomarker SS/PV-ROC Plot Using Results of the UBC<sup>®</sup> <i>Rapid</i> Test in Bladder Cancer Entropy predictive ROC curve ROC curve PV-ROC curve SS-ROC curve SS/PV-ROC plot empirical |
| title | Establishment and Characterization of an Empirical Biomarker SS/PV-ROC Plot Using Results of the UBC<sup>®</sup> <i>Rapid</i> Test in Bladder Cancer |
| title_full | Establishment and Characterization of an Empirical Biomarker SS/PV-ROC Plot Using Results of the UBC<sup>®</sup> <i>Rapid</i> Test in Bladder Cancer |
| title_fullStr | Establishment and Characterization of an Empirical Biomarker SS/PV-ROC Plot Using Results of the UBC<sup>®</sup> <i>Rapid</i> Test in Bladder Cancer |
| title_full_unstemmed | Establishment and Characterization of an Empirical Biomarker SS/PV-ROC Plot Using Results of the UBC<sup>®</sup> <i>Rapid</i> Test in Bladder Cancer |
| title_short | Establishment and Characterization of an Empirical Biomarker SS/PV-ROC Plot Using Results of the UBC<sup>®</sup> <i>Rapid</i> Test in Bladder Cancer |
| title_sort | establishment and characterization of an empirical biomarker ss pv roc plot using results of the ubc sup r sup i rapid i test in bladder cancer |
| topic | predictive ROC curve ROC curve PV-ROC curve SS-ROC curve SS/PV-ROC plot empirical |
| url | https://www.mdpi.com/1099-4300/22/7/729 |
| work_keys_str_mv | AT peteroehr establishmentandcharacterizationofanempiricalbiomarkersspvrocplotusingresultsoftheubcsupsupirapiditestinbladdercancer AT thorstenecke establishmentandcharacterizationofanempiricalbiomarkersspvrocplotusingresultsoftheubcsupsupirapiditestinbladdercancer |