Improved Detection Criteria for Detecting Drug-Drug Interaction Signals Using the Proportional Reporting Ratio
There is a current demand for “safety signal” screening, not only for single drugs but also for drug-drug interactions. The detection of drug-drug interaction signals using the proportional reporting ratio (<i>PRR</i>) has been reported, such as through using the combination risk ratio (...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-12-01
|
| Series: | Pharmaceuticals |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8247/14/1/4 |
| _version_ | 1797543877857509376 |
|---|---|
| author | Yoshihiro Noguchi Keisuke Aoyama Satoaki Kubo Tomoya Tachi Hitomi Teramachi |
| author_facet | Yoshihiro Noguchi Keisuke Aoyama Satoaki Kubo Tomoya Tachi Hitomi Teramachi |
| author_sort | Yoshihiro Noguchi |
| collection | DOAJ |
| description | There is a current demand for “safety signal” screening, not only for single drugs but also for drug-drug interactions. The detection of drug-drug interaction signals using the proportional reporting ratio (<i>PRR</i>) has been reported, such as through using the combination risk ratio (<i>CRR</i>). However, the <i>CRR</i> does not consider the overlap between the lower limit of the 95% confidence interval of the <i>PRR</i> of concomitant-use drugs and the upper limit of the 95% confidence interval of the <i>PRR</i> of single drugs. In this study, we proposed the concomitant signal score (<i>CSS</i>), with the improved detection criteria, to overcome the issues associated with the <i>CRR</i>. “Hypothetical” true data were generated through a combination of signals detected using three detection algorithms. The signal detection accuracy of the analytical model under investigation was verified using machine learning indicators. The <i>CSS</i> presented improved signal detection when the number of reports was ≥3, with respect to the following metrics: accuracy (<i>CRR</i>: 0.752 → <i>CSS</i>: 0.817), Youden’s index (<i>CRR</i>: 0.555 → <i>CSS</i>: 0.661), and <i>F</i>-measure (<i>CRR</i>: 0.780 → <i>CSS</i>: 0.820). The proposed model significantly improved the accuracy of signal detection for drug-drug interactions using the <i>PRR</i>. |
| first_indexed | 2024-03-10T13:51:12Z |
| format | Article |
| id | doaj.art-ccd6f25b7bd74759bc65aa7370017767 |
| institution | Directory Open Access Journal |
| issn | 1424-8247 |
| language | English |
| last_indexed | 2024-03-10T13:51:12Z |
| publishDate | 2020-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Pharmaceuticals |
| spelling | doaj.art-ccd6f25b7bd74759bc65aa73700177672023-11-21T02:08:25ZengMDPI AGPharmaceuticals1424-82472020-12-01141410.3390/ph14010004Improved Detection Criteria for Detecting Drug-Drug Interaction Signals Using the Proportional Reporting RatioYoshihiro Noguchi0Keisuke Aoyama1Satoaki Kubo2Tomoya Tachi3Hitomi Teramachi4Laboratory of Clinical Pharmacy, Gifu Pharmaceutical University, 1-25-4, Daigakunishi, Gifu-shi, Gifu 501-1196, JapanLaboratory of Clinical Pharmacy, Gifu Pharmaceutical University, 1-25-4, Daigakunishi, Gifu-shi, Gifu 501-1196, JapanLaboratory of Clinical Pharmacy, Gifu Pharmaceutical University, 1-25-4, Daigakunishi, Gifu-shi, Gifu 501-1196, JapanLaboratory of Clinical Pharmacy, Gifu Pharmaceutical University, 1-25-4, Daigakunishi, Gifu-shi, Gifu 501-1196, JapanLaboratory of Clinical Pharmacy, Gifu Pharmaceutical University, 1-25-4, Daigakunishi, Gifu-shi, Gifu 501-1196, JapanThere is a current demand for “safety signal” screening, not only for single drugs but also for drug-drug interactions. The detection of drug-drug interaction signals using the proportional reporting ratio (<i>PRR</i>) has been reported, such as through using the combination risk ratio (<i>CRR</i>). However, the <i>CRR</i> does not consider the overlap between the lower limit of the 95% confidence interval of the <i>PRR</i> of concomitant-use drugs and the upper limit of the 95% confidence interval of the <i>PRR</i> of single drugs. In this study, we proposed the concomitant signal score (<i>CSS</i>), with the improved detection criteria, to overcome the issues associated with the <i>CRR</i>. “Hypothetical” true data were generated through a combination of signals detected using three detection algorithms. The signal detection accuracy of the analytical model under investigation was verified using machine learning indicators. The <i>CSS</i> presented improved signal detection when the number of reports was ≥3, with respect to the following metrics: accuracy (<i>CRR</i>: 0.752 → <i>CSS</i>: 0.817), Youden’s index (<i>CRR</i>: 0.555 → <i>CSS</i>: 0.661), and <i>F</i>-measure (<i>CRR</i>: 0.780 → <i>CSS</i>: 0.820). The proposed model significantly improved the accuracy of signal detection for drug-drug interactions using the <i>PRR</i>.https://www.mdpi.com/1424-8247/14/1/4spontaneous reporting systemsdrug-drug interactionproportional reporting ratiocombination risk ratioconcomitant signal score |
| spellingShingle | Yoshihiro Noguchi Keisuke Aoyama Satoaki Kubo Tomoya Tachi Hitomi Teramachi Improved Detection Criteria for Detecting Drug-Drug Interaction Signals Using the Proportional Reporting Ratio Pharmaceuticals spontaneous reporting systems drug-drug interaction proportional reporting ratio combination risk ratio concomitant signal score |
| title | Improved Detection Criteria for Detecting Drug-Drug Interaction Signals Using the Proportional Reporting Ratio |
| title_full | Improved Detection Criteria for Detecting Drug-Drug Interaction Signals Using the Proportional Reporting Ratio |
| title_fullStr | Improved Detection Criteria for Detecting Drug-Drug Interaction Signals Using the Proportional Reporting Ratio |
| title_full_unstemmed | Improved Detection Criteria for Detecting Drug-Drug Interaction Signals Using the Proportional Reporting Ratio |
| title_short | Improved Detection Criteria for Detecting Drug-Drug Interaction Signals Using the Proportional Reporting Ratio |
| title_sort | improved detection criteria for detecting drug drug interaction signals using the proportional reporting ratio |
| topic | spontaneous reporting systems drug-drug interaction proportional reporting ratio combination risk ratio concomitant signal score |
| url | https://www.mdpi.com/1424-8247/14/1/4 |
| work_keys_str_mv | AT yoshihironoguchi improveddetectioncriteriafordetectingdrugdruginteractionsignalsusingtheproportionalreportingratio AT keisukeaoyama improveddetectioncriteriafordetectingdrugdruginteractionsignalsusingtheproportionalreportingratio AT satoakikubo improveddetectioncriteriafordetectingdrugdruginteractionsignalsusingtheproportionalreportingratio AT tomoyatachi improveddetectioncriteriafordetectingdrugdruginteractionsignalsusingtheproportionalreportingratio AT hitomiteramachi improveddetectioncriteriafordetectingdrugdruginteractionsignalsusingtheproportionalreportingratio |