Comparing Classifier's Performance Based on Confidence Interval of the ROC
This paper proposes a new methodology for comparing} two performance methods based on confidence interval for the ROC curve. The methods performed and compared are two algorithms for face recognition. The novelty of the paper is three-fold: i) designing a methodology for the comparison of decision m...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Spolecnost pro radioelektronicke inzenyrstvi
2018-08-01
|
| Series: | Radioengineering |
| Subjects: | |
| Online Access: | https://www.radioeng.cz/fulltexts/2018/18_03_0827_0834.pdf |
| _version_ | 1819259921805344768 |
|---|---|
| author | T. Malach J. Pomenkova |
| author_facet | T. Malach J. Pomenkova |
| author_sort | T. Malach |
| collection | DOAJ |
| description | This paper proposes a new methodology for comparing} two performance methods based on confidence interval for the ROC curve. The methods performed and compared are two algorithms for face recognition. The novelty of the paper is three-fold: i) designing a methodology for the comparison of decision making algorithms via confidence intervals of ROC curves; ii) investigating how sample sizes influence the properties of the particular methods; iii) recommendations for a general comparison of decision making algorithms via confidence intervals of ROC curves. To support our conclusions we investigate and demonstrate several approaches for constructing parametric confidence intervals on real data. Thus, we present a non-traditional and reliable way of reporting pattern recognition results using ROC curves with confidence intervals. |
| first_indexed | 2024-12-23T19:17:42Z |
| format | Article |
| id | doaj.art-75ce0edfeb294a07bd9b8574f36a37f1 |
| institution | Directory Open Access Journal |
| issn | 1210-2512 |
| language | English |
| last_indexed | 2024-12-23T19:17:42Z |
| publishDate | 2018-08-01 |
| publisher | Spolecnost pro radioelektronicke inzenyrstvi |
| record_format | Article |
| series | Radioengineering |
| spelling | doaj.art-75ce0edfeb294a07bd9b8574f36a37f12022-12-21T17:34:16ZengSpolecnost pro radioelektronicke inzenyrstviRadioengineering1210-25122018-08-01273827834Comparing Classifier's Performance Based on Confidence Interval of the ROCT. MalachJ. PomenkovaThis paper proposes a new methodology for comparing} two performance methods based on confidence interval for the ROC curve. The methods performed and compared are two algorithms for face recognition. The novelty of the paper is three-fold: i) designing a methodology for the comparison of decision making algorithms via confidence intervals of ROC curves; ii) investigating how sample sizes influence the properties of the particular methods; iii) recommendations for a general comparison of decision making algorithms via confidence intervals of ROC curves. To support our conclusions we investigate and demonstrate several approaches for constructing parametric confidence intervals on real data. Thus, we present a non-traditional and reliable way of reporting pattern recognition results using ROC curves with confidence intervals.https://www.radioeng.cz/fulltexts/2018/18_03_0827_0834.pdfConfidence intervalROC curvesface recognitionpattern recognition |
| spellingShingle | T. Malach J. Pomenkova Comparing Classifier's Performance Based on Confidence Interval of the ROC Radioengineering Confidence interval ROC curves face recognition pattern recognition |
| title | Comparing Classifier's Performance Based on Confidence Interval of the ROC |
| title_full | Comparing Classifier's Performance Based on Confidence Interval of the ROC |
| title_fullStr | Comparing Classifier's Performance Based on Confidence Interval of the ROC |
| title_full_unstemmed | Comparing Classifier's Performance Based on Confidence Interval of the ROC |
| title_short | Comparing Classifier's Performance Based on Confidence Interval of the ROC |
| title_sort | comparing classifier s performance based on confidence interval of the roc |
| topic | Confidence interval ROC curves face recognition pattern recognition |
| url | https://www.radioeng.cz/fulltexts/2018/18_03_0827_0834.pdf |
| work_keys_str_mv | AT tmalach comparingclassifiersperformancebasedonconfidenceintervaloftheroc AT jpomenkova comparingclassifiersperformancebasedonconfidenceintervaloftheroc |