Super-trustscore: reliable failure detection for automated skin lesion diagnosis
The successful deployment of deep neural networks in safetycritical settings, such as medical image analysis, is contingent on their ability to provide reliable uncertainty estimates. In this paper, we propose a new confidence scoring function called Super-TrustScore that improves upon the existing...
| Main Authors: | , |
|---|---|
| 格式: | Conference item |
| 语言: | English |
| 出版: |
IEEE
2024
|
| _version_ | 1826314513859739648 |
|---|---|
| author | Naushad, J Voiculescu, ID |
| author_facet | Naushad, J Voiculescu, ID |
| author_sort | Naushad, J |
| collection | OXFORD |
| description | The successful deployment of deep neural networks in safetycritical settings, such as medical image analysis, is contingent on their ability to provide reliable uncertainty estimates.
In this paper, we propose a new confidence scoring function called Super-TrustScore that improves upon the existing TrustScore method by combining a local confidence score
and a global confidence score. Super-TrustScore is a post-hoc
method and can be easily applied to any existing pre-trained
model as there are no particular architecture or classifier training requirements. We demonstrate empirically that SuperTrustScore consistently provides the most reliable uncertainty
estimates for both in-distribution and shifted-distribution failure detection on the task of skin lesion diagnosis. |
| first_indexed | 2024-03-07T08:21:50Z |
| format | Conference item |
| id | oxford-uuid:8c70db19-7ad8-42a7-bc27-884f19e31f7c |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-09-25T04:35:14Z |
| publishDate | 2024 |
| publisher | IEEE |
| record_format | dspace |
| spelling | oxford-uuid:8c70db19-7ad8-42a7-bc27-884f19e31f7c2024-09-12T20:03:31ZSuper-trustscore: reliable failure detection for automated skin lesion diagnosisConference itemhttp://purl.org/coar/resource_type/c_5794uuid:8c70db19-7ad8-42a7-bc27-884f19e31f7cEnglishSymplectic ElementsIEEE2024Naushad, JVoiculescu, IDThe successful deployment of deep neural networks in safetycritical settings, such as medical image analysis, is contingent on their ability to provide reliable uncertainty estimates. In this paper, we propose a new confidence scoring function called Super-TrustScore that improves upon the existing TrustScore method by combining a local confidence score and a global confidence score. Super-TrustScore is a post-hoc method and can be easily applied to any existing pre-trained model as there are no particular architecture or classifier training requirements. We demonstrate empirically that SuperTrustScore consistently provides the most reliable uncertainty estimates for both in-distribution and shifted-distribution failure detection on the task of skin lesion diagnosis. |
| spellingShingle | Naushad, J Voiculescu, ID Super-trustscore: reliable failure detection for automated skin lesion diagnosis |
| title | Super-trustscore: reliable failure detection for automated skin lesion diagnosis |
| title_full | Super-trustscore: reliable failure detection for automated skin lesion diagnosis |
| title_fullStr | Super-trustscore: reliable failure detection for automated skin lesion diagnosis |
| title_full_unstemmed | Super-trustscore: reliable failure detection for automated skin lesion diagnosis |
| title_short | Super-trustscore: reliable failure detection for automated skin lesion diagnosis |
| title_sort | super trustscore reliable failure detection for automated skin lesion diagnosis |
| work_keys_str_mv | AT naushadj supertrustscorereliablefailuredetectionforautomatedskinlesiondiagnosis AT voiculescuid supertrustscorereliablefailuredetectionforautomatedskinlesiondiagnosis |