Semantic Segmentation With Multiple Contradictory Annotations Using a Dynamic Score Function
Semantic Segmentation aims to partition an image into separate regions where each region conveys certain valuable information. In recent years, deep learning models have achieved high performance in this task. However, when several ground truth segmentations are available, aggregating the informatio...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10130286/ |
| _version_ | 1797788557231783936 |
|---|---|
| author | Pooya Esmaeil Akhoondi Mahdieh Soleymani Baghshah |
| author_facet | Pooya Esmaeil Akhoondi Mahdieh Soleymani Baghshah |
| author_sort | Pooya Esmaeil Akhoondi |
| collection | DOAJ |
| description | Semantic Segmentation aims to partition an image into separate regions where each region conveys certain valuable information. In recent years, deep learning models have achieved high performance in this task. However, when several ground truth segmentations are available, aggregating the information of these segmentations into a single ground truth becomes a crucial pre-processing step. This task becomes challenging when the segmentations are contradictory and the existing classes in the segmentations are imbalanced. An elegant example is the grading of Prostate Cancer in the Gleason 2019 Challenge dataset. This dataset provides six annotations of relatively high contrast from expert pathologists for each image. Additionally, the low number of images for Gleason grade 5 has also resulted in an imbalanced dataset. The Majority Voting and the Simultaneous Truth And Performance Level Estimation (STAPLE) algorithm are the most popular algorithms for combining annotations. In this paper, we visually show that the outputs of these algorithms discard the semantics of the image in regions of high inconsistency and point out that they demote low-frequency patterns, making the final segmentations even more imbalanced. We claim these drawbacks highly decrease the performance of deep learning models trained on these ground truths. To solve this problem, we propose a dynamic score function that selects one of the six annotations for each image while balancing the Gleason grading among the annotations in terms of variability and quantity. Finally, we train and evaluate a Pyramid Scene Parsing network on the final ground truths to validate our claims. |
| first_indexed | 2024-03-13T01:38:13Z |
| format | Article |
| id | doaj.art-d856afd6be7e472b8defbb863268907a |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T01:38:13Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-d856afd6be7e472b8defbb863268907a2023-07-03T23:00:19ZengIEEEIEEE Access2169-35362023-01-0111645446455810.1109/ACCESS.2023.327827510130286Semantic Segmentation With Multiple Contradictory Annotations Using a Dynamic Score FunctionPooya Esmaeil Akhoondi0https://orcid.org/0009-0004-9921-7249Mahdieh Soleymani Baghshah1https://orcid.org/0000-0002-1971-6231Department of Computer Engineering, Sharif University of Technology, Tehran, IranDepartment of Computer Engineering, Sharif University of Technology, Tehran, IranSemantic Segmentation aims to partition an image into separate regions where each region conveys certain valuable information. In recent years, deep learning models have achieved high performance in this task. However, when several ground truth segmentations are available, aggregating the information of these segmentations into a single ground truth becomes a crucial pre-processing step. This task becomes challenging when the segmentations are contradictory and the existing classes in the segmentations are imbalanced. An elegant example is the grading of Prostate Cancer in the Gleason 2019 Challenge dataset. This dataset provides six annotations of relatively high contrast from expert pathologists for each image. Additionally, the low number of images for Gleason grade 5 has also resulted in an imbalanced dataset. The Majority Voting and the Simultaneous Truth And Performance Level Estimation (STAPLE) algorithm are the most popular algorithms for combining annotations. In this paper, we visually show that the outputs of these algorithms discard the semantics of the image in regions of high inconsistency and point out that they demote low-frequency patterns, making the final segmentations even more imbalanced. We claim these drawbacks highly decrease the performance of deep learning models trained on these ground truths. To solve this problem, we propose a dynamic score function that selects one of the six annotations for each image while balancing the Gleason grading among the annotations in terms of variability and quantity. Finally, we train and evaluate a Pyramid Scene Parsing network on the final ground truths to validate our claims.https://ieeexplore.ieee.org/document/10130286/Convolutional neural networksGleason 2019 challengeGleason gradingMulti-expert annotationsProstate cancerSemantic segmentation |
| spellingShingle | Pooya Esmaeil Akhoondi Mahdieh Soleymani Baghshah Semantic Segmentation With Multiple Contradictory Annotations Using a Dynamic Score Function IEEE Access Convolutional neural networks Gleason 2019 challenge Gleason grading Multi-expert annotations Prostate cancer Semantic segmentation |
| title | Semantic Segmentation With Multiple Contradictory Annotations Using a Dynamic Score Function |
| title_full | Semantic Segmentation With Multiple Contradictory Annotations Using a Dynamic Score Function |
| title_fullStr | Semantic Segmentation With Multiple Contradictory Annotations Using a Dynamic Score Function |
| title_full_unstemmed | Semantic Segmentation With Multiple Contradictory Annotations Using a Dynamic Score Function |
| title_short | Semantic Segmentation With Multiple Contradictory Annotations Using a Dynamic Score Function |
| title_sort | semantic segmentation with multiple contradictory annotations using a dynamic score function |
| topic | Convolutional neural networks Gleason 2019 challenge Gleason grading Multi-expert annotations Prostate cancer Semantic segmentation |
| url | https://ieeexplore.ieee.org/document/10130286/ |
| work_keys_str_mv | AT pooyaesmaeilakhoondi semanticsegmentationwithmultiplecontradictoryannotationsusingadynamicscorefunction AT mahdiehsoleymanibaghshah semanticsegmentationwithmultiplecontradictoryannotationsusingadynamicscorefunction |