Weakly supervised instance segmentation by learning annotation consistent instances
Recent approaches for weakly supervised instance segmentations depend on two components: (i) a pseudo label generation model which provides instances that are consistent with a given annotation; and (ii) an instance segmentation model, which is trained in a supervised manner using the pseudo labels...
| Main Authors: | , , |
|---|---|
| Format: | Conference item |
| Language: | English |
| Published: |
Springer
2020
|
| _version_ | 1826265168008445952 |
|---|---|
| author | Arun, A Jawahar, CV Mudigonda, P |
| author_facet | Arun, A Jawahar, CV Mudigonda, P |
| author_sort | Arun, A |
| collection | OXFORD |
| description | Recent approaches for weakly supervised instance segmentations depend on two components: (i) a pseudo label generation model which provides instances that are consistent with a given annotation; and (ii) an instance segmentation model, which is trained in a supervised manner using the pseudo labels as ground-truth. Unlike previous approaches, we explicitly model the uncertainty in the pseudo label generation process using a conditional distribution. The samples drawn from our conditional distribution provide accurate pseudo labels due to the use of semantic class aware unary terms, boundary aware pairwise smoothness terms, and annotation aware higher order terms. Furthermore, we represent the instance segmentation model as an annotation agnostic prediction distribution. In contrast to previous methods, our representation allows us to define a joint probabilistic learning objective that minimizes the dissimilarity between the two distributions. Our approach achieves state of the art results on the PASCAL VOC 2012 data set, outperforming the best baseline by 4.2% mAP𝑟0.5 and 4.8% mAP𝑟0.75 . |
| first_indexed | 2024-03-06T20:19:25Z |
| format | Conference item |
| id | oxford-uuid:2d48847b-d11a-4d2e-889b-350525ce7583 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T20:19:25Z |
| publishDate | 2020 |
| publisher | Springer |
| record_format | dspace |
| spelling | oxford-uuid:2d48847b-d11a-4d2e-889b-350525ce75832022-03-26T12:41:57ZWeakly supervised instance segmentation by learning annotation consistent instancesConference itemhttp://purl.org/coar/resource_type/c_5794uuid:2d48847b-d11a-4d2e-889b-350525ce7583EnglishSymplectic ElementsSpringer2020Arun, AJawahar, CVMudigonda, PRecent approaches for weakly supervised instance segmentations depend on two components: (i) a pseudo label generation model which provides instances that are consistent with a given annotation; and (ii) an instance segmentation model, which is trained in a supervised manner using the pseudo labels as ground-truth. Unlike previous approaches, we explicitly model the uncertainty in the pseudo label generation process using a conditional distribution. The samples drawn from our conditional distribution provide accurate pseudo labels due to the use of semantic class aware unary terms, boundary aware pairwise smoothness terms, and annotation aware higher order terms. Furthermore, we represent the instance segmentation model as an annotation agnostic prediction distribution. In contrast to previous methods, our representation allows us to define a joint probabilistic learning objective that minimizes the dissimilarity between the two distributions. Our approach achieves state of the art results on the PASCAL VOC 2012 data set, outperforming the best baseline by 4.2% mAP𝑟0.5 and 4.8% mAP𝑟0.75 . |
| spellingShingle | Arun, A Jawahar, CV Mudigonda, P Weakly supervised instance segmentation by learning annotation consistent instances |
| title | Weakly supervised instance segmentation by learning annotation consistent instances |
| title_full | Weakly supervised instance segmentation by learning annotation consistent instances |
| title_fullStr | Weakly supervised instance segmentation by learning annotation consistent instances |
| title_full_unstemmed | Weakly supervised instance segmentation by learning annotation consistent instances |
| title_short | Weakly supervised instance segmentation by learning annotation consistent instances |
| title_sort | weakly supervised instance segmentation by learning annotation consistent instances |
| work_keys_str_mv | AT aruna weaklysupervisedinstancesegmentationbylearningannotationconsistentinstances AT jawaharcv weaklysupervisedinstancesegmentationbylearningannotationconsistentinstances AT mudigondap weaklysupervisedinstancesegmentationbylearningannotationconsistentinstances |