Dynamic Soft Label Assignment for Arbitrary-Oriented Ship Detection
Ship detection with several military and civilian applications has drawn considerable attention in recent years. In remote sensing images, ships have the characteristics of arbitrary orientation. Based on the characteristics, many arbitrary-oriented ship detectors have been proposed. Most of these d...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10003970/ |
| _version_ | 1797330382794784768 |
|---|---|
| author | Yangfan Li Chunjiang Bian Hongzhen Chen |
| author_facet | Yangfan Li Chunjiang Bian Hongzhen Chen |
| author_sort | Yangfan Li |
| collection | DOAJ |
| description | Ship detection with several military and civilian applications has drawn considerable attention in recent years. In remote sensing images, ships have the characteristics of arbitrary orientation. Based on the characteristics, many arbitrary-oriented ship detectors have been proposed. Most of these detectors preset many horizontal or rotated anchors and determine the positive and negative samples based on the intersection over union (IoU) between the anchor and ground-truth bounding box, in what is called the label assignment process. However, IoU performance is limited as it can only reflect the quality of the anchor to a certain extent. In addition, the manually fixed IoU threshold to separate the positive and negative limits the flexibility of the method, as different ships may have different optimal thresholds. Moreover, the equally weighted training samples cause a misalignment between the classification and regression heads. Therefore, we propose a dynamic soft label assignment method for arbitrary-oriented ship detection. First, we design a novel anchor quality score function that takes into account both prior and prediction information of the anchor and enables the model to participate in the label assignment process. Second, we propose a dynamic anchor quality score threshold instead of a fixed IoU threshold for dividing positive and negative samples. Third, in contrast to assigning equal weights, we propose a soft label assignment strategy to weigh the training samples in the loss function. The proposed method offers superior detection performances for arbitrary-oriented ships with only one horizontal preset anchor. Experimental results on HRSC2016, FGSD, and ShipRSImageNet datasets demonstrate the effectiveness of our proposed dynamic soft label assignment for arbitrary-oriented ship detection. |
| first_indexed | 2024-03-08T07:19:05Z |
| format | Article |
| id | doaj.art-1a48b239d9a940c8b088fa9e885a0893 |
| institution | Directory Open Access Journal |
| issn | 2151-1535 |
| language | English |
| last_indexed | 2024-03-08T07:19:05Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj.art-1a48b239d9a940c8b088fa9e885a08932024-02-03T00:01:47ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing2151-15352023-01-01161160117010.1109/JSTARS.2022.323308110003970Dynamic Soft Label Assignment for Arbitrary-Oriented Ship DetectionYangfan Li0https://orcid.org/0000-0002-8965-7134Chunjiang Bian1Hongzhen Chen2https://orcid.org/0000-0002-0181-9742Key Laboratory of Electronics and Information Technology for Space Systems, National Space Science Center, Chinese Academy of Sciences, Beijing, ChinaKey Laboratory of Electronics and Information Technology for Space Systems, National Space Science Center, Chinese Academy of Sciences, Beijing, ChinaKey Laboratory of Electronics and Information Technology for Space Systems, National Space Science Center, Chinese Academy of Sciences, Beijing, ChinaShip detection with several military and civilian applications has drawn considerable attention in recent years. In remote sensing images, ships have the characteristics of arbitrary orientation. Based on the characteristics, many arbitrary-oriented ship detectors have been proposed. Most of these detectors preset many horizontal or rotated anchors and determine the positive and negative samples based on the intersection over union (IoU) between the anchor and ground-truth bounding box, in what is called the label assignment process. However, IoU performance is limited as it can only reflect the quality of the anchor to a certain extent. In addition, the manually fixed IoU threshold to separate the positive and negative limits the flexibility of the method, as different ships may have different optimal thresholds. Moreover, the equally weighted training samples cause a misalignment between the classification and regression heads. Therefore, we propose a dynamic soft label assignment method for arbitrary-oriented ship detection. First, we design a novel anchor quality score function that takes into account both prior and prediction information of the anchor and enables the model to participate in the label assignment process. Second, we propose a dynamic anchor quality score threshold instead of a fixed IoU threshold for dividing positive and negative samples. Third, in contrast to assigning equal weights, we propose a soft label assignment strategy to weigh the training samples in the loss function. The proposed method offers superior detection performances for arbitrary-oriented ships with only one horizontal preset anchor. Experimental results on HRSC2016, FGSD, and ShipRSImageNet datasets demonstrate the effectiveness of our proposed dynamic soft label assignment for arbitrary-oriented ship detection.https://ieeexplore.ieee.org/document/10003970/Deep learninglabel assignmentremote sensing imagesship detection |
| spellingShingle | Yangfan Li Chunjiang Bian Hongzhen Chen Dynamic Soft Label Assignment for Arbitrary-Oriented Ship Detection IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Deep learning label assignment remote sensing images ship detection |
| title | Dynamic Soft Label Assignment for Arbitrary-Oriented Ship Detection |
| title_full | Dynamic Soft Label Assignment for Arbitrary-Oriented Ship Detection |
| title_fullStr | Dynamic Soft Label Assignment for Arbitrary-Oriented Ship Detection |
| title_full_unstemmed | Dynamic Soft Label Assignment for Arbitrary-Oriented Ship Detection |
| title_short | Dynamic Soft Label Assignment for Arbitrary-Oriented Ship Detection |
| title_sort | dynamic soft label assignment for arbitrary oriented ship detection |
| topic | Deep learning label assignment remote sensing images ship detection |
| url | https://ieeexplore.ieee.org/document/10003970/ |
| work_keys_str_mv | AT yangfanli dynamicsoftlabelassignmentforarbitraryorientedshipdetection AT chunjiangbian dynamicsoftlabelassignmentforarbitraryorientedshipdetection AT hongzhenchen dynamicsoftlabelassignmentforarbitraryorientedshipdetection |