Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing Images
Oriented object detection is a fundamental and challenging task in remote sensing image analysis and has received much attention in recent years. Optical remote sensing images often have more complex background information than natural images, and the number of annotated samples varies in different...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-12-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/14/24/6226 |
| _version_ | 1797455443890536448 |
|---|---|
| author | Peng Lin Xiaofeng Wu Bin Wang |
| author_facet | Peng Lin Xiaofeng Wu Bin Wang |
| author_sort | Peng Lin |
| collection | DOAJ |
| description | Oriented object detection is a fundamental and challenging task in remote sensing image analysis and has received much attention in recent years. Optical remote sensing images often have more complex background information than natural images, and the number of annotated samples varies in different categories. To enhance the difference between foreground and background, current one-stage object detection algorithms attempt to exploit focus loss to balance the foreground and background weights, thus making the network more focused on the foreground part. However, the current one-stage object detectors still face two main challenges: (1) the detection network pays little attention to the foreground and does not make full use of the foreground information; (2) the distinction of similar object categories has not attracted attention. To address the above challenges, this paper presents a foreground feature enhancement method applied to one-stage object detection. The proposed method mainly includes two important components: keypoint attention module (KAM) and prototype contrastive learning module (PCLM). The KAM is used to enhance the features of the foreground part of the image and reduce the features of the background part of the image, and the PCLM is utilized to enhance the discrimination of samples between foreground categories and reduce the confusion of samples between different categories. Furthermore, the proposed method designs and adopts an equalized modulation focal loss (EMFL) to optimize the training process of the model and increase the loss weight of the foreground later in the model training. Experimental results on the publicly available DOTA datasets and HRSC2016 datasets show that our method exhibits state-of-the-art performance. |
| first_indexed | 2024-03-09T15:54:29Z |
| format | Article |
| id | doaj.art-63e0cbde04db482787c5a7a70387730d |
| institution | Directory Open Access Journal |
| issn | 2072-4292 |
| language | English |
| last_indexed | 2024-03-09T15:54:29Z |
| publishDate | 2022-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj.art-63e0cbde04db482787c5a7a70387730d2023-11-24T17:46:10ZengMDPI AGRemote Sensing2072-42922022-12-011424622610.3390/rs14246226Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing ImagesPeng Lin0Xiaofeng Wu1Bin Wang2Key Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University, Shanghai 200433, ChinaKey Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University, Shanghai 200433, ChinaKey Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University, Shanghai 200433, ChinaOriented object detection is a fundamental and challenging task in remote sensing image analysis and has received much attention in recent years. Optical remote sensing images often have more complex background information than natural images, and the number of annotated samples varies in different categories. To enhance the difference between foreground and background, current one-stage object detection algorithms attempt to exploit focus loss to balance the foreground and background weights, thus making the network more focused on the foreground part. However, the current one-stage object detectors still face two main challenges: (1) the detection network pays little attention to the foreground and does not make full use of the foreground information; (2) the distinction of similar object categories has not attracted attention. To address the above challenges, this paper presents a foreground feature enhancement method applied to one-stage object detection. The proposed method mainly includes two important components: keypoint attention module (KAM) and prototype contrastive learning module (PCLM). The KAM is used to enhance the features of the foreground part of the image and reduce the features of the background part of the image, and the PCLM is utilized to enhance the discrimination of samples between foreground categories and reduce the confusion of samples between different categories. Furthermore, the proposed method designs and adopts an equalized modulation focal loss (EMFL) to optimize the training process of the model and increase the loss weight of the foreground later in the model training. Experimental results on the publicly available DOTA datasets and HRSC2016 datasets show that our method exhibits state-of-the-art performance.https://www.mdpi.com/2072-4292/14/24/6226remote sensing imagesoriented object detectionkeypoint attentioncontrastive learningfocal loss |
| spellingShingle | Peng Lin Xiaofeng Wu Bin Wang Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing Images Remote Sensing remote sensing images oriented object detection keypoint attention contrastive learning focal loss |
| title | Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing Images |
| title_full | Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing Images |
| title_fullStr | Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing Images |
| title_full_unstemmed | Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing Images |
| title_short | Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing Images |
| title_sort | oriented object detection based on foreground feature enhancement in remote sensing images |
| topic | remote sensing images oriented object detection keypoint attention contrastive learning focal loss |
| url | https://www.mdpi.com/2072-4292/14/24/6226 |
| work_keys_str_mv | AT penglin orientedobjectdetectionbasedonforegroundfeatureenhancementinremotesensingimages AT xiaofengwu orientedobjectdetectionbasedonforegroundfeatureenhancementinremotesensingimages AT binwang orientedobjectdetectionbasedonforegroundfeatureenhancementinremotesensingimages |