Texture and semantic integrated small objects detection in foggy scenes.
In recent years, small objects detection has received extensive attention from scholars for its important value in application. Some effective methods for small objects detection have been proposed. However, the data collected in real scenes are often foggy images, so the models trained with these m...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2022-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0270356 |
| _version_ | 1827963206325239808 |
|---|---|
| author | Zhengyun Fang Hongbin Wang Shilin Li Yi Hu Xingbo Han |
| author_facet | Zhengyun Fang Hongbin Wang Shilin Li Yi Hu Xingbo Han |
| author_sort | Zhengyun Fang |
| collection | DOAJ |
| description | In recent years, small objects detection has received extensive attention from scholars for its important value in application. Some effective methods for small objects detection have been proposed. However, the data collected in real scenes are often foggy images, so the models trained with these methods are difficult to extract discriminative object features from such images. In addition, the existing small objects detection algorithms ignore the texture information and high-level semantic information of tiny objects, which limits the improvement of detection performance. Aiming at the above problems, this paper proposes a texture and semantic integrated small objects detection in foggy scenes. The algorithm focuses on extracting discriminative features unaffected by the environment, and obtaining texture information and high-level semantic information of small objects. Specifically, considering the adverse impact of foggy images on recognition performance, a knowledge guidance module is designed, and the discriminative features extracted from clear images by the model are used to guide the network to learn foggy images. Second, the features of high-resolution images and low-resolution images are extracted, and the adversarial learning method is adopted to train the model to give the network the ability to obtain the texture information of tiny objects from low-resolution images. Finally, an attention mechanism is constructed between feature maps of the same scale and different scales to further enrich the high-level semantic information of small objects. A large number of experiments have been conducted on data sets such as "Cityscape to Foggy" and "CoCo". The mean prediction accuracy (mAP) has reached 46.2% on "Cityscape to Fogg", and 33.3% on "CoCo", which fully proves the effectiveness and superiority of the proposed method. |
| first_indexed | 2024-04-09T16:54:40Z |
| format | Article |
| id | doaj.art-4c4953597a6f4a4181661041685f6076 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-04-09T16:54:40Z |
| publishDate | 2022-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-4c4953597a6f4a4181661041685f60762023-04-21T05:36:26ZengPublic Library of Science (PLoS)PLoS ONE1932-62032022-01-01178e027035610.1371/journal.pone.0270356Texture and semantic integrated small objects detection in foggy scenes.Zhengyun FangHongbin WangShilin LiYi HuXingbo HanIn recent years, small objects detection has received extensive attention from scholars for its important value in application. Some effective methods for small objects detection have been proposed. However, the data collected in real scenes are often foggy images, so the models trained with these methods are difficult to extract discriminative object features from such images. In addition, the existing small objects detection algorithms ignore the texture information and high-level semantic information of tiny objects, which limits the improvement of detection performance. Aiming at the above problems, this paper proposes a texture and semantic integrated small objects detection in foggy scenes. The algorithm focuses on extracting discriminative features unaffected by the environment, and obtaining texture information and high-level semantic information of small objects. Specifically, considering the adverse impact of foggy images on recognition performance, a knowledge guidance module is designed, and the discriminative features extracted from clear images by the model are used to guide the network to learn foggy images. Second, the features of high-resolution images and low-resolution images are extracted, and the adversarial learning method is adopted to train the model to give the network the ability to obtain the texture information of tiny objects from low-resolution images. Finally, an attention mechanism is constructed between feature maps of the same scale and different scales to further enrich the high-level semantic information of small objects. A large number of experiments have been conducted on data sets such as "Cityscape to Foggy" and "CoCo". The mean prediction accuracy (mAP) has reached 46.2% on "Cityscape to Fogg", and 33.3% on "CoCo", which fully proves the effectiveness and superiority of the proposed method.https://doi.org/10.1371/journal.pone.0270356 |
| spellingShingle | Zhengyun Fang Hongbin Wang Shilin Li Yi Hu Xingbo Han Texture and semantic integrated small objects detection in foggy scenes. PLoS ONE |
| title | Texture and semantic integrated small objects detection in foggy scenes. |
| title_full | Texture and semantic integrated small objects detection in foggy scenes. |
| title_fullStr | Texture and semantic integrated small objects detection in foggy scenes. |
| title_full_unstemmed | Texture and semantic integrated small objects detection in foggy scenes. |
| title_short | Texture and semantic integrated small objects detection in foggy scenes. |
| title_sort | texture and semantic integrated small objects detection in foggy scenes |
| url | https://doi.org/10.1371/journal.pone.0270356 |
| work_keys_str_mv | AT zhengyunfang textureandsemanticintegratedsmallobjectsdetectioninfoggyscenes AT hongbinwang textureandsemanticintegratedsmallobjectsdetectioninfoggyscenes AT shilinli textureandsemanticintegratedsmallobjectsdetectioninfoggyscenes AT yihu textureandsemanticintegratedsmallobjectsdetectioninfoggyscenes AT xingbohan textureandsemanticintegratedsmallobjectsdetectioninfoggyscenes |