Aurora Image Search With Saliency Deep Features
Although the convolutional neural networks have obtained amazing performance in the area of image search, most of the existing methods are applied for natural images collected via normal lens without anamorphic distortion. Actually, there are great amounts of images collected with a circular fisheye...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2019-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8718278/ |
| _version_ | 1818935913533669376 |
|---|---|
| author | Xi Yang Nannan Wang Bin Song Xinbo Gao |
| author_facet | Xi Yang Nannan Wang Bin Song Xinbo Gao |
| author_sort | Xi Yang |
| collection | DOAJ |
| description | Although the convolutional neural networks have obtained amazing performance in the area of image search, most of the existing methods are applied for natural images collected via normal lens without anamorphic distortion. Actually, there are great amounts of images collected with a circular fisheye lens to obtain larger field-of-view (FOV), especially in the area of natural science study. This paper aims to present a novel image search method with saliency deep features for those images, especially the aurora images used in solar-terrestrial space research. Our method exploits the advanced Mask R-CNN framework to extract semantic features. To utilize the unique physical characteristics of aurora and focus on the most informative local regions, we present a saliency proposal network (SPN) to take place in the region proposal network (RPN). In our SPN, different from the conventional rectangular gridding way, the proposed anchors show spherical distortion determined by imaging principle and magnetic information. In addition, instead of the horizontal directions, our anchor boxes direct perpendicular to the physical magnetic meridian, and thus ensure them to include the auroral structures within minimum areas. We perform numerous experiments on the big aurora image dataset, and the results prove the superiority of the proposed method over the state-of-the-art methods on both search accuracy and efficiency. |
| first_indexed | 2024-12-20T05:27:43Z |
| format | Article |
| id | doaj.art-5a10d59c93cb4ca9ae26a5544cc8472a |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-20T05:27:43Z |
| publishDate | 2019-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-5a10d59c93cb4ca9ae26a5544cc8472a2022-12-21T19:51:50ZengIEEEIEEE Access2169-35362019-01-017659966600610.1109/ACCESS.2019.29177238718278Aurora Image Search With Saliency Deep FeaturesXi Yang0https://orcid.org/0000-0002-5791-3674Nannan Wang1Bin Song2Xinbo Gao3State Key Laboratory of Integrated Services Networks, School of Telecommunications Engineering, Xidian University, Xi’an, ChinaState Key Laboratory of Integrated Services Networks, School of Telecommunications Engineering, Xidian University, Xi’an, ChinaState Key Laboratory of Integrated Services Networks, School of Telecommunications Engineering, Xidian University, Xi’an, ChinaState Key Laboratory of Integrated Services Networks, School of Electronic Engineering, Xidian University, Xi’an, ChinaAlthough the convolutional neural networks have obtained amazing performance in the area of image search, most of the existing methods are applied for natural images collected via normal lens without anamorphic distortion. Actually, there are great amounts of images collected with a circular fisheye lens to obtain larger field-of-view (FOV), especially in the area of natural science study. This paper aims to present a novel image search method with saliency deep features for those images, especially the aurora images used in solar-terrestrial space research. Our method exploits the advanced Mask R-CNN framework to extract semantic features. To utilize the unique physical characteristics of aurora and focus on the most informative local regions, we present a saliency proposal network (SPN) to take place in the region proposal network (RPN). In our SPN, different from the conventional rectangular gridding way, the proposed anchors show spherical distortion determined by imaging principle and magnetic information. In addition, instead of the horizontal directions, our anchor boxes direct perpendicular to the physical magnetic meridian, and thus ensure them to include the auroral structures within minimum areas. We perform numerous experiments on the big aurora image dataset, and the results prove the superiority of the proposed method over the state-of-the-art methods on both search accuracy and efficiency.https://ieeexplore.ieee.org/document/8718278/Convolutional neural networkaurora image searchsaliency deep features |
| spellingShingle | Xi Yang Nannan Wang Bin Song Xinbo Gao Aurora Image Search With Saliency Deep Features IEEE Access Convolutional neural network aurora image search saliency deep features |
| title | Aurora Image Search With Saliency Deep Features |
| title_full | Aurora Image Search With Saliency Deep Features |
| title_fullStr | Aurora Image Search With Saliency Deep Features |
| title_full_unstemmed | Aurora Image Search With Saliency Deep Features |
| title_short | Aurora Image Search With Saliency Deep Features |
| title_sort | aurora image search with saliency deep features |
| topic | Convolutional neural network aurora image search saliency deep features |
| url | https://ieeexplore.ieee.org/document/8718278/ |
| work_keys_str_mv | AT xiyang auroraimagesearchwithsaliencydeepfeatures AT nannanwang auroraimagesearchwithsaliencydeepfeatures AT binsong auroraimagesearchwithsaliencydeepfeatures AT xinbogao auroraimagesearchwithsaliencydeepfeatures |