Remote Sensing Colorization Based on Bidirectional Macro-Micro Adaptive Enhancement Network
The demand for re-colorization of remote sensing images is urgent since image quality is extremely deteriorated by haze or other noises occurring in the atmospheric layer. The most challenging issue is to restore the color information with respect to preserving spatial consistency as well as to obta...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9938408/ |
| _version_ | 1797986828281708544 |
|---|---|
| author | Jingyu J Wang Chenglong Wang Qicheng Yang Chengyu Zheng Jie Nie Mingxing Jiang |
| author_facet | Jingyu J Wang Chenglong Wang Qicheng Yang Chengyu Zheng Jie Nie Mingxing Jiang |
| author_sort | Jingyu J Wang |
| collection | DOAJ |
| description | The demand for re-colorization of remote sensing images is urgent since image quality is extremely deteriorated by haze or other noises occurring in the atmospheric layer. The most challenging issue is to restore the color information with respect to preserving spatial consistency as well as to obtain object salience in context with extremely imbalanced space structure, where the former requires learning stable macroscopic semantics while the latter needs to recover microscopic pixels. In this paper, we propose a Bidirectional Macro-Micro Adaptive Enhancement (BMMAEnet) framework by adopting three modules, i.e., the Downward Micro Enhancement (DME) module, the Upward Adaptive Macro Enhancement(UAME) module, and Macro-Micro Balance (MMB) module. Firstly, the DME module is designed by adding micro details as well as suppressing macro context during the multi-branch downsampling process to supplement missing pixel details. Secondly, UAME is proposed by adaptive selecting proper level of features during multi-branch upsampling process to strengthen macro semantic constraints. In addition, MMB is designed by embedding attention-guided local details and global semantics into the decoding features to balance micro and macro information within each branch. Comprehensive comparison and ablation experiments are implemented and verify the proposed method performs overpass SOTA methods not only in pixel color value restoration performance but also in human perceptive understanding. |
| first_indexed | 2024-04-11T07:38:03Z |
| format | Article |
| id | doaj.art-026a894f296444349ddccfe38f454ed9 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-11T07:38:03Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-026a894f296444349ddccfe38f454ed92022-12-22T04:36:39ZengIEEEIEEE Access2169-35362022-01-011012127212128610.1109/ACCESS.2022.32188349938408Remote Sensing Colorization Based on Bidirectional Macro-Micro Adaptive Enhancement NetworkJingyu J Wang0https://orcid.org/0000-0002-5644-3375Chenglong Wang1https://orcid.org/0000-0003-2262-4167Qicheng Yang2Chengyu Zheng3Jie Nie4https://orcid.org/0000-0003-4952-7666Mingxing Jiang5Faculty of Information Science and Engineering, Ocean University of China, Qingdao, ChinaFaculty of Information Science and Engineering, Ocean University of China, Qingdao, ChinaFaculty of Information Science and Engineering, Ocean University of China, Qingdao, ChinaFaculty of Information Science and Engineering, Ocean University of China, Qingdao, ChinaFaculty of Information Science and Engineering, Ocean University of China, Qingdao, ChinaFaculty of Information Science and Engineering, Ocean University of China, Qingdao, ChinaThe demand for re-colorization of remote sensing images is urgent since image quality is extremely deteriorated by haze or other noises occurring in the atmospheric layer. The most challenging issue is to restore the color information with respect to preserving spatial consistency as well as to obtain object salience in context with extremely imbalanced space structure, where the former requires learning stable macroscopic semantics while the latter needs to recover microscopic pixels. In this paper, we propose a Bidirectional Macro-Micro Adaptive Enhancement (BMMAEnet) framework by adopting three modules, i.e., the Downward Micro Enhancement (DME) module, the Upward Adaptive Macro Enhancement(UAME) module, and Macro-Micro Balance (MMB) module. Firstly, the DME module is designed by adding micro details as well as suppressing macro context during the multi-branch downsampling process to supplement missing pixel details. Secondly, UAME is proposed by adaptive selecting proper level of features during multi-branch upsampling process to strengthen macro semantic constraints. In addition, MMB is designed by embedding attention-guided local details and global semantics into the decoding features to balance micro and macro information within each branch. Comprehensive comparison and ablation experiments are implemented and verify the proposed method performs overpass SOTA methods not only in pixel color value restoration performance but also in human perceptive understanding.https://ieeexplore.ieee.org/document/9938408/ColorizationDCGANmulti-scaleremote sensing image |
| spellingShingle | Jingyu J Wang Chenglong Wang Qicheng Yang Chengyu Zheng Jie Nie Mingxing Jiang Remote Sensing Colorization Based on Bidirectional Macro-Micro Adaptive Enhancement Network IEEE Access Colorization DCGAN multi-scale remote sensing image |
| title | Remote Sensing Colorization Based on Bidirectional Macro-Micro Adaptive Enhancement Network |
| title_full | Remote Sensing Colorization Based on Bidirectional Macro-Micro Adaptive Enhancement Network |
| title_fullStr | Remote Sensing Colorization Based on Bidirectional Macro-Micro Adaptive Enhancement Network |
| title_full_unstemmed | Remote Sensing Colorization Based on Bidirectional Macro-Micro Adaptive Enhancement Network |
| title_short | Remote Sensing Colorization Based on Bidirectional Macro-Micro Adaptive Enhancement Network |
| title_sort | remote sensing colorization based on bidirectional macro micro adaptive enhancement network |
| topic | Colorization DCGAN multi-scale remote sensing image |
| url | https://ieeexplore.ieee.org/document/9938408/ |
| work_keys_str_mv | AT jingyujwang remotesensingcolorizationbasedonbidirectionalmacromicroadaptiveenhancementnetwork AT chenglongwang remotesensingcolorizationbasedonbidirectionalmacromicroadaptiveenhancementnetwork AT qichengyang remotesensingcolorizationbasedonbidirectionalmacromicroadaptiveenhancementnetwork AT chengyuzheng remotesensingcolorizationbasedonbidirectionalmacromicroadaptiveenhancementnetwork AT jienie remotesensingcolorizationbasedonbidirectionalmacromicroadaptiveenhancementnetwork AT mingxingjiang remotesensingcolorizationbasedonbidirectionalmacromicroadaptiveenhancementnetwork |