Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night Scene
The goal of infrared and visible image fusion in the night scene is to generate a fused image containing salient targets and rich textural details. However, the existing image fusion methods fail to take the unevenness of nighttime luminance into account. To address the above issue, an infrared and...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-11-01
|
| Series: | Entropy |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1099-4300/24/12/1759 |
| _version_ | 1797459265633386496 |
|---|---|
| author | Weida Zhan Jiale Wang Yichun Jiang Yu Chen Tingyuan Zheng Yang Hong |
| author_facet | Weida Zhan Jiale Wang Yichun Jiang Yu Chen Tingyuan Zheng Yang Hong |
| author_sort | Weida Zhan |
| collection | DOAJ |
| description | The goal of infrared and visible image fusion in the night scene is to generate a fused image containing salient targets and rich textural details. However, the existing image fusion methods fail to take the unevenness of nighttime luminance into account. To address the above issue, an infrared and visible image fusion method for highlighting salient targets in the night scene is proposed. First of all, a global attention module is designed, which rescales the weights of different channels after capturing global contextual information. Second, the loss function is divided into the foreground loss and the background loss, forcing the fused image to retain rich texture details while highlighting the salient targets. Finally, a luminance estimation function is introduced to obtain the trade-off control parameters of the foreground loss function based on the nighttime luminance. It can effectively highlight salient targets by retaining the foreground information from the source images. Compared with other advanced methods, the experimental results adequately demonstrate the excellent fusion performance and generalization of the proposed method. |
| first_indexed | 2024-03-09T16:49:57Z |
| format | Article |
| id | doaj.art-7f764e416e2547418319491549d3f561 |
| institution | Directory Open Access Journal |
| issn | 1099-4300 |
| language | English |
| last_indexed | 2024-03-09T16:49:57Z |
| publishDate | 2022-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Entropy |
| spelling | doaj.art-7f764e416e2547418319491549d3f5612023-11-24T14:42:28ZengMDPI AGEntropy1099-43002022-11-012412175910.3390/e24121759Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night SceneWeida Zhan0Jiale Wang1Yichun Jiang2Yu Chen3Tingyuan Zheng4Yang Hong5National Demonstration Center for Experimental Electrical, School of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, ChinaNational Demonstration Center for Experimental Electrical, School of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, ChinaNational Demonstration Center for Experimental Electrical, School of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, ChinaNational Demonstration Center for Experimental Electrical, School of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, ChinaNational Demonstration Center for Experimental Electrical, School of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, ChinaNational Demonstration Center for Experimental Electrical, School of Electronic and Information Engineering, Changchun University of Science and Technology, Changchun 130022, ChinaThe goal of infrared and visible image fusion in the night scene is to generate a fused image containing salient targets and rich textural details. However, the existing image fusion methods fail to take the unevenness of nighttime luminance into account. To address the above issue, an infrared and visible image fusion method for highlighting salient targets in the night scene is proposed. First of all, a global attention module is designed, which rescales the weights of different channels after capturing global contextual information. Second, the loss function is divided into the foreground loss and the background loss, forcing the fused image to retain rich texture details while highlighting the salient targets. Finally, a luminance estimation function is introduced to obtain the trade-off control parameters of the foreground loss function based on the nighttime luminance. It can effectively highlight salient targets by retaining the foreground information from the source images. Compared with other advanced methods, the experimental results adequately demonstrate the excellent fusion performance and generalization of the proposed method.https://www.mdpi.com/1099-4300/24/12/1759image fusionhighlighting salient targetsinfrared imagesdeep learning |
| spellingShingle | Weida Zhan Jiale Wang Yichun Jiang Yu Chen Tingyuan Zheng Yang Hong Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night Scene Entropy image fusion highlighting salient targets infrared images deep learning |
| title | Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night Scene |
| title_full | Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night Scene |
| title_fullStr | Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night Scene |
| title_full_unstemmed | Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night Scene |
| title_short | Infrared and Visible Image Fusion for Highlighting Salient Targets in the Night Scene |
| title_sort | infrared and visible image fusion for highlighting salient targets in the night scene |
| topic | image fusion highlighting salient targets infrared images deep learning |
| url | https://www.mdpi.com/1099-4300/24/12/1759 |
| work_keys_str_mv | AT weidazhan infraredandvisibleimagefusionforhighlightingsalienttargetsinthenightscene AT jialewang infraredandvisibleimagefusionforhighlightingsalienttargetsinthenightscene AT yichunjiang infraredandvisibleimagefusionforhighlightingsalienttargetsinthenightscene AT yuchen infraredandvisibleimagefusionforhighlightingsalienttargetsinthenightscene AT tingyuanzheng infraredandvisibleimagefusionforhighlightingsalienttargetsinthenightscene AT yanghong infraredandvisibleimagefusionforhighlightingsalienttargetsinthenightscene |