An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information
Infrared and visible image fusion is a hot topic due to the perfect complementarity of their information. There are two key problems in infrared and visible image fusion. One is how to extract significant target areas and rich texture details from the source images, and the other is how to integrate...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9502600/ |
| _version_ | 1819152336219537408 |
|---|---|
| author | Qingqing Li Guangliang Han Peixun Liu Hang Yang Jiajia Wu Dongxu Liu |
| author_facet | Qingqing Li Guangliang Han Peixun Liu Hang Yang Jiajia Wu Dongxu Liu |
| author_sort | Qingqing Li |
| collection | DOAJ |
| description | Infrared and visible image fusion is a hot topic due to the perfect complementarity of their information. There are two key problems in infrared and visible image fusion. One is how to extract significant target areas and rich texture details from the source images, and the other is how to integrate them to produce satisfactory fused images. To tackle these problems, we propose a novel fusion framework in this paper. A multi-level image decomposition method is used to obtain the base layer and detail layer of the source image. For the fusion of base layer, an ingenious fusion strategy guided by the saliency map of source image is designed to improve the intensity of salient targets and the visual quality of the fused image. For the fusion of detail layer, an efficient approach by introducing the enhanced gradient information is presented to boost the detail features and sharpen the edges of the fused image. Experimental results demonstrate that, compared with fifteen classical and advanced fusion methods, the proposed image fusion framework has better performance in both subjective and objective evaluation. |
| first_indexed | 2024-12-22T14:47:40Z |
| format | Article |
| id | doaj.art-b20814daa6a14bebbdaa68c3350f70e0 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-22T14:47:40Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-b20814daa6a14bebbdaa68c3350f70e02022-12-21T18:22:24ZengIEEEIEEE Access2169-35362021-01-01910894210895810.1109/ACCESS.2021.31016399502600An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient InformationQingqing Li0https://orcid.org/0000-0002-2339-2399Guangliang Han1Peixun Liu2Hang Yang3https://orcid.org/0000-0001-6027-1337Jiajia Wu4Dongxu Liu5Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun, ChinaInfrared and visible image fusion is a hot topic due to the perfect complementarity of their information. There are two key problems in infrared and visible image fusion. One is how to extract significant target areas and rich texture details from the source images, and the other is how to integrate them to produce satisfactory fused images. To tackle these problems, we propose a novel fusion framework in this paper. A multi-level image decomposition method is used to obtain the base layer and detail layer of the source image. For the fusion of base layer, an ingenious fusion strategy guided by the saliency map of source image is designed to improve the intensity of salient targets and the visual quality of the fused image. For the fusion of detail layer, an efficient approach by introducing the enhanced gradient information is presented to boost the detail features and sharpen the edges of the fused image. Experimental results demonstrate that, compared with fifteen classical and advanced fusion methods, the proposed image fusion framework has better performance in both subjective and objective evaluation.https://ieeexplore.ieee.org/document/9502600/Image fusionbase layerdetail layersaliency mapgradient information |
| spellingShingle | Qingqing Li Guangliang Han Peixun Liu Hang Yang Jiajia Wu Dongxu Liu An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information IEEE Access Image fusion base layer detail layer saliency map gradient information |
| title | An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information |
| title_full | An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information |
| title_fullStr | An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information |
| title_full_unstemmed | An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information |
| title_short | An Infrared and Visible Image Fusion Method Guided by Saliency and Gradient Information |
| title_sort | infrared and visible image fusion method guided by saliency and gradient information |
| topic | Image fusion base layer detail layer saliency map gradient information |
| url | https://ieeexplore.ieee.org/document/9502600/ |
| work_keys_str_mv | AT qingqingli aninfraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT guanglianghan aninfraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT peixunliu aninfraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT hangyang aninfraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT jiajiawu aninfraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT dongxuliu aninfraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT qingqingli infraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT guanglianghan infraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT peixunliu infraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT hangyang infraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT jiajiawu infraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation AT dongxuliu infraredandvisibleimagefusionmethodguidedbysaliencyandgradientinformation |