Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary

Multi-focus image fusion is an important method used to combine the focused parts from source multi-focus images into a single full-focus image. Currently, to address the problem of multi-focus image fusion, the key is on how to accurately detect the focus regions, especially when the source images...

Full description

Bibliographic Details
Main Authors: Hui Wan, Xianlun Tang, Zhiqin Zhu, Weisheng Li
Format: Article
Language:English
Published: MDPI AG 2021-10-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/23/10/1362
_version_ 1797514684250718208
author Hui Wan
Xianlun Tang
Zhiqin Zhu
Weisheng Li
author_facet Hui Wan
Xianlun Tang
Zhiqin Zhu
Weisheng Li
author_sort Hui Wan
collection DOAJ
description Multi-focus image fusion is an important method used to combine the focused parts from source multi-focus images into a single full-focus image. Currently, to address the problem of multi-focus image fusion, the key is on how to accurately detect the focus regions, especially when the source images captured by cameras produce anisotropic blur and unregistration. This paper proposes a new multi-focus image fusion method based on the multi-scale decomposition of complementary information. Firstly, this method uses two groups of large-scale and small-scale decomposition schemes that are structurally complementary, to perform two-scale double-layer singular value decomposition of the image separately and obtain low-frequency and high-frequency components. Then, the low-frequency components are fused by a rule that integrates image local energy with edge energy. The high-frequency components are fused by the parameter-adaptive pulse-coupled neural network model (PA-PCNN), and according to the feature information contained in each decomposition layer of the high-frequency components, different detailed features are selected as the external stimulus input of the PA-PCNN. Finally, according to the two-scale decomposition of the source image that is structure complementary, and the fusion of high and low frequency components, two initial decision maps with complementary information are obtained. By refining the initial decision graph, the final fusion decision map is obtained to complete the image fusion. In addition, the proposed method is compared with 10 state-of-the-art approaches to verify its effectiveness. The experimental results show that the proposed method can more accurately distinguish the focused and non-focused areas in the case of image pre-registration and unregistration, and the subjective and objective evaluation indicators are slightly better than those of the existing methods.
first_indexed 2024-03-10T06:35:04Z
format Article
id doaj.art-d04e0d64a12f4b679c889df2eac824e1
institution Directory Open Access Journal
issn 1099-4300
language English
last_indexed 2024-03-10T06:35:04Z
publishDate 2021-10-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj.art-d04e0d64a12f4b679c889df2eac824e12023-11-22T18:11:54ZengMDPI AGEntropy1099-43002021-10-012310136210.3390/e23101362Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information ComplementaryHui Wan0Xianlun Tang1Zhiqin Zhu2Weisheng Li3College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaCollege of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaCollege of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaCollege of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaMulti-focus image fusion is an important method used to combine the focused parts from source multi-focus images into a single full-focus image. Currently, to address the problem of multi-focus image fusion, the key is on how to accurately detect the focus regions, especially when the source images captured by cameras produce anisotropic blur and unregistration. This paper proposes a new multi-focus image fusion method based on the multi-scale decomposition of complementary information. Firstly, this method uses two groups of large-scale and small-scale decomposition schemes that are structurally complementary, to perform two-scale double-layer singular value decomposition of the image separately and obtain low-frequency and high-frequency components. Then, the low-frequency components are fused by a rule that integrates image local energy with edge energy. The high-frequency components are fused by the parameter-adaptive pulse-coupled neural network model (PA-PCNN), and according to the feature information contained in each decomposition layer of the high-frequency components, different detailed features are selected as the external stimulus input of the PA-PCNN. Finally, according to the two-scale decomposition of the source image that is structure complementary, and the fusion of high and low frequency components, two initial decision maps with complementary information are obtained. By refining the initial decision graph, the final fusion decision map is obtained to complete the image fusion. In addition, the proposed method is compared with 10 state-of-the-art approaches to verify its effectiveness. The experimental results show that the proposed method can more accurately distinguish the focused and non-focused areas in the case of image pre-registration and unregistration, and the subjective and objective evaluation indicators are slightly better than those of the existing methods.https://www.mdpi.com/1099-4300/23/10/1362multi-focus image fusionsingular value decompositionmulti-scale decompositionPA-PCNNquaternionjoint bilateral filter
spellingShingle Hui Wan
Xianlun Tang
Zhiqin Zhu
Weisheng Li
Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary
Entropy
multi-focus image fusion
singular value decomposition
multi-scale decomposition
PA-PCNN
quaternion
joint bilateral filter
title Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary
title_full Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary
title_fullStr Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary
title_full_unstemmed Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary
title_short Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary
title_sort multi focus image fusion method based on multi scale decomposition of information complementary
topic multi-focus image fusion
singular value decomposition
multi-scale decomposition
PA-PCNN
quaternion
joint bilateral filter
url https://www.mdpi.com/1099-4300/23/10/1362
work_keys_str_mv AT huiwan multifocusimagefusionmethodbasedonmultiscaledecompositionofinformationcomplementary
AT xianluntang multifocusimagefusionmethodbasedonmultiscaledecompositionofinformationcomplementary
AT zhiqinzhu multifocusimagefusionmethodbasedonmultiscaledecompositionofinformationcomplementary
AT weishengli multifocusimagefusionmethodbasedonmultiscaledecompositionofinformationcomplementary