DPACFuse: Dual-Branch Progressive Learning for Infrared and Visible Image Fusion with Complementary Self-Attention and Convolution

DPACFuse: Dual-Branch Progressive Learning for Infrared and Visible Image Fusion with Complementary Self-Attention and Convolution

Infrared and visible image fusion aims to generate a single fused image that not only contains rich texture details and salient objects, but also facilitates downstream tasks. However, existing works mainly focus on learning different modality-specific or shared features, and ignore the importance o...

Full description

Bibliographic Details
Main Authors:	Huayi Zhu, Heshan Wu, Xiaolong Wang, Dongmei He, Zhenbing Liu, Xipeng Pan
Format:	Article
Language:	English
Published:	MDPI AG 2023-08-01
Series:	Sensors
Subjects:	multi-head self-attention convolutional neural network image fusion gradient convolution cross-modality interaction
Online Access:	https://www.mdpi.com/1424-8220/23/16/7205

Similar Items

Multi-scale attention-based lightweight network with dilated convolutions for infrared and visible image fusion
by: Fuquan Li, et al.
Published: (2023-08-01)

Infrared and Visible Image Fusion Method Using Salience Detection and Convolutional Neural Network
by: Zetian Wang, et al.
Published: (2022-07-01)

Facial Expression Recognition Using Multi-Branch Attention Convolutional Neural Network
by: Yinggang He
Published: (2023-01-01)

Self-Attention and MLP Auxiliary Convolution for Face Anti-Spoofing
by: Hanqing Gu, et al.
Published: (2023-01-01)

Ship Classification Based on Attention Mechanism and Multi-Scale Convolutional Neural Network for Visible and Infrared Images
by: Yongmei Ren, et al.
Published: (2020-11-01)

Double-Branch Network with Pyramidal Convolution and Iterative Attention for Hyperspectral Image Classification
by: Hao Shi, et al.
Published: (2021-04-01)

Multi-Head Spatiotemporal Attention Graph Convolutional Network for Traffic Prediction
by: Ariyo Oluwasanmi, et al.
Published: (2023-04-01)

Attention-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Classification with Multi-Head Attention
by: Guangtao Xu, et al.
Published: (2021-04-01)

Dual-Branch Fusion of Convolutional Neural Network and Graph Convolutional Network for PolSAR Image Classification
by: Ali Radman, et al.
Published: (2022-12-01)

Dynamic Graph Convolution Network with Multi-head Attention for Traffic Flow Prediction
by: Hanyou DENG, et al.
Published: (2024-01-01)

CR‐Net: Robot grasping detection method integrating convolutional block attention module and residual module
by: Song Yan, et al.
Published: (2024-04-01)

Affective-Knowledge-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Analysis with Multi-Head Attention
by: Xiaodong Cui, et al.
Published: (2023-03-01)

IPGM: Inertial Proximal Gradient Method for Convolutional Dictionary Learning
by: Jing Li, et al.
Published: (2021-12-01)

Integrating Parallel Attention Mechanisms and Multi-Scale Features for Infrared and Visible Image Fusion
by: Qian Xu, et al.
Published: (2024-01-01)

An Adaptive Remote Sensing Image-Matching Network Based on Cross Attention and Deformable Convolution
by: Peiyan Chen, et al.
Published: (2023-06-01)

Intelligent Complementary Multi-Modal Fusion for Anomaly Surveillance and Security System
by: Jae-hyeok Jeong, et al.
Published: (2023-11-01)

MKGCN: Multi-Modal Knowledge Graph Convolutional Network for Music Recommender Systems
by: Xiaohui Cui, et al.
Published: (2023-06-01)

Object-Aware Adaptive Convolution Kernel Attention Mechanism in Siamese Network for Visual Tracking
by: Dongliang Yuan, et al.
Published: (2022-01-01)

MFDGCN: Multi-Stage Spatio-Temporal Fusion Diffusion Graph Convolutional Network for Traffic Prediction
by: Zhengyan Cui, et al.
Published: (2022-03-01)

Remaining Useful Life Prediction of Bearings Based on Convolution Attention Mechanism and Temporal Convolution Network
by: Haitao Wang, et al.
Published: (2023-01-01)

FADNet:Greenhouse Identification With Fusion Attention Mechanism and Deformable Convolution
by: Jun Liu, et al.
Published: (2024-01-01)

Real-Time Semantics-Driven Infrared and Visible Image Fusion Network
by: Binhao Zheng, et al.
Published: (2023-07-01)

Shot Boundary Detection with 3D Depthwise Convolutions and Visual Attention
by: Miguel Jose Esteve Brotons, et al.
Published: (2023-08-01)

Research on Transportation Mode Recognition Based on Multi-Head Attention Temporal Convolutional Network
by: Shuyu Cheng, et al.
Published: (2023-03-01)

Micro-Attention Branch, a Flexible Plug-In That Enhances Existing 3D ConvNets
by: Yongsheng Li, et al.
Published: (2022-03-01)

Wind power output prediction in complex terrain based on modal decomposition attentional convolutional network
by: Yang Liu, et al.
Published: (2024-01-01)

SC-CAN: Spectral Convolution and Channel Attention Network for Wheat Stress Classification
by: Wijayanti Nurul Khotimah, et al.
Published: (2022-08-01)

Object detection using convolutional networks with adaptively adjusting receptive field of convolutional filter
by: Qishuo Lu, et al.
Published: (2019-09-01)

Remaining Useful Life Prediction of Aeroengines Based on Multi-Head Attention Mechanism
by: Lei Nie, et al.
Published: (2022-07-01)

On fine-grained visual explanation in convolutional neural networks
by: Xia Lei, et al.
Published: (2023-10-01)

SDS-Net: A lightweight 3D convolutional neural network with multi-branch attention for multimodal brain tumor accurate segmentation
by: Qian Wu, et al.
Published: (2023-09-01)

Speech Emotion Recognition Using Convolution Neural Networks and Multi-Head Convolutional Transformer
by: Rizwan Ullah, et al.
Published: (2023-07-01)

Infrared and Visible Image Fusion Based on Mask and Cross-Dynamic Fusion
by: Qiang Fu, et al.
Published: (2023-10-01)

Dual‐granularity feature fusion in visible‐infrared person re‐identification
by: Shuang Cai, et al.
Published: (2024-03-01)

Convolutional neural network optimisation to enhance ESPI fringe visibility
by: Crespo José Manuel, et al.
Published: (2023-01-01)

Feature Fusion and Center Aggregation for Visible-Infrared Person Re-Identification
by: Xianju Wang, et al.
Published: (2022-01-01)

A Dual Convolutional Neural Network with Attention Mechanism for Thermal Infrared Image Enhancement
by: Pengfei Gao, et al.
Published: (2023-10-01)

A Gradient Boosting Approach for Training Convolutional and Deep Neural Networks
by: Seyedsaman Emami, et al.
Published: (2023-01-01)

Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural Network
by: Ebtihal Al-Mansour, et al.
Published: (2023-12-01)

Multi-Branch Attention-Based Grouped Convolution Network for Human Activity Recognition Using Inertial Sensors
by: Yong Li, et al.
Published: (2022-08-01)