EAAU-Net: Enhanced Asymmetric Attention U-Net for Infrared Small Target Detection

Detecting infrared small targets lacking texture and shape information in cluttered environments is extremely challenging. With the development of deep learning, convolutional neural network (CNN)-based methods have achieved promising results in generic object detection. However, existing CNN-based...

Full description

Bibliographic Details
Main Authors: Xiaozhong Tong, Bei Sun, Junyu Wei, Zhen Zuo, Shaojing Su
Format: Article
Language:English
Published: MDPI AG 2021-08-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/13/16/3200
_version_ 1797522149637881856
author Xiaozhong Tong
Bei Sun
Junyu Wei
Zhen Zuo
Shaojing Su
author_facet Xiaozhong Tong
Bei Sun
Junyu Wei
Zhen Zuo
Shaojing Su
author_sort Xiaozhong Tong
collection DOAJ
description Detecting infrared small targets lacking texture and shape information in cluttered environments is extremely challenging. With the development of deep learning, convolutional neural network (CNN)-based methods have achieved promising results in generic object detection. However, existing CNN-based methods with pooling layers may lose the targets in the deep layers and, thus, cannot be directly applied for infrared small target detection. To overcome this problem, we propose an enhanced asymmetric attention (EAA) U-Net. Specifically, we present an efficient and powerful EAA module that uses both same-layer feature information exchange and cross-layer feature fusion to improve feature representation. In the proposed approach, spatial and channel information exchanges occur between the same layers to reinforce the primitive features of small targets, and a bottom-up global attention module focuses on cross-layer feature fusion to enable the dynamic weighted modulation of high-level features under the guidance of low-level features. The results of detailed ablation studies empirically validate the effectiveness of each component in the network architecture. Compared to state-of-the-art methods, the proposed method achieved superior performance, with an intersection-over-union (IoU) of 0.771, normalised IoU (nIoU) of 0.746, and F-area of 0.681 on the publicly available SIRST dataset.
first_indexed 2024-03-10T08:25:22Z
format Article
id doaj.art-63d1ab5a9fb74d7c90d87e8b82e9304d
institution Directory Open Access Journal
issn 2072-4292
language English
last_indexed 2024-03-10T08:25:22Z
publishDate 2021-08-01
publisher MDPI AG
record_format Article
series Remote Sensing
spelling doaj.art-63d1ab5a9fb74d7c90d87e8b82e9304d2023-11-22T09:33:42ZengMDPI AGRemote Sensing2072-42922021-08-011316320010.3390/rs13163200EAAU-Net: Enhanced Asymmetric Attention U-Net for Infrared Small Target DetectionXiaozhong Tong0Bei Sun1Junyu Wei2Zhen Zuo3Shaojing Su4College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, ChinaDetecting infrared small targets lacking texture and shape information in cluttered environments is extremely challenging. With the development of deep learning, convolutional neural network (CNN)-based methods have achieved promising results in generic object detection. However, existing CNN-based methods with pooling layers may lose the targets in the deep layers and, thus, cannot be directly applied for infrared small target detection. To overcome this problem, we propose an enhanced asymmetric attention (EAA) U-Net. Specifically, we present an efficient and powerful EAA module that uses both same-layer feature information exchange and cross-layer feature fusion to improve feature representation. In the proposed approach, spatial and channel information exchanges occur between the same layers to reinforce the primitive features of small targets, and a bottom-up global attention module focuses on cross-layer feature fusion to enable the dynamic weighted modulation of high-level features under the guidance of low-level features. The results of detailed ablation studies empirically validate the effectiveness of each component in the network architecture. Compared to state-of-the-art methods, the proposed method achieved superior performance, with an intersection-over-union (IoU) of 0.771, normalised IoU (nIoU) of 0.746, and F-area of 0.681 on the publicly available SIRST dataset.https://www.mdpi.com/2072-4292/13/16/3200infrared small target detectionenhanced asymmetric attention mechanismfeature fusionU-Net
spellingShingle Xiaozhong Tong
Bei Sun
Junyu Wei
Zhen Zuo
Shaojing Su
EAAU-Net: Enhanced Asymmetric Attention U-Net for Infrared Small Target Detection
Remote Sensing
infrared small target detection
enhanced asymmetric attention mechanism
feature fusion
U-Net
title EAAU-Net: Enhanced Asymmetric Attention U-Net for Infrared Small Target Detection
title_full EAAU-Net: Enhanced Asymmetric Attention U-Net for Infrared Small Target Detection
title_fullStr EAAU-Net: Enhanced Asymmetric Attention U-Net for Infrared Small Target Detection
title_full_unstemmed EAAU-Net: Enhanced Asymmetric Attention U-Net for Infrared Small Target Detection
title_short EAAU-Net: Enhanced Asymmetric Attention U-Net for Infrared Small Target Detection
title_sort eaau net enhanced asymmetric attention u net for infrared small target detection
topic infrared small target detection
enhanced asymmetric attention mechanism
feature fusion
U-Net
url https://www.mdpi.com/2072-4292/13/16/3200
work_keys_str_mv AT xiaozhongtong eaaunetenhancedasymmetricattentionunetforinfraredsmalltargetdetection
AT beisun eaaunetenhancedasymmetricattentionunetforinfraredsmalltargetdetection
AT junyuwei eaaunetenhancedasymmetricattentionunetforinfraredsmalltargetdetection
AT zhenzuo eaaunetenhancedasymmetricattentionunetforinfraredsmalltargetdetection
AT shaojingsu eaaunetenhancedasymmetricattentionunetforinfraredsmalltargetdetection