SCAUIE-Net: Underwater Image Enhancement Method Based on Spatial and Channel Attention

Underwater image enhancement is a Low-Level Vision task that plays an important role in marine resource development, but the light absorption and scattering cause severe underwater image quality degradation. To solve these problems, this paper proposes a neural network based on a spatial and channel...

Full description

Bibliographic Details
Main Authors: Yuanhao Zhong, Ji Wang, Qingjie Lu
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10171360/
_version_ 1797773344715571200
author Yuanhao Zhong
Ji Wang
Qingjie Lu
author_facet Yuanhao Zhong
Ji Wang
Qingjie Lu
author_sort Yuanhao Zhong
collection DOAJ
description Underwater image enhancement is a Low-Level Vision task that plays an important role in marine resource development, but the light absorption and scattering cause severe underwater image quality degradation. To solve these problems, this paper proposes a neural network based on a spatial and channel attention module that reinforces the network’s attention to channel and spatial information. The network’s Confidence Generator can precisely extract feature maps from multi-scale underwater images. Meanwhile, we propose a new training loss function by mixing perceptual, MS-SSIM and MAE loss functions to further improve the contrast in high-frequency, colors and luminance. For training, this paper also uses a feature fusion strategy: Firstly, augmenting the training underwater images by Gamma Correction, White Balance and Histogram Equalization algorithms to remove color cast, lighten up dark regions and improve the contrast. Then, fusing the enhancing images with confidence maps predicted from the Generator. The network was validated in the UIEB dataset and obtains efficient improvements on Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) metrics, yielding a PSNR of 22.9286 and SSIM of 0.9290. Experimental results on real-world underwater images demonstrate that the proposed method performs well on different underwater scenes.
first_indexed 2024-03-12T22:04:12Z
format Article
id doaj.art-6fe7e41f312742f08c0431566667af74
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-03-12T22:04:12Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-6fe7e41f312742f08c0431566667af742023-07-24T23:00:19ZengIEEEIEEE Access2169-35362023-01-0111721727218510.1109/ACCESS.2023.329144910171360SCAUIE-Net: Underwater Image Enhancement Method Based on Spatial and Channel AttentionYuanhao Zhong0Ji Wang1Qingjie Lu2https://orcid.org/0000-0003-3988-8951School of Electronics and Information Engineering, Guangdong Ocean University, Zhanjiang, ChinaSchool of Electronics and Information Engineering, Guangdong Ocean University, Zhanjiang, ChinaSchool of Electronics and Information Engineering, Guangdong Ocean University, Zhanjiang, ChinaUnderwater image enhancement is a Low-Level Vision task that plays an important role in marine resource development, but the light absorption and scattering cause severe underwater image quality degradation. To solve these problems, this paper proposes a neural network based on a spatial and channel attention module that reinforces the network’s attention to channel and spatial information. The network’s Confidence Generator can precisely extract feature maps from multi-scale underwater images. Meanwhile, we propose a new training loss function by mixing perceptual, MS-SSIM and MAE loss functions to further improve the contrast in high-frequency, colors and luminance. For training, this paper also uses a feature fusion strategy: Firstly, augmenting the training underwater images by Gamma Correction, White Balance and Histogram Equalization algorithms to remove color cast, lighten up dark regions and improve the contrast. Then, fusing the enhancing images with confidence maps predicted from the Generator. The network was validated in the UIEB dataset and obtains efficient improvements on Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) metrics, yielding a PSNR of 22.9286 and SSIM of 0.9290. Experimental results on real-world underwater images demonstrate that the proposed method performs well on different underwater scenes.https://ieeexplore.ieee.org/document/10171360/Underwater image enhancementlow-level visionattention mechanism
spellingShingle Yuanhao Zhong
Ji Wang
Qingjie Lu
SCAUIE-Net: Underwater Image Enhancement Method Based on Spatial and Channel Attention
IEEE Access
Underwater image enhancement
low-level vision
attention mechanism
title SCAUIE-Net: Underwater Image Enhancement Method Based on Spatial and Channel Attention
title_full SCAUIE-Net: Underwater Image Enhancement Method Based on Spatial and Channel Attention
title_fullStr SCAUIE-Net: Underwater Image Enhancement Method Based on Spatial and Channel Attention
title_full_unstemmed SCAUIE-Net: Underwater Image Enhancement Method Based on Spatial and Channel Attention
title_short SCAUIE-Net: Underwater Image Enhancement Method Based on Spatial and Channel Attention
title_sort scauie net underwater image enhancement method based on spatial and channel attention
topic Underwater image enhancement
low-level vision
attention mechanism
url https://ieeexplore.ieee.org/document/10171360/
work_keys_str_mv AT yuanhaozhong scauienetunderwaterimageenhancementmethodbasedonspatialandchannelattention
AT jiwang scauienetunderwaterimageenhancementmethodbasedonspatialandchannelattention
AT qingjielu scauienetunderwaterimageenhancementmethodbasedonspatialandchannelattention