Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion
At present, deep residual network has been widely used in image super-resolution and proved to be able to achieve good reconstruction results. However, the existing super-resolution algorithms based on deep residual network have the problems of indiscriminately learning feature information of differ...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10147230/ |
| _version_ | 1797799313631346688 |
|---|---|
| author | Qiqi Kou Jiamin Zhao Deqiang Cheng Zhen Su Xingguang Zhu |
| author_facet | Qiqi Kou Jiamin Zhao Deqiang Cheng Zhen Su Xingguang Zhu |
| author_sort | Qiqi Kou |
| collection | DOAJ |
| description | At present, deep residual network has been widely used in image super-resolution and proved to be able to achieve good reconstruction results. However, the existing super-resolution algorithms based on deep residual network have the problems of indiscriminately learning feature information of different regions and low utilization rate of feature information, which make them difficult to further improve the reconstruction effect. In view of the above problems, a novel super-resolution reconstruction network based on residual attention and multi-scale feature fusion (RAMF) is proposed in this paper. Firstly, a lightweight multi-scale residual module (LMRM) is proposed in the deep feature extraction stage, by which the multi-scale features are extracted and further cross-connected to enrich the information of different receptive fields. Then, to fully improve the utilization rate of feature information, a dense feature fusion structure is designed to fuse the output feature of each LMRM. Finally, a residual spatial attention module (RSAM) is proposed to specifically learn and better retain high-frequency feature information, so as to improve the reconstruction effect. Experimental tests and comparisons are conducted with the current advanced methods on four baseline databases, and the results demonstrate that the proposed RAMF can achieve better reconstruction effect with fewer parameters, low computational complexity, fast processing speed and high objective evaluation index. Especially, the peak signal-to-noise ratio measured on Urban100 data set increases by 0.13dB on average, and the reconstructed image has better visual effect and richer texture detail features. |
| first_indexed | 2024-03-13T04:18:02Z |
| format | Article |
| id | doaj.art-b12bced4b1d64bb8b2094b88c7ef6e04 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T04:18:02Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-b12bced4b1d64bb8b2094b88c7ef6e042023-06-20T23:00:21ZengIEEEIEEE Access2169-35362023-01-0111595305954110.1109/ACCESS.2023.328454410147230Image Super-Resolution Based on Residual Attention and Multi-Scale Feature FusionQiqi Kou0https://orcid.org/0000-0003-2873-2636Jiamin Zhao1Deqiang Cheng2https://orcid.org/0000-0001-8831-1994Zhen Su3Xingguang Zhu4School of Computer Science and Technology, China University of Mining and Technology, Xuzhou, ChinaSchool of Information and Control Engineering, China University of Mining and Technology, Xuzhou, ChinaSchool of Information and Control Engineering, China University of Mining and Technology, Xuzhou, ChinaSchool of Information and Control Engineering, China University of Mining and Technology, Xuzhou, ChinaSchool of Information and Control Engineering, China University of Mining and Technology, Xuzhou, ChinaAt present, deep residual network has been widely used in image super-resolution and proved to be able to achieve good reconstruction results. However, the existing super-resolution algorithms based on deep residual network have the problems of indiscriminately learning feature information of different regions and low utilization rate of feature information, which make them difficult to further improve the reconstruction effect. In view of the above problems, a novel super-resolution reconstruction network based on residual attention and multi-scale feature fusion (RAMF) is proposed in this paper. Firstly, a lightweight multi-scale residual module (LMRM) is proposed in the deep feature extraction stage, by which the multi-scale features are extracted and further cross-connected to enrich the information of different receptive fields. Then, to fully improve the utilization rate of feature information, a dense feature fusion structure is designed to fuse the output feature of each LMRM. Finally, a residual spatial attention module (RSAM) is proposed to specifically learn and better retain high-frequency feature information, so as to improve the reconstruction effect. Experimental tests and comparisons are conducted with the current advanced methods on four baseline databases, and the results demonstrate that the proposed RAMF can achieve better reconstruction effect with fewer parameters, low computational complexity, fast processing speed and high objective evaluation index. Especially, the peak signal-to-noise ratio measured on Urban100 data set increases by 0.13dB on average, and the reconstructed image has better visual effect and richer texture detail features.https://ieeexplore.ieee.org/document/10147230/Dense feature fusionattention mechanismsuper-resolutionresidual learning |
| spellingShingle | Qiqi Kou Jiamin Zhao Deqiang Cheng Zhen Su Xingguang Zhu Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion IEEE Access Dense feature fusion attention mechanism super-resolution residual learning |
| title | Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion |
| title_full | Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion |
| title_fullStr | Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion |
| title_full_unstemmed | Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion |
| title_short | Image Super-Resolution Based on Residual Attention and Multi-Scale Feature Fusion |
| title_sort | image super resolution based on residual attention and multi scale feature fusion |
| topic | Dense feature fusion attention mechanism super-resolution residual learning |
| url | https://ieeexplore.ieee.org/document/10147230/ |
| work_keys_str_mv | AT qiqikou imagesuperresolutionbasedonresidualattentionandmultiscalefeaturefusion AT jiaminzhao imagesuperresolutionbasedonresidualattentionandmultiscalefeaturefusion AT deqiangcheng imagesuperresolutionbasedonresidualattentionandmultiscalefeaturefusion AT zhensu imagesuperresolutionbasedonresidualattentionandmultiscalefeaturefusion AT xingguangzhu imagesuperresolutionbasedonresidualattentionandmultiscalefeaturefusion |