Speedy and accurate image super‐resolution via deeply recursive CNN with skip connection and network in network

The single image super‐resolution (SISR) methods based on the deep convolutional neural network (CNN) have recently achieved significant improvements in accuracy, advancing the state of the art. However, these deeper models are computationally expensive and require a large number of parameters. Acco...

Full description

Bibliographic Details
Main Authors: Dan Guo, Yanxiong Niu, Pengyan Xie
Format: Article
Language:English
Published: Wiley 2019-05-01
Series:IET Image Processing
Subjects:
Online Access:https://doi.org/10.1049/iet-ipr.2018.5907
_version_ 1818114857696755712
author Dan Guo
Yanxiong Niu
Pengyan Xie
author_facet Dan Guo
Yanxiong Niu
Pengyan Xie
author_sort Dan Guo
collection DOAJ
description The single image super‐resolution (SISR) methods based on the deep convolutional neural network (CNN) have recently achieved significant improvements in accuracy, advancing the state of the art. However, these deeper models are computationally expensive and require a large number of parameters. Accordingly, they demand more memory and are unsuitable for on‐chip devices. In this study, a novel SISR method using a deeply recursive CNN with skip connections and a network in network structure is proposed. The deeply recursive CNN with skip connections is adopted for the image feature extraction at both local and global levels. Parallelised 1 × 1 CNNs, usually called a network in network structure, are adopted for image reconstruction. Specifically, recursive learning is utilised to control the number of model parameters needed and residual learning is used to ease the difficulty of training. The proposed method performs favourably against the state‐of‐the‐art methods in terms of computational speed and accuracy. It significantly outperforms the previous methods by a large margin, while demanding far fewer parameters. This model requires less memory and is friendly to on‐chip devices.
first_indexed 2024-12-11T03:57:24Z
format Article
id doaj.art-33c1970e28754b52bb22792ed8a3a143
institution Directory Open Access Journal
issn 1751-9659
1751-9667
language English
last_indexed 2024-12-11T03:57:24Z
publishDate 2019-05-01
publisher Wiley
record_format Article
series IET Image Processing
spelling doaj.art-33c1970e28754b52bb22792ed8a3a1432022-12-22T01:21:45ZengWileyIET Image Processing1751-96591751-96672019-05-011371201120910.1049/iet-ipr.2018.5907Speedy and accurate image super‐resolution via deeply recursive CNN with skip connection and network in networkDan Guo0Yanxiong Niu1Pengyan Xie2School of Instrumentation and OptoelectronicEngineering, Beihang UniversityBeijing100191People's Republic of ChinaSchool of Instrumentation and OptoelectronicEngineering, Beihang UniversityBeijing100191People's Republic of ChinaSchool of Instrumentation and OptoelectronicEngineering, Beihang UniversityBeijing100191People's Republic of ChinaThe single image super‐resolution (SISR) methods based on the deep convolutional neural network (CNN) have recently achieved significant improvements in accuracy, advancing the state of the art. However, these deeper models are computationally expensive and require a large number of parameters. Accordingly, they demand more memory and are unsuitable for on‐chip devices. In this study, a novel SISR method using a deeply recursive CNN with skip connections and a network in network structure is proposed. The deeply recursive CNN with skip connections is adopted for the image feature extraction at both local and global levels. Parallelised 1 × 1 CNNs, usually called a network in network structure, are adopted for image reconstruction. Specifically, recursive learning is utilised to control the number of model parameters needed and residual learning is used to ease the difficulty of training. The proposed method performs favourably against the state‐of‐the‐art methods in terms of computational speed and accuracy. It significantly outperforms the previous methods by a large margin, while demanding far fewer parameters. This model requires less memory and is friendly to on‐chip devices.https://doi.org/10.1049/iet-ipr.2018.5907accurate image super‐resolutiondeeply recursive CNNskip connectionsingle image super‐resolution methodsdeep convolutional neural networkon‐chip devices
spellingShingle Dan Guo
Yanxiong Niu
Pengyan Xie
Speedy and accurate image super‐resolution via deeply recursive CNN with skip connection and network in network
IET Image Processing
accurate image super‐resolution
deeply recursive CNN
skip connection
single image super‐resolution methods
deep convolutional neural network
on‐chip devices
title Speedy and accurate image super‐resolution via deeply recursive CNN with skip connection and network in network
title_full Speedy and accurate image super‐resolution via deeply recursive CNN with skip connection and network in network
title_fullStr Speedy and accurate image super‐resolution via deeply recursive CNN with skip connection and network in network
title_full_unstemmed Speedy and accurate image super‐resolution via deeply recursive CNN with skip connection and network in network
title_short Speedy and accurate image super‐resolution via deeply recursive CNN with skip connection and network in network
title_sort speedy and accurate image super resolution via deeply recursive cnn with skip connection and network in network
topic accurate image super‐resolution
deeply recursive CNN
skip connection
single image super‐resolution methods
deep convolutional neural network
on‐chip devices
url https://doi.org/10.1049/iet-ipr.2018.5907
work_keys_str_mv AT danguo speedyandaccurateimagesuperresolutionviadeeplyrecursivecnnwithskipconnectionandnetworkinnetwork
AT yanxiongniu speedyandaccurateimagesuperresolutionviadeeplyrecursivecnnwithskipconnectionandnetworkinnetwork
AT pengyanxie speedyandaccurateimagesuperresolutionviadeeplyrecursivecnnwithskipconnectionandnetworkinnetwork