DeepInterpolation: fusion of multiple interpolations and CNN to obtain super‐resolution
The authors propose architectures that learn end‐to‐end mapping functions to improve the spatial resolution of the input natural images. The models are unique in forming non‐linear combinations of three image interpolation techniques using the convolutional neural network. Another proposed architect...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2020-12-01
|
| Series: | IET Image Processing |
| Subjects: | |
| Online Access: | https://doi.org/10.1049/iet-ipr.2019.1244 |
| _version_ | 1818517521103323136 |
|---|---|
| author | Ram Krishna Pandey Ramakrishnan Angarai Ganesan |
| author_facet | Ram Krishna Pandey Ramakrishnan Angarai Ganesan |
| author_sort | Ram Krishna Pandey |
| collection | DOAJ |
| description | The authors propose architectures that learn end‐to‐end mapping functions to improve the spatial resolution of the input natural images. The models are unique in forming non‐linear combinations of three image interpolation techniques using the convolutional neural network. Another proposed architecture uses a skip connection with nearest‐neighbour interpolation, achieving almost similar results. The architectures have been carefully designed to ensure that the reconstructed images lie precisely in the manifold of high‐resolution images, thereby preserving the high‐frequency components with fine details. They have compared with the state‐of‐the‐art and recent deep learning‐based natural image super‐resolution techniques and found that their methods can preserve the sharp details in the image, while also obtaining comparable or better peak‐signal‐to‐noise ratio values than them. Since their methods use image interpolations and a shallow convolutional neural network (CNN) with a fewer number of smaller filters, the computational cost is kept low. They have reported the results of the best two proposed architectures on five standard data sets for an upscale factor of 2. Their methods generalise well in most cases, which is evident from the better results obtained with increasingly complex data sets. For four times upscaling, they have designed similar architectures for comparing with other methods. |
| first_indexed | 2024-12-11T00:57:21Z |
| format | Article |
| id | doaj.art-ba17468126fa43709851725f9dea313b |
| institution | Directory Open Access Journal |
| issn | 1751-9659 1751-9667 |
| language | English |
| last_indexed | 2024-12-11T00:57:21Z |
| publishDate | 2020-12-01 |
| publisher | Wiley |
| record_format | Article |
| series | IET Image Processing |
| spelling | doaj.art-ba17468126fa43709851725f9dea313b2022-12-22T01:26:26ZengWileyIET Image Processing1751-96591751-96672020-12-0114154000401110.1049/iet-ipr.2019.1244DeepInterpolation: fusion of multiple interpolations and CNN to obtain super‐resolutionRam Krishna Pandey0Ramakrishnan Angarai Ganesan1Department of Electrical EngineeringIndian Institute of ScienceBangaloreIndiaDepartment of Electrical EngineeringIndian Institute of ScienceBangaloreIndiaThe authors propose architectures that learn end‐to‐end mapping functions to improve the spatial resolution of the input natural images. The models are unique in forming non‐linear combinations of three image interpolation techniques using the convolutional neural network. Another proposed architecture uses a skip connection with nearest‐neighbour interpolation, achieving almost similar results. The architectures have been carefully designed to ensure that the reconstructed images lie precisely in the manifold of high‐resolution images, thereby preserving the high‐frequency components with fine details. They have compared with the state‐of‐the‐art and recent deep learning‐based natural image super‐resolution techniques and found that their methods can preserve the sharp details in the image, while also obtaining comparable or better peak‐signal‐to‐noise ratio values than them. Since their methods use image interpolations and a shallow convolutional neural network (CNN) with a fewer number of smaller filters, the computational cost is kept low. They have reported the results of the best two proposed architectures on five standard data sets for an upscale factor of 2. Their methods generalise well in most cases, which is evident from the better results obtained with increasingly complex data sets. For four times upscaling, they have designed similar architectures for comparing with other methods.https://doi.org/10.1049/iet-ipr.2019.1244image interpolation techniquesskip connectionnearest‐neighbour interpolationreconstructed imageshigh‐resolution imageshigh‐frequency components |
| spellingShingle | Ram Krishna Pandey Ramakrishnan Angarai Ganesan DeepInterpolation: fusion of multiple interpolations and CNN to obtain super‐resolution IET Image Processing image interpolation techniques skip connection nearest‐neighbour interpolation reconstructed images high‐resolution images high‐frequency components |
| title | DeepInterpolation: fusion of multiple interpolations and CNN to obtain super‐resolution |
| title_full | DeepInterpolation: fusion of multiple interpolations and CNN to obtain super‐resolution |
| title_fullStr | DeepInterpolation: fusion of multiple interpolations and CNN to obtain super‐resolution |
| title_full_unstemmed | DeepInterpolation: fusion of multiple interpolations and CNN to obtain super‐resolution |
| title_short | DeepInterpolation: fusion of multiple interpolations and CNN to obtain super‐resolution |
| title_sort | deepinterpolation fusion of multiple interpolations and cnn to obtain super resolution |
| topic | image interpolation techniques skip connection nearest‐neighbour interpolation reconstructed images high‐resolution images high‐frequency components |
| url | https://doi.org/10.1049/iet-ipr.2019.1244 |
| work_keys_str_mv | AT ramkrishnapandey deepinterpolationfusionofmultipleinterpolationsandcnntoobtainsuperresolution AT ramakrishnanangaraiganesan deepinterpolationfusionofmultipleinterpolationsandcnntoobtainsuperresolution |