Algorithms for multi-frame image super-resolution under applicative noise based on deep neural networks
The article describes algorithms for multi-frame image super-resolution, which recover high-resolution images from a sequence of low-resolution images of the same scene under applicative noise. Applicative noise generates local regions of outlying observations in each image and reduces the image res...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Samara National Research University
2022-02-01
|
| Series: | Компьютерная оптика |
| Subjects: | |
| Online Access: | https://computeroptics.ru/eng/KO/Annot/KO46-1/460116e.html |
| _version_ | 1827986597801361408 |
|---|---|
| author | S.V. Savvin A.A. Sirota |
| author_facet | S.V. Savvin A.A. Sirota |
| author_sort | S.V. Savvin |
| collection | DOAJ |
| description | The article describes algorithms for multi-frame image super-resolution, which recover high-resolution images from a sequence of low-resolution images of the same scene under applicative noise. Applicative noise generates local regions of outlying observations in each image and reduces the image resolution. So far, little attention has been paid to this problem. At the same time, the use of deep neural networks is considered to be a promising method of image processing, including multi-frame image super-resolution. The article considers the existing solutions to the problem and suggests a new approach based on using several pre-trained convolutional neural networks and directed acyclic graph neural networks trained by the authors. The developed approach and the algorithms based on this approach involve iterative processing of the input sequence of low-resolution images using different neural networks at different processing stages. The stages include registration of low-resolution images, their segmentation performed in order to determine regions damaged by applicative noise, and transformation performed in order to increase the resolution. The approach combines the strengths of the existing solutions while lacking their drawbacks resulting from the use of approximate mathematical data models required for the synthesis of the image processing algorithms within the statistical theory of solutions. The experimental studies demonstrated that the suggested algorithm is fully functional and allows more accurate recovery of high-resolution images than the existing analogues. |
| first_indexed | 2024-04-09T23:33:54Z |
| format | Article |
| id | doaj.art-4d9ac0371f4c48489066ea2fab8f3c08 |
| institution | Directory Open Access Journal |
| issn | 0134-2452 2412-6179 |
| language | English |
| last_indexed | 2024-04-09T23:33:54Z |
| publishDate | 2022-02-01 |
| publisher | Samara National Research University |
| record_format | Article |
| series | Компьютерная оптика |
| spelling | doaj.art-4d9ac0371f4c48489066ea2fab8f3c082023-03-20T15:31:20ZengSamara National Research UniversityКомпьютерная оптика0134-24522412-61792022-02-0146113013810.18287/2412-6179-CO-904Algorithms for multi-frame image super-resolution under applicative noise based on deep neural networksS.V. Savvin0A.A. Sirota1Voronezh State UniversityVoronezh State UniversityThe article describes algorithms for multi-frame image super-resolution, which recover high-resolution images from a sequence of low-resolution images of the same scene under applicative noise. Applicative noise generates local regions of outlying observations in each image and reduces the image resolution. So far, little attention has been paid to this problem. At the same time, the use of deep neural networks is considered to be a promising method of image processing, including multi-frame image super-resolution. The article considers the existing solutions to the problem and suggests a new approach based on using several pre-trained convolutional neural networks and directed acyclic graph neural networks trained by the authors. The developed approach and the algorithms based on this approach involve iterative processing of the input sequence of low-resolution images using different neural networks at different processing stages. The stages include registration of low-resolution images, their segmentation performed in order to determine regions damaged by applicative noise, and transformation performed in order to increase the resolution. The approach combines the strengths of the existing solutions while lacking their drawbacks resulting from the use of approximate mathematical data models required for the synthesis of the image processing algorithms within the statistical theory of solutions. The experimental studies demonstrated that the suggested algorithm is fully functional and allows more accurate recovery of high-resolution images than the existing analogues.https://computeroptics.ru/eng/KO/Annot/KO46-1/460116e.htmldigital image processingmulti-frame superresolutionconvolutional neural networksdeep learningapplicative noise |
| spellingShingle | S.V. Savvin A.A. Sirota Algorithms for multi-frame image super-resolution under applicative noise based on deep neural networks Компьютерная оптика digital image processing multi-frame superresolution convolutional neural networks deep learning applicative noise |
| title | Algorithms for multi-frame image super-resolution under applicative noise based on deep neural networks |
| title_full | Algorithms for multi-frame image super-resolution under applicative noise based on deep neural networks |
| title_fullStr | Algorithms for multi-frame image super-resolution under applicative noise based on deep neural networks |
| title_full_unstemmed | Algorithms for multi-frame image super-resolution under applicative noise based on deep neural networks |
| title_short | Algorithms for multi-frame image super-resolution under applicative noise based on deep neural networks |
| title_sort | algorithms for multi frame image super resolution under applicative noise based on deep neural networks |
| topic | digital image processing multi-frame superresolution convolutional neural networks deep learning applicative noise |
| url | https://computeroptics.ru/eng/KO/Annot/KO46-1/460116e.html |
| work_keys_str_mv | AT svsavvin algorithmsformultiframeimagesuperresolutionunderapplicativenoisebasedondeepneuralnetworks AT aasirota algorithmsformultiframeimagesuperresolutionunderapplicativenoisebasedondeepneuralnetworks |