Image super-resolution using artificial intelligence
Cameras have undoubtedly grown more advanced but there are still some scenarios where the perceptual quality and resolution of the captured image is less than ideal. That is where super- resolution comes into play, which is the process of upscaling the resolution and improving the quality of an imag...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/157462 |
| _version_ | 1826121859598385152 |
|---|---|
| author | Sendjaja, Dewi |
| author2 | Yap Kim Hui |
| author_facet | Yap Kim Hui Sendjaja, Dewi |
| author_sort | Sendjaja, Dewi |
| collection | NTU |
| description | Cameras have undoubtedly grown more advanced but there are still some scenarios where the perceptual quality and resolution of the captured image is less than ideal. That is where super- resolution comes into play, which is the process of upscaling the resolution and improving the quality of an image. While traditional methods of super-resolution such as bicubic and bilinear interpolation exist, the field has gotten much more advanced with the help of deep learning. This project aims to explore deep learning super-resolution models and adapt them to a surveillance camera setting, which can be used in workspaces and even street views to observe blurry details.
Initially, various state-of-the-art models were reviewed in order to determine the base model used for training. To better suit the application of surveillance super-resolution, a dataset was built using a combination of street scenes, factory CCTV footage as well as self-recorded footage using a CCTV camera. After training and extensive experiments using these datasets, a PSNR result of around 23-25dB is obtained using ESRGAN and SWINIR, with its SSIM ranging around 0.7.
To improve the resulting image, post-processing in the form of applying bilateral filters was done. Efforts were also made to try and improve the model’s performance by tweaking the validation metrics and loss function of the model so as to include additional perceptual loss during training. Overall, although perfect restoration is not achieved, the resulting image still has promising quality and its visual pleasantness is vastly improved. |
| first_indexed | 2024-10-01T05:39:03Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/157462 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T05:39:03Z |
| publishDate | 2022 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1574622023-07-07T19:20:56Z Image super-resolution using artificial intelligence Sendjaja, Dewi Yap Kim Hui School of Electrical and Electronic Engineering EKHYap@ntu.edu.sg Engineering::Electrical and electronic engineering Cameras have undoubtedly grown more advanced but there are still some scenarios where the perceptual quality and resolution of the captured image is less than ideal. That is where super- resolution comes into play, which is the process of upscaling the resolution and improving the quality of an image. While traditional methods of super-resolution such as bicubic and bilinear interpolation exist, the field has gotten much more advanced with the help of deep learning. This project aims to explore deep learning super-resolution models and adapt them to a surveillance camera setting, which can be used in workspaces and even street views to observe blurry details. Initially, various state-of-the-art models were reviewed in order to determine the base model used for training. To better suit the application of surveillance super-resolution, a dataset was built using a combination of street scenes, factory CCTV footage as well as self-recorded footage using a CCTV camera. After training and extensive experiments using these datasets, a PSNR result of around 23-25dB is obtained using ESRGAN and SWINIR, with its SSIM ranging around 0.7. To improve the resulting image, post-processing in the form of applying bilateral filters was done. Efforts were also made to try and improve the model’s performance by tweaking the validation metrics and loss function of the model so as to include additional perceptual loss during training. Overall, although perfect restoration is not achieved, the resulting image still has promising quality and its visual pleasantness is vastly improved. Bachelor of Engineering (Electrical and Electronic Engineering) 2022-05-17T13:17:17Z 2022-05-17T13:17:17Z 2022 Final Year Project (FYP) Sendjaja, D. (2022). Image super-resolution using artificial intelligence. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/157462 https://hdl.handle.net/10356/157462 en A3295-211 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Electrical and electronic engineering Sendjaja, Dewi Image super-resolution using artificial intelligence |
| title | Image super-resolution using artificial intelligence |
| title_full | Image super-resolution using artificial intelligence |
| title_fullStr | Image super-resolution using artificial intelligence |
| title_full_unstemmed | Image super-resolution using artificial intelligence |
| title_short | Image super-resolution using artificial intelligence |
| title_sort | image super resolution using artificial intelligence |
| topic | Engineering::Electrical and electronic engineering |
| url | https://hdl.handle.net/10356/157462 |
| work_keys_str_mv | AT sendjajadewi imagesuperresolutionusingartificialintelligence |