Intelligent Image Super-Resolution for Vehicle License Plate in Surveillance Applications

Vehicle license plate images are often low resolution and blurry because of the large distance and relative motion between the vision sensor and vehicle, making license plate identification arduous. The extensive use of expensive, high-quality vision sensors is uneconomical in most cases; thus, imag...

Full description

Bibliographic Details
Main Authors: Mohammad Hijji, Abbas Khan, Mohammed M. Alwakeel, Rafika Harrabi, Fahad Aradah, Faouzi Alaya Cheikh, Muhammad Sajjad, Khan Muhammad
Format: Article
Language:English
Published: MDPI AG 2023-02-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/11/4/892
_version_ 1827756682712711168
author Mohammad Hijji
Abbas Khan
Mohammed M. Alwakeel
Rafika Harrabi
Fahad Aradah
Faouzi Alaya Cheikh
Muhammad Sajjad
Khan Muhammad
author_facet Mohammad Hijji
Abbas Khan
Mohammed M. Alwakeel
Rafika Harrabi
Fahad Aradah
Faouzi Alaya Cheikh
Muhammad Sajjad
Khan Muhammad
author_sort Mohammad Hijji
collection DOAJ
description Vehicle license plate images are often low resolution and blurry because of the large distance and relative motion between the vision sensor and vehicle, making license plate identification arduous. The extensive use of expensive, high-quality vision sensors is uneconomical in most cases; thus, images are initially captured and then translated from low resolution to high resolution. For this purpose, several traditional techniques such as bilinear, bicubic, super-resolution convolutional neural network, and super-resolution generative adversarial network (SRGAN) have been developed over time to upgrade low-quality images. However, most studies in this area pertain to the conversion of low-resolution images to super-resolution images, and little attention has been paid to motion de-blurring. This work extends SRGAN by adding an intelligent motion-deblurring method (termed SRGAN-LP), which helps to enhance the image resolution and remove motion blur from the given images. A comprehensive and new domain-specific dataset was developed to achieve improved results. Moreover, maintaining higher quantitative and qualitative results in comparison to the ground truth images, this study upscales the provided low-resolution image four times and removes the motion blur to a reasonable extent, making it suitable for surveillance applications.
first_indexed 2024-03-11T08:28:56Z
format Article
id doaj.art-fe2b9df07e8c4235a10a52a62e0cfa03
institution Directory Open Access Journal
issn 2227-7390
language English
last_indexed 2024-03-11T08:28:56Z
publishDate 2023-02-01
publisher MDPI AG
record_format Article
series Mathematics
spelling doaj.art-fe2b9df07e8c4235a10a52a62e0cfa032023-11-16T21:55:28ZengMDPI AGMathematics2227-73902023-02-0111489210.3390/math11040892Intelligent Image Super-Resolution for Vehicle License Plate in Surveillance ApplicationsMohammad Hijji0Abbas Khan1Mohammed M. Alwakeel2Rafika Harrabi3Fahad Aradah4Faouzi Alaya Cheikh5Muhammad Sajjad6Khan Muhammad7Faculty of Computers and Information Technology, University of Tabuk, Tabuk 47711, Saudi ArabiaDigital Image Processing Laboratory, Department of Computer Science, Islamia College Peshawar, Peshawar 25000, PakistanFaculty of Computers and Information Technology, University of Tabuk, Tabuk 47711, Saudi ArabiaFaculty of Computers and Information Technology, University of Tabuk, Tabuk 47711, Saudi ArabiaFaculty of Computers and Information Technology, University of Tabuk, Tabuk 47711, Saudi ArabiaThe Software, Data and Digital Ecosystems (SDDE) Research Group, Department of Computer Science, Norwegian University of Science and Technology (NTNU), 2815 Gjøvik, NorwayDigital Image Processing Laboratory, Department of Computer Science, Islamia College Peshawar, Peshawar 25000, PakistanVisual Analytics for Knowledge Laboratory (VIS2KNOW Lab), Department of Applied Artificial Intelligence, School of Convergence, College of Computing and Informatics, Sungkyunkwan University, Seoul 03063, Republic of KoreaVehicle license plate images are often low resolution and blurry because of the large distance and relative motion between the vision sensor and vehicle, making license plate identification arduous. The extensive use of expensive, high-quality vision sensors is uneconomical in most cases; thus, images are initially captured and then translated from low resolution to high resolution. For this purpose, several traditional techniques such as bilinear, bicubic, super-resolution convolutional neural network, and super-resolution generative adversarial network (SRGAN) have been developed over time to upgrade low-quality images. However, most studies in this area pertain to the conversion of low-resolution images to super-resolution images, and little attention has been paid to motion de-blurring. This work extends SRGAN by adding an intelligent motion-deblurring method (termed SRGAN-LP), which helps to enhance the image resolution and remove motion blur from the given images. A comprehensive and new domain-specific dataset was developed to achieve improved results. Moreover, maintaining higher quantitative and qualitative results in comparison to the ground truth images, this study upscales the provided low-resolution image four times and removes the motion blur to a reasonable extent, making it suitable for surveillance applications.https://www.mdpi.com/2227-7390/11/4/892AISRGANimage super-resolutiongeneratordiscriminatorgenerative adversarial networks
spellingShingle Mohammad Hijji
Abbas Khan
Mohammed M. Alwakeel
Rafika Harrabi
Fahad Aradah
Faouzi Alaya Cheikh
Muhammad Sajjad
Khan Muhammad
Intelligent Image Super-Resolution for Vehicle License Plate in Surveillance Applications
Mathematics
AI
SRGAN
image super-resolution
generator
discriminator
generative adversarial networks
title Intelligent Image Super-Resolution for Vehicle License Plate in Surveillance Applications
title_full Intelligent Image Super-Resolution for Vehicle License Plate in Surveillance Applications
title_fullStr Intelligent Image Super-Resolution for Vehicle License Plate in Surveillance Applications
title_full_unstemmed Intelligent Image Super-Resolution for Vehicle License Plate in Surveillance Applications
title_short Intelligent Image Super-Resolution for Vehicle License Plate in Surveillance Applications
title_sort intelligent image super resolution for vehicle license plate in surveillance applications
topic AI
SRGAN
image super-resolution
generator
discriminator
generative adversarial networks
url https://www.mdpi.com/2227-7390/11/4/892
work_keys_str_mv AT mohammadhijji intelligentimagesuperresolutionforvehiclelicenseplateinsurveillanceapplications
AT abbaskhan intelligentimagesuperresolutionforvehiclelicenseplateinsurveillanceapplications
AT mohammedmalwakeel intelligentimagesuperresolutionforvehiclelicenseplateinsurveillanceapplications
AT rafikaharrabi intelligentimagesuperresolutionforvehiclelicenseplateinsurveillanceapplications
AT fahadaradah intelligentimagesuperresolutionforvehiclelicenseplateinsurveillanceapplications
AT faouzialayacheikh intelligentimagesuperresolutionforvehiclelicenseplateinsurveillanceapplications
AT muhammadsajjad intelligentimagesuperresolutionforvehiclelicenseplateinsurveillanceapplications
AT khanmuhammad intelligentimagesuperresolutionforvehiclelicenseplateinsurveillanceapplications