An Efficient License Plate Detection Approach With Deep Convolutional Neural Networks in Unconstrained Scenarios
License plate (LP) detection is a crucial task for Automatic License Plate Recognition (ALPR) systems. Most existing LP detection networks can detect License plates, but their accuracy suffers when license plates (LPs) are tilted or deformed due to perspective distortion. This is because these detec...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10201873/ |
| _version_ | 1797741582773911552 |
|---|---|
| author | Wei Jia Mingshan Xie |
| author_facet | Wei Jia Mingshan Xie |
| author_sort | Wei Jia |
| collection | DOAJ |
| description | License plate (LP) detection is a crucial task for Automatic License Plate Recognition (ALPR) systems. Most existing LP detection networks can detect License plates, but their accuracy suffers when license plates (LPs) are tilted or deformed due to perspective distortion. This is because these detectors can only detect the region where the LP is located, and even the most advanced object detectors struggle in unconstrained scenarios. To address this problem, we propose a lightweight Deformation Planar Object Detection Network (DPOD-NET), which can correct the deformed LPs of various vehicles (e.g., car, truck, electric motorcycle, bus) by detecting the LP corner points. Accordingly, the distortion associated with perspective is mitigated when we adjust the LP to a frontal parallel view through the LP corners. To optimize small errors between the predicted and true values of the LP corner points, we propose an LPWing loss function. Compared with the commonly used L1 function, the LPWing loss is derivable at the zero position, and the gradient will be bigger when errors are smaller. This enables the model to converge faster at the position where the error is close to zero, resulting in better convergence when the error between the true values and predicted values is small. In addition, the paper presents a stochastic multi-scale image detail boosting strategy, which effectively augments the dataset. Finally, to objectively evaluate the effectiveness of LP corner detection approaches, we present a dataset (LPDE-4K) including various LP types (e.g., color, country, illumination, distortion). We test the performance on various datasets, and our approach outperforms other existing state-of-the-art approaches in terms of higher accuracy and lower computational cost. |
| first_indexed | 2024-03-12T14:28:47Z |
| format | Article |
| id | doaj.art-dcea1940169a47a6978e9b0ad0312f93 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-12T14:28:47Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-dcea1940169a47a6978e9b0ad0312f932023-08-17T23:00:33ZengIEEEIEEE Access2169-35362023-01-0111856268563910.1109/ACCESS.2023.330112210201873An Efficient License Plate Detection Approach With Deep Convolutional Neural Networks in Unconstrained ScenariosWei Jia0https://orcid.org/0000-0003-3781-6428Mingshan Xie1https://orcid.org/0000-0002-6387-785XCollege of Big Data and Information Engineering, Guizhou University (GZU), Guiyang, ChinaCollege of Big Data and Information Engineering, Guizhou University (GZU), Guiyang, ChinaLicense plate (LP) detection is a crucial task for Automatic License Plate Recognition (ALPR) systems. Most existing LP detection networks can detect License plates, but their accuracy suffers when license plates (LPs) are tilted or deformed due to perspective distortion. This is because these detectors can only detect the region where the LP is located, and even the most advanced object detectors struggle in unconstrained scenarios. To address this problem, we propose a lightweight Deformation Planar Object Detection Network (DPOD-NET), which can correct the deformed LPs of various vehicles (e.g., car, truck, electric motorcycle, bus) by detecting the LP corner points. Accordingly, the distortion associated with perspective is mitigated when we adjust the LP to a frontal parallel view through the LP corners. To optimize small errors between the predicted and true values of the LP corner points, we propose an LPWing loss function. Compared with the commonly used L1 function, the LPWing loss is derivable at the zero position, and the gradient will be bigger when errors are smaller. This enables the model to converge faster at the position where the error is close to zero, resulting in better convergence when the error between the true values and predicted values is small. In addition, the paper presents a stochastic multi-scale image detail boosting strategy, which effectively augments the dataset. Finally, to objectively evaluate the effectiveness of LP corner detection approaches, we present a dataset (LPDE-4K) including various LP types (e.g., color, country, illumination, distortion). We test the performance on various datasets, and our approach outperforms other existing state-of-the-art approaches in terms of higher accuracy and lower computational cost.https://ieeexplore.ieee.org/document/10201873/License plate (LP) detectionconvolutional neural networksunconstrained scenarios |
| spellingShingle | Wei Jia Mingshan Xie An Efficient License Plate Detection Approach With Deep Convolutional Neural Networks in Unconstrained Scenarios IEEE Access License plate (LP) detection convolutional neural networks unconstrained scenarios |
| title | An Efficient License Plate Detection Approach With Deep Convolutional Neural Networks in Unconstrained Scenarios |
| title_full | An Efficient License Plate Detection Approach With Deep Convolutional Neural Networks in Unconstrained Scenarios |
| title_fullStr | An Efficient License Plate Detection Approach With Deep Convolutional Neural Networks in Unconstrained Scenarios |
| title_full_unstemmed | An Efficient License Plate Detection Approach With Deep Convolutional Neural Networks in Unconstrained Scenarios |
| title_short | An Efficient License Plate Detection Approach With Deep Convolutional Neural Networks in Unconstrained Scenarios |
| title_sort | efficient license plate detection approach with deep convolutional neural networks in unconstrained scenarios |
| topic | License plate (LP) detection convolutional neural networks unconstrained scenarios |
| url | https://ieeexplore.ieee.org/document/10201873/ |
| work_keys_str_mv | AT weijia anefficientlicenseplatedetectionapproachwithdeepconvolutionalneuralnetworksinunconstrainedscenarios AT mingshanxie anefficientlicenseplatedetectionapproachwithdeepconvolutionalneuralnetworksinunconstrainedscenarios AT weijia efficientlicenseplatedetectionapproachwithdeepconvolutionalneuralnetworksinunconstrainedscenarios AT mingshanxie efficientlicenseplatedetectionapproachwithdeepconvolutionalneuralnetworksinunconstrainedscenarios |