Multi-Oriented and Scale-Invariant License Plate Detection Based on Convolutional Neural Networks
License plate detection (LPD) is the first and key step in license plate recognition.State-of-the-art object-detection algorithms based on deep learning provide a promising form ofLPD. However, there still exist two main challenges. First, existing methods often enclose objectswith horizontal rectan...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2019-03-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/19/5/1175 |
| _version_ | 1817990497228029952 |
|---|---|
| author | Jing Han Jian Yao Jiao Zhao Jingmin Tu Yahui Liu |
| author_facet | Jing Han Jian Yao Jiao Zhao Jingmin Tu Yahui Liu |
| author_sort | Jing Han |
| collection | DOAJ |
| description | License plate detection (LPD) is the first and key step in license plate recognition.State-of-the-art object-detection algorithms based on deep learning provide a promising form ofLPD. However, there still exist two main challenges. First, existing methods often enclose objectswith horizontal rectangles. However, horizontal rectangles are not always suitable since licenseplates in images are multi-oriented, reflected by rotation and perspective distortion. Second, thescale of license plates often varies, leading to the difficulty of multi-scale detection. To addressthe aforementioned problems, we propose a novel method of multi-oriented and scale-invariantlicense plate detection (MOSI-LPD) based on convolutional neural networks. Our MOSI-LPD tightlyencloses the multi-oriented license plates with bounding parallelograms, regardless of the licenseplate scales. To obtain bounding parallelograms, we first parameterize the edge points of licenseplates by relative positions. Next, we design mapping functions between oriented regions andhorizontal proposals. Then, we enforce the symmetry constraints in the loss function and train themodel with a multi-task loss. Finally, we map region proposals to three edge points of a nearby licenseplate, and infer the fourth point to form bounding parallelograms. To achieve scale invariance, wefirst design anchor boxes based on inherent shapes of license plates. Next, we search different layersto generate region proposals with multiple scales. Finally, we up-sample the last layer and combineproposal features extracted from different layers to recognize true license plates. Experimental resultshave demonstrated that the proposed method outperforms existing approaches in terms of detectinglicense plates with different orientations and multiple scales. |
| first_indexed | 2024-04-14T01:00:57Z |
| format | Article |
| id | doaj.art-e26bfc61b0d24e7f8f1f2bcd55e847b3 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-04-14T01:00:57Z |
| publishDate | 2019-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-e26bfc61b0d24e7f8f1f2bcd55e847b32022-12-22T02:21:26ZengMDPI AGSensors1424-82202019-03-01195117510.3390/s19051175s19051175Multi-Oriented and Scale-Invariant License Plate Detection Based on Convolutional Neural NetworksJing Han0Jian Yao1Jiao Zhao2Jingmin Tu3Yahui Liu4School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, ChinaSchool of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, ChinaSchool of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, ChinaSchool of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430070, ChinaSchool of Sociology, Wuhan University,Wuhan 430070, ChinaLicense plate detection (LPD) is the first and key step in license plate recognition.State-of-the-art object-detection algorithms based on deep learning provide a promising form ofLPD. However, there still exist two main challenges. First, existing methods often enclose objectswith horizontal rectangles. However, horizontal rectangles are not always suitable since licenseplates in images are multi-oriented, reflected by rotation and perspective distortion. Second, thescale of license plates often varies, leading to the difficulty of multi-scale detection. To addressthe aforementioned problems, we propose a novel method of multi-oriented and scale-invariantlicense plate detection (MOSI-LPD) based on convolutional neural networks. Our MOSI-LPD tightlyencloses the multi-oriented license plates with bounding parallelograms, regardless of the licenseplate scales. To obtain bounding parallelograms, we first parameterize the edge points of licenseplates by relative positions. Next, we design mapping functions between oriented regions andhorizontal proposals. Then, we enforce the symmetry constraints in the loss function and train themodel with a multi-task loss. Finally, we map region proposals to three edge points of a nearby licenseplate, and infer the fourth point to form bounding parallelograms. To achieve scale invariance, wefirst design anchor boxes based on inherent shapes of license plates. Next, we search different layersto generate region proposals with multiple scales. Finally, we up-sample the last layer and combineproposal features extracted from different layers to recognize true license plates. Experimental resultshave demonstrated that the proposed method outperforms existing approaches in terms of detectinglicense plates with different orientations and multiple scales.http://www.mdpi.com/1424-8220/19/5/1175convolutional neural networksdeep learninglicense plate detectionmulti-orientationmulti-scale detection |
| spellingShingle | Jing Han Jian Yao Jiao Zhao Jingmin Tu Yahui Liu Multi-Oriented and Scale-Invariant License Plate Detection Based on Convolutional Neural Networks Sensors convolutional neural networks deep learning license plate detection multi-orientation multi-scale detection |
| title | Multi-Oriented and Scale-Invariant License Plate
Detection Based on Convolutional Neural Networks |
| title_full | Multi-Oriented and Scale-Invariant License Plate
Detection Based on Convolutional Neural Networks |
| title_fullStr | Multi-Oriented and Scale-Invariant License Plate
Detection Based on Convolutional Neural Networks |
| title_full_unstemmed | Multi-Oriented and Scale-Invariant License Plate
Detection Based on Convolutional Neural Networks |
| title_short | Multi-Oriented and Scale-Invariant License Plate
Detection Based on Convolutional Neural Networks |
| title_sort | multi oriented and scale invariant license plate detection based on convolutional neural networks |
| topic | convolutional neural networks deep learning license plate detection multi-orientation multi-scale detection |
| url | http://www.mdpi.com/1424-8220/19/5/1175 |
| work_keys_str_mv | AT jinghan multiorientedandscaleinvariantlicenseplatedetectionbasedonconvolutionalneuralnetworks AT jianyao multiorientedandscaleinvariantlicenseplatedetectionbasedonconvolutionalneuralnetworks AT jiaozhao multiorientedandscaleinvariantlicenseplatedetectionbasedonconvolutionalneuralnetworks AT jingmintu multiorientedandscaleinvariantlicenseplatedetectionbasedonconvolutionalneuralnetworks AT yahuiliu multiorientedandscaleinvariantlicenseplatedetectionbasedonconvolutionalneuralnetworks |