Login Register Cart 0
Generic placeholder image

Recent Advances in Electrical & Electronic Engineering

Editor-in-Chief

ISSN (Print): 2352-0965
ISSN (Online): 2352-0973

Back
Journal Home About Journal Editorial Board Journal Insight Current Issue Volumes/Issues
Subscribe
Research Article

Real-Time Location, Correction and Segmentation Algorithm based on Tilted License Plate

Author(s): Zhiyong Gao* and Jianhong Xiang

Volume 16, Issue 4, 2023

Published on: 23 December, 2022

Page: [395 - 406] Pages: 12

DOI: 10.2174/2352096516666221129093434

Price: $65

conference banner
Abstract

Background: Vehicles have become one of the most important means of transportation, and license plate is the only identifying mark of vehicles. License plate recognition technologies are being applied to a series of occasions, such as supervising road traffic violations, recovering stolen vehicles, monitoring wanted vehicles, and dispatching special vehicles. The license plate tilt phenomenon caused by various reasons has brought great trouble to its own recognition.

Objective: How to identify tilted license plates efficiently and accurately becomes the key to the automatic management of a large number of vehicles. Therefore, a real-time location, correction and segmentation algorithm based on the tilted license plate is proposed in this paper.

Methods: Firstly, an end-to-end deep convolutional neural network (CNN) is proposed for the location detection of the tilted license plate. The developed CNN is optimized by the most advanced RefineDet algorithm. By improving the object detection module, the representation ability of the CNN for small features and the accuracy of the detector are improved, so as to make the location regression and label prediction of the detected object more accurate. Secondly, the optimized perspective transformation algorithm is applied to correct the tilted license plate. According to the vertices coordinates of the bounding box detected by our CNN, the license plate area cropped out from the original image has a certain tilt angle, and the perspective transformation algorithm achieves the correction. Finally, digital image processing technology is used to segment the characters of license plates.

Results: The experimental results in the Chinese City Parking (CCP) dataset show that the proposed algorithm exhibits location average precisions improvements of 2.4-5.4% over the other algorithm.

Conclusion: The proposed algorithm achieves high-accuracy correction and real-time segmentation.

« Previous Next »
Graphical Abstract

[1]
W. Weihong, and T. Jiaoyang, "Research on license plate recognition algorithms based on deep learning in complex environment", IEEE Access, vol. 8, pp. 91661-91675, 2020.
[http://dx.doi.org/10.1109/ACCESS.2020.2994287]
[2]
Y. Chen, and X. Ding, "The method of car license localization and character division in complex vehicles image", Hongwai Yu Jiguang Gongcheng, vol. 33, no. 1, pp. 29-33, 2004.
[3]
D. Yang, H. Zhou, L. Tang, S. Chen, and S. Liu, "A license plate tilt correction algorithm based on the character median line algorithme de correction d’inclinaison de plaque d’immatriculation basé sur la ligne médiane du caractère", Can. J. Electr. Comput. Eng., vol. 41, no. 3, pp. 145-150, 2018.
[http://dx.doi.org/10.1109/CJECE.2018.2867591]
[4]
P. Li, M. Nguyen, and W. Yan, "Rotation correction for license plate recognition In: 2018 4th International Conference on Control, Automation and Robotics (ICCAR). Apr 20-23, 2018, Auckland, New Zealand, 2018",
[http://dx.doi.org/10.1109/ICCAR.2018.8384708]
[5]
Y. Wen, Y. Lu, J. Yan, Z. Zhou, K.M. von Deneen, and P. Shi, "An algorithm for license plate recognition applied to intelligent transportation system", IEEE Trans. Intell. Transp. Syst., vol. 12, no. 3, pp. 830-845, 2011.
[http://dx.doi.org/10.1109/TITS.2011.2114346]
[6]
L. Xie, T. Ahmad, L. Jin, Y. Liu, and S. Zhang, "A new CNN-based method for multi-directional car license plate detection", IEEE Trans. Intell. Transp. Syst., vol. 19, no. 2, pp. 507-517, 2018.
[http://dx.doi.org/10.1109/TITS.2017.2784093]
[7]
Y. Zhang, and C. Huang, "A robust chinese license plate detection and recognition systemin natural scenes", In: 2019 IEEE 4th International Conference on Signal and Image Processing (ICSIP). Jul 19-21, 2019, Wuxi, China, p. pp. 137-142, 2019, .
[http://dx.doi.org/10.1109/SIPROCESS.2019.8868545]
[8]
C. Nguyen, T. Nguyen, and S. Chung, "Reliable detection and skew correction method of license plate for PTZ camera-based license plate recognition system", In: 2015 International Conference on Information and Communication Technology Convergence (ICTC) Oct 28-30, 2015, Jeju, 2015, p. pp. 1013-1018, 2015, .
[http://dx.doi.org/10.1109/ICTC.2015.7354726]
[9]
A. Meng, W. Yang, Z. Xu, H. Huang, L. Huang, and C. Ying, "A robust and efficient method for license plate recognition", In: 2018 24th International Conference on Pattern Recognition (ICPR). Aug 20-24, 2018, Beijing, China, pp. 1713-1718, 2018.
[http://dx.doi.org/10.1109/ICPR.2018.8546291]
[10]
Z. Hong, and L. Feng, "An algorithm based on geometric region to correct tilt license plates", n: 2012 International Conference on Industrial Control and Electronics Engineering. Aug 23-25, 2012, Xi'an, pp. 665-667, 2012.
[http://dx.doi.org/10.1109/ICICEE.2012.180]
[11]
R. Wang, G. Wang, and Z. Wang, "A fast method for two-stage precise license plate location based on fusion of corner feature and gray level jumps", In: 2012 International Conference on Industrial Control and Electronics Engineering. Aug 23-25, 2012, Xi'an, pp. 976-979, 2012.
[http://dx.doi.org/10.1109/ICICEE.2012.259]
[12]
P. Dhar, M. Abedin, R. Karim, and M. Hossain, "Bangladeshi license plate recognition using adaboost classifier", In: 2019 Joint 8th International Conference on Informatics, Electronics & Vision (ICIEV) and 2019 3rd International Conference on Imaging, Vision & Pattern Recognition (icIVPR). May 30- Jun 03, 2019, Spokane, WA, USA, p. pp. 342-347, 2019, .
[http://dx.doi.org/10.1109/ICIEV.2019.8858580]
[13]
W. Zhai, T. Gao, Y. Hu, and Y. Tian, Research and implementation of license plate character segmentation based on tilt correction.In: L. Qi, Ed., Information and Automation. ISIA 2010. Communications in Computer and Information Science, vol. 86. Springer: Berlin, Heidelberg, 2010.
[14]
J. Dalida, A. Galiza, A. Godoy, M. Nakaegawa, J. Vallester, and A. Dela, “Development of intelligent transportation system for Philippine license plate recognition,” 2016 IEEE Region 10 Conference., TENCON: Singapore, 2016, pp. 3762-3766.
[15]
J. Huang, "Research on license plate image segmentation and intelligent character recognition", Int. J. Pattern Recognit. Artif. Intell., vol. 34, no. 6, p. 2050014, 2020.
[http://dx.doi.org/10.1142/S0218001420500147]
[16]
L. Wu, C. Yang, W. Zhang, and W. Jiang, "Design and development of license plate recognition software based on OpenCV and deep learning", Comput. Knowledge Technol., vol. 16, no. 01, pp. 203-204, 2020.
[17]
S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: Towards real-time object detection with region proposal networks", IEEE Trans. Pattern Anal. Mach. Intell., vol. 39, no. 6, pp. 1137-1149, 2017.
[http://dx.doi.org/10.1109/TPAMI.2016.2577031] [PMID: 27295650]
[18]
W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C-Y. Fu, and A.C. Berg, SSD: Single shot multibox detector Lect. Notes Comput. Sci., vol. 9905, pp. 21-37, 2016.
[http://dx.doi.org/10.1007/978-3-319-46448-0_2]
[19]
S. Zhang, L. Wen, X. Bian, Z. Lei, and S. Li, "Single-shot refinement neural network for object detection", In: Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Jun 18-23, 2018, Salt Lake City, UT, USA, p. pp. 4203- 4212, 2018, .
[http://dx.doi.org/10.1109/CVPR.2018.00442]
[20]
K. Simonyan, and A. Zisserman, "Very deep convolutional networks for large-scale image recognition", In International Conference of Learning Representation, 2015.
[21]
G. Chen, H. Yi, and Z. Mao, "Vehicle and pedestrian detection based on multi-level feature fusion in autonomous driving", Rec. Adv. Comput. Sci. Commun., vol. 21, p. 7267, 2021.
[22]
Z. Xu, W. Yang, A. Meng, N. Lu, and L. Huang, "Towards end-to-end license plate detection and recognition: A large dataset and baseline", In Proceedings of the European conference on computer vision (ECCV), Springer Cham, p. 2018 pp. 255-271, .
[http://dx.doi.org/10.1007/978-3-030-01261-8_16]
[23]
D. Erhan, C. Szegedy, and A. Toshev, Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2014, pp. 2155-2162, 2014.
[24]
J. Cexus, A. Boudraa, and A. Bouchikhi, "A combined teager-huang and hough transforms for LFM signals detection", In: 2010 4th International Symposium on Communications, Control and Signal Processing (ISCCSP). Mar 03-05, 2010, Limassol, Cyprus, p. pp. 1-5, 2010, .
[http://dx.doi.org/10.1109/ISCCSP.2010.5463482]
[25]
P. Singh, and S.S. Bose, "A quantum-clustering optimization method for COVID-19 CT scan image segmentation", Expert Syst. Appl., vol. 185, p. 115637, 2021.
[http://dx.doi.org/10.1016/j.eswa.2021.115637] [PMID: 34334964]
[26]
P. Singh, and S.S. Bose, "Ambiguous D-means fusion clustering algorithm based on ambiguous set theory: Special application in clustering of CT scan images of COVID-19", Knowl. Base. Syst., vol. 231, p. 107432, 2021.
[http://dx.doi.org/10.1016/j.knosys.2021.107432] [PMID: 34462624]

Rights & Permissions Print Cite
© 2024 Bentham Science Publishers | Privacy Policy