Deep learning approach to automatically recognise license number plates | Multimedia Tools and Applications Skip to main content
Springer Nature Link
Log in

Deep learning approach to automatically recognise license number plates

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Automatic Number Plate Recognition (ANPR) has become an important aspect in our daily life because of unlimited increase of vehicles and transportation system. This makes it more and more difficult to fully manage and monitor by humans. Due to the diversity of license plates formats, varying scales and sizes, different angles, illuminations, this is quite a challenging problem in the area of computer vision. In this paper, we have proposed methods for automatic detection of a license plate from an image, which is followed by plate correction, or in other words, plate rectification. Thereafter, character recognition methodology has been applied to identify characters from the number plate. Convolutional Neural Networks (CNNs) based approach is used to locate corner points of license plate image, after that plate rectification done using perspective transformation. The CNNs models for locating corner points are neural networks for regression. Here, the loss function is based on an average sum of Euclidean distance between predicted corner points and actual corner points, the loss function is also known as the mean squared error function. The results show that our CNNs models are able to accurately predict corner points from number plate. Furthermore, an optical character recognition (OCR) model is used to identify characters from the plate. The developed methodology shows excellent results on the Chinese City Parking Dataset (CCPD).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Data Availability

CCPD data is available online.

Notes

  1. https://www.visionofhumanity.org/maps/

  2. https://docs.opencv.org/2.4/modules/imgproc/doc/geometric_transformations.html

References

  1. Abolghasemi V, Ahmadyfard A (2009) An edge-based color-aided method for license plate detection. Image Vis Comput 27(8):1134–1142

    Article  Google Scholar 

  2. Alam NA, Ahsan M, Based MA et al (2021) Intelligent system for vehicles number plate detection and recognition using convolutional neural networks. Technologies 9(1):9

    Article  Google Scholar 

  3. Bradski G, Kaehler A (2000) Opencv. Dr Dobb’s journal of software tools, vol 3

  4. Car license plates dataset (2020) https://makeml.app/datasets/cars-license-plates

  5. Dalarmelina NdV, Teixeira MA, Meneguette RI (2020) A real-time automatic plate recognition system based on optical character recognition and wireless sensor networks for its. Sensors 20(1):55

    Article  Google Scholar 

  6. Davies E (1989) Minimising the search space for polygon detection using the generalised hough transform. Pattern Recogn Lett 9(3):181–192

    Article  MATH  Google Scholar 

  7. Du S, Ibrahim M, Shehata M et al (2012) Automatic license plate recognition (alpr): a state-of-the-art review. IEEE Trans Circuits Syst Video Technol 23(2):311–325

    Article  Google Scholar 

  8. Farhat A, Hommos O, Al-Zawqari A et al (2018) Optical character recognition on heterogeneous soc for hd automatic number plate recognition system. EURASIP Journal on Image and Video Processing 2018(1):1–17

    Article  Google Scholar 

  9. Giannoukos I, Anagnostopoulos C N, Loumos V, et al. (2010) Operator context scanning to support high segmentation rates for real time license plate recognition. Pattern Recogn 43(11):3866–3878

    Article  MATH  Google Scholar 

  10. Graves A (2012) Connectionist temporal classification. In: Supervised sequence labelling with recurrent neural networks. Springer, pp 61–93

  11. Hsu G S, Chen J C, Chung Y Z (2012) Application-oriented license plate recognition. IEEE Trans Veh Technol 62(2):552–561

    Article  Google Scholar 

  12. Huang Q, Cai Z, Lan T (2020) A new approach for character recognition of multi-style vehicle license plates. IEEE Trans Multimedia 23:3768–3777

    Article  Google Scholar 

  13. Huang J, Rathod V, Sun C et al (2017) Speed/accuracy trade-offs for modern convolutional object detectors. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7310–7311

  14. Illingworth J, Kittler J (1988) A survey of the hough transform. Computer vision, Graphics, and Image Processing 44(1):87–116

    Article  Google Scholar 

  15. Jia W, Zhang H, He X et al (2006) Gaussian weighted histogram intersection for license plate classification. In: 18th International conference on pattern recognition (ICPR’06). IEEE, pp 574–577

  16. Kabiraj A, Pal D, Ganguly D, et al. (2022) Number plate recognition from enhanced super-resolution using generative adversarial network. Multimed Tools Appl, pp 1–17

  17. Khan MG, Saeed M, Zulfiqar A, et al. (2022) A novel deep learning based anpr pipeline for vehicle access control. IEEE Access 10:64,172–64,184

    Article  Google Scholar 

  18. Khan MA, Sharif M, Javed MY et al (2018) License number plate recognition system using entropy-based features selection approach with svm. IET Image Process 12(2):200–209

    Article  Google Scholar 

  19. Kim DS, Chien SI (2001) Automatic car license plate extraction using modified generalized symmetry transform and image warping. In: ISIE 2001. 2001 IEEE international symposium on industrial electronics proceedings (Cat. No. 01TH8570). IEEE, pp 2022–2027

  20. Kim KK, Kim KI, Kim J et al (2000) Learning-based approach for license plate recognition. In: Neural networks for signal processing x. proceedings of the 2000 ieee signal processing society workshop (Cat. No. 00TH8501), IEEE, pp 614–623

  21. Kong X, Wang K, Hou M et al (2021) A federated learning-based license plate recognition scheme for 5g-enabled internet of vehicles. IEEE Trans Industr Inf 17(12):8523–8530

    Article  Google Scholar 

  22. Modi ND, Paunwala CN, Modi CK et al (2011) Skew correction for vehicle license plates using principal component of harris corner feature. In: 2011 International conference on communication systems and network technologies, IEEE, pp 339–343

  23. Mufti N, Shah SAA, et al. (2021) Automatic number plate recognition: a detailed survey of relevant algorithms. Sensors 21(9):3028

    Article  Google Scholar 

  24. N Kamal N, Tariq E (2021) License plate tilt correction: a review. Engineering and Technology Journal 39(1):101–116

    Article  Google Scholar 

  25. Pan MS, Xiong Q, Yan JB (2009) A new method for correcting vehicle license plate tilt. Int J Autom Comput 6(2):210–216

    Article  Google Scholar 

  26. Pustokhina IV, Pustokhin DA, Rodrigues JJ et al (2020) Automatic vehicle license plate recognition using optimal k-means with convolutional neural network for intelligent transportation systems. Ieee Access 8:92,907–92,917

    Article  Google Scholar 

  27. Rajput H, Som T, Kar S (2015) An automated vehicle license plate recognition system. Computer 48(8):56–61

    Article  Google Scholar 

  28. Redmon J, Divvala S, Girshick R et al (2016) You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779–788

  29. Shi B, Bai X, Yao C (2016) An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE transactions on pattern analysis and machine intelligence 39 (11):2298–2304

    Article  Google Scholar 

  30. Silva SM, Jung CR (2018) License plate detection and recognition in unconstrained scenarios. In: Proceedings of the european conference on computer vision (ECCV), pp 580–596

  31. Silva SM, Jung CR (2021) A flexible approach for automatic license plate recognition in unconstrained scenarios. IEEE Transactions on Intelligent Transportation Systems

  32. Tang J, Zeng J, Wang Y, et al. (2021) Traffic flow prediction on urban road network based on license plate recognition data: combining attention-lstm with genetic algorithm. Transportmetrica A: Transport Science 17(4):1217–1243

    Article  Google Scholar 

  33. Vi GV, Faudzi AAbM (2022) A study on different techniques in alpr system: the systems performance analysis. In: Recent trends in Mechatronics towards industry 4.0. Springer, pp 617–627

  34. Wang W, Yang J, Chen M et al (2019) A light cnn for end-to-end car license plates detection and recognition. IEEE Access 7:173,875–173,883

    Article  Google Scholar 

  35. Xu H, Guo ZH, Wang DH et al (2021) 2d license plate recognition based on automatic perspective rectification. In: 2020 25th International conference on pattern recognition (ICPR), pp 202–208. https://doi.org/10.1109/ICPR48806.2021.9413152

  36. Xu Z, Yang W, Meng A et al (2018) Towards end-to-end license plate detection and recognition: a large dataset and baseline. In: Proceedings of the european conference on computer vision (ECCV), pp 255–271

  37. Yang X, Wang X (2019) Recognizing license plates in real-time. arXiv:190604376

  38. Yoo H, Jun K (2021) Deep corner prediction to rectify tilted license plate images. Multimedia Syst 27(4):779–786

    Article  MathSciNet  Google Scholar 

  39. Zhang Y (2019) A robust chinese license plate detection and recognition systemin natural scenes. In: 2019 IEEE 4th international conference on signal and image processing (ICSIP). IEEE, pp 137–142

  40. Zhang X, Ni X, Deng Y et al (2021) Chinese license plate recognition using machine and deep learning models. In: 2021 IEEE 2nd International conference on pattern recognition and machine learning (PRML). IEEE, pp 342–346

  41. Zhang L, Wang P, Li H et al (2020) A robust attentional framework for license plate recognition in the wild. IEEE Trans Intell Transp Syst 22 (11):6967–6976

    Article  Google Scholar 

Download references

Acknowledgements

We would like to express our gratitude towards Indian Institute of Information Technology Allahabad for providing us working environment.

Funding

No funding received

Author information

Authors and Affiliations

  1. Department of Information Technology, Indian Institute of Information Technology Allahabad, Prayagraj, India

    Anjali Gautam, Divyesh Rana, Saksham Aggarwal, Swaraj Bhosle & Hritik Sharma

Authors
  1. Anjali Gautam
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Divyesh Rana
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Saksham Aggarwal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Swaraj Bhosle
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Hritik Sharma
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anjali Gautam.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gautam, A., Rana, D., Aggarwal, S. et al. Deep learning approach to automatically recognise license number plates. Multimed Tools Appl 82, 31487–31504 (2023). https://doi.org/10.1007/s11042-023-15020-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-15020-w

Keywords

Search

Navigation