Abstract
Automatic detection and recognition of traffic sign has been a topic of great interest in advanced driver assistance system. It enhances vehicle and driver safety by providing the condition and state of the road to the drivers. However, visual occlusion and ambiguities in the real-world scenario make the traffic sign recognition a challenging task. This paper presents an Automatic Traffic Sign Detection and Recognition (ATSDR) system, involving three modules: segmentation, detection, and recognition. Region of Interest (ROI) is extracted using multiple thresholding schemes with a novel environmental selection strategy. Then, the traffic sign detection is carried out using correlation computation between log-polar mapped inner regions and the reference template. Finally, recognition is performed using Support Vector Machine (SVM) classifier. Our proposed system achieved a recognition accuracy of 98.3 % and the experimental results demonstrates the robustness of traffic sign detection and recognition in real-world scenario.
Similar content being viewed by others
References
Alsibai M, Hirai Y (2010) Real-time recognition of blue traffic signs designating directions. Int J Intell Transp Syst Res 8(2):96–105
Barnes N, Zelinsky A, Fletcher L (2008) Real-time speed sign detection using the radial symmetry detector. IEEE Trans Intell Transp Syst 9(2):322–332
Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396
Boumediene M, Cudel C, Basset M, Ouamri A (2013) Triangular traffic signs detection based on rsld algorithm. Mach Vis Appl 24(8):1721–1732
Burges CJC (1998) A tutorial on support vector machines for pattern recognition. Data Min Knowl Disc 2(2):121–167
Cai D, He X, Zhou K, Han J Bao H (2007) Locality sensitive discriminant analysis. In: Proceedings of the 20th international joint conference on artifical intelligence. Hyderabad, India, pp 708–713
Chang CC, Lin CJ (2011) LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol 2:27:1–27:27. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm
Ciresan D, Meier U, Masci J, Schmidhuber J (2011) A committee of neural networks for traffic sign classification. In: The 2011 international joint conference on neural networks, San Jose, pp 1918–1921
Duda RO, Hart PE, Stork DG (2000) Pattern classification, 2nd edn. Wiley-Interscience
Escalera S, Pujol O, Radeva P (2010) Traffic sign recognition system with ß -correction. Mach Vis Appl 21(2):99–111
Fang X, Xu Y, Li X, Fan Z, Liu H, Chen Y (2014) Locality and similarity preserving embedding for feature selection. Neurocomputing 128:304–315
Fleyeh H, Davami E (2011) Eigen-based traffic sign recognition. IET Intell Transp Syst 5(3):190–196
Gamec J, Urdzík D, Gamcová M (2012) Algorithm of traffic signs recognition based on the rapid transform. Cent Eur J Comput Sci 2(3):236–244
Gao XW, Podladchikova L, Shaposhnikov D, Hong K, Shevtsova N (2006) Recognition of traffic signs based on their colour and shape features extracted using human vision models. J Vis Commun Image Represent 17(4):675–685
Gil Jiménez P, Bascón SM, Moreno HG, Arroyo SL, Ferreras FL (2008) Traffic sign shape classification and localization based on the normalized fft of the signature of blobs and 2d homographies. Signal Process 88(12):2943–2955
Gómez-Moreno H, Maldonado-Bascón S, Gil-Jiménez P, Lafuente-Arroyo S (2010) Goal evaluation of segmentation algorithms for traffic sign recognition. IEEE Trans Intell Transp Syst 11(4):917–930
Greenhalgh J, Mirmehdi M (2012) Real-time detection and recognition of road traffic signs. IEEE Trans Intell Transp Syst 13(4):1498–1506
Gu Y, Yendo T, Tehrani M, Fujii T Tanimoto M (2011) Traffic sign detection in dual-focal active camera system. In: Intelligent vehicles symposium (IV), Germany, pp 1054–1059
Gudigar A, Jagadale B,Mahesh P K, Raghavendra U (2012) Kernel based automatic traffic sign detection and recognition using svm. In: Eco-friendly computing and communication systems, vol 305, India, pp 153–161
Gudigar A, Chokkadi S, Raghavendra U (2016) A review on automatic detection and recognition of traffic sign. Multimed Tools Appl 75(1):333–364
Han PY, Jin ATB, Abas FS (2009) Neighbourhood preserving discriminant embedding in face recognition. J Vis Commun Image Represent 20(8):532–542
He X, Cai D, Yan S, Zhang HJ (2005) Neighborhood preserving embedding. In: Proceedings of the 10th IEEE international conference on computer vision, vol 2, Beijing, pp 1208–1213
Houben S, Stallkamp J, Salmen J, Schlipsing M, Igel C (2013) Detection of traffic signs in real-world images: the German traffic sign detection benchmark. In: Proceedings of IEEE international joint conference on neural networks, USA, p 1288
Jalba AC, Roerdink JBTM, Wilkinson MHF (2003) Morphological hat-transform scale spaces and their use in texture classification. Pattern Recogn 37:901–915
Javier Traver V, Bernardino A (2010) A review of log-polar imaging for visual perception in robotics. Robot Auton Syst 58(4):378–398
Kehtarnavaz N, Ahmad A (1995) Traffic sign recognition in noisy outdoor scenes. In: Proceedings of the intelligent vehicles ’95 symposium, Detroit, pp 460–465
Khan JF, Bhuiyan SMA, Adhami RR (2011) Image segmentation and shape analysis for road-sign detection. IEEE Trans Intell Transp Syst 12(1):83–96
Kuo WJ, Lin CC (2007) Two-stage road sign detection and recognition. In: IEEE international conference on multimedia and expo, China, pp 1427–1430
Lafuente-Arroyo S, Salcedo-Sanz S, Maldonado-Bascón S, Portilla-Figueras J, López-Sastre R (2010) A decision support system for the automatic management of keep-clear signs based on support vector machines and geographic information systems. Expert Syst Appl 37(1):767–773
Liu H, Liu Y, Sun F (2014) Traffic sign recognition using group sparse coding. Inform Sci 266:75– 89
Lu K, Ding Z, Ge S (2012) Sparse-representation-based graph embedding for traffic sign recognition. IEEE Trans Intell Transp Syst 13(4):1515–1524
Maldonado-Bascón S, Lafuente-Arroyo S, Gil-Jiménez P, Gómez-Moreno H, López-Ferreras F (2007) Road-sign detection and recognition based on support vector machines. IEEE Trans Intell Transp Syst 8(2):264–278
Mathias M, Timofte R, Benenson R, Van Gool L (2013) Traffic sign recognition - how far are we from the solution?. In: The 2013 international joint conference on neural networks, USA, pp 1–8
Mazinan A, Sarikhani M (2014) Providing an efficient intelligent transportation system through detection, tracking and recognition of the region of interest in traffic signs by using non-linear svm classifier in line with histogram oriented gradient and kalman filter approach. Sadhana 39(1):27–37
Miura J, Kanda T, Shirai Y (2000) An active vision system for real-time traffic sign recognition. In: Proceedings of intelligent transportation systems, USA, pp 52–57
Nguwi YY, Cho SY (2010) Emergent self-organizing feature map for recognizing road sign images. Neural Comput & Applic 19(4):601–615
Nguwi YY, Kouzani AZ (2008) Detection and classification of road signs in natural environments. Neural Comput & Applic 17(3):265–289
Park JG, Kim K (2013) Design of a visual perception model with edge-adaptive gabor filter and support vector machine for traffic sign detection. Expert Syst Appl 40 (9):3679–3687
Pazhoumand-dar H, Yaghoobi M (2013) A new approach in road sign recognition based on fast fractal coding. Neural Comput & Applic 22(3-4):615–625
Raghavendra U, Makkithaya K, Karunakar AK (2013) Anchor-diagonal-based shape adaptive local support region for efficient stereo matching. SIViP 9(4):893–901
Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326
Ruta A, Li Y, Liu X (2010) Real-time traffic sign recognition from video by class-specific discriminative features. Pattern Recogn 43(1):416–430
Segu M, Prieto Allen AR (2009) Using self-organising maps in the detection and recognition of road signs. Image Vis Comput 27(6):673–683
Sermanet P, LeCun Y (2011) Traffic sign recognition with multi-scale convolutional networks. In: The 2011 international joint conference on neural networks, San Jose, pp 2809–2813
Souani C, Faiedh H, Besbes K (2014) Efficient algorithm for automatic road sign recognition and its hardware implementation. J Real-Time Image Proc 9(1):79–93
Stallkamp J, Schlipsing M, Salmen J, Igel C (2012) Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw 32:323–332
Sun ZL, Wang H, Lau WS, Seet G, Wang D (2014) Application of bw-elm model on traffic sign recognition. Neurocomputing 128:153–159
Tenenbaum JB, Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323
Timofte R, Zimmermann K, Van Gool L (2014) Multi-view traffic sign detection, recognition, and 3d localisation. Mach Vis Appl 25(3):633–647
Violence WHO, Prevention I, Organization WH (2013) Global status report on road safety 2013: supporting a decade of action. World Health Organization
Wang G, Ren G, Jiang L, Quan T (2014) Hole-based traffic sign detection method for traffic signs with red rim. Vis Comput 30(5):539–551
Xu Y, Zhu Q, Fan Z, Qiu M, Chen Y, Liu H (2013) Coarse to fine k nearest neighbor classifier. Pattern Recogn Lett 34(9):980–986
Zaklouta F, Stanciulescu B (2014) Real-time traffic sign recognition in three stages. Robot Auton Syst 62(1):16–24
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gudigar, A., Chokkadi, S., Raghavendra, U. et al. Multiple thresholding and subspace based approach for detection and recognition of traffic sign. Multimed Tools Appl 76, 6973–6991 (2017). https://doi.org/10.1007/s11042-016-3321-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-016-3321-6