Abstract
Traffic sign detection is a crucial element of advanced driver assistance systems (ADAS) for environmental perception. However, challenges persist in the detection of small-scale targets and susceptibility to adverse weather, varying light conditions, and occlusions. To address this issue, a novel traffic sign detection algorithm, GRFS-YOLOv8, is proposed. GRFS-YOLOv8 introduces an enhanced greater receptive field-SPPF (GRF-SPPF) module to replace the original SPPF module, enabling the capture of richer multiscale features from image feature maps. Additionally, a new SPAnet architecture is designed by introducing two “shortcut” paths and additional smaller target detection layers to enhance path aggregation capabilities. This architecture propagates complete semantic information, alleviating the reduction in resolution for small targets and enhancing the model’s capability to detect them. Finally, by employing GhostConv and C2fGhost to replace multiple CBS and C2f modules in Backbone and Neck, cost-effective linear operations are utilized to obtain more feature maps, thus reducing the computational cost of the model. Experimental validation across multiple datasets demonstrates the efficacy and adaptability of GRFS-YOLOv8, achieving an 80.3% mAP and 72.4% Recall in CCTSDB 2021, a 71.2% mAP and 95% Recall in TT100K, and a 94.0% mAP and 96.0% Recall in GTSDB, surpassing mainstream detectors and comparative methods.
Similar content being viewed by others
Availability of data and materials
Data will be made available on reasonable request.
Code availability
Code availability not applicable.
References
Soendoro, D., Supriana, I.: Traffic sign recognition with color-based method, shape-arc estimation and SVM. In: Proceedings of the 2011 International Conference on Electrical Engineering and Informatics, pp. 1–6 (2011). https://doi.org/10.1109/ICEEI.2011.6021584
Khongviriyakit, N., Paripurana, S.: Traffic sign detection based on color and boundary shape box ratio. In: 2018 15th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON), pp. 461–464 (2018). https://doi.org/10.1109/ECTICon.2018.8620017
Garcí-Garrido, M.A., et al.: Complete vision-based traffic sign recognition supported by an I2V communication system. Sensors 12(2), 1148–1169 (2012)
Li, J., Wang, Z.: Real-time traffic sign recognition based on efficient CNNs in the wild. IEEE Trans. Intell. Transport. Syst. 20(3), 975–984 (2019). https://doi.org/10.1109/TITS.2018.2843815
Tabernik, D., Skočaj, D.: Deep learning for large-scale traffic-sign detection and recognition. IEEE Trans. Intell. Transport. Syst. 21(4), 1427–1440 (2020). https://doi.org/10.1109/TITS.2019.2913588
Yan, Yi., et al.: A traffic sign recognition method under complex illumination conditions. IEEE Access 11, 39185–39196 (2023). https://doi.org/10.1109/ACCESS.2023.3266825
Liu, W., et al.: Ssd: single shot multibox detector. In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14, pp. 21–37 (2016). Springer
Yu, J., Ye, X., Tu, Q.: Traffic sign detection and recognition in multiimages using a fusion model with YOLO and VGG network. IEEE Trans. Intell. Transport. Syst. 23(9), 16632–16642 (2022). https://doi.org/10.1109/TITS.2022.3170354
Shi, Y., Li, X., Chen, M.: SC-YOLO: a object detection modelfor small traffic signs. IEEE Access 11, 11500–11510 (2023). https://doi.org/10.1109/ACCESS.2023.3241234
Luo, S., Chenghang, Wu., Li, L.: Detection and recognition of obscured traffic signs during vehicle movement. IEEE Access 11, 122516–122525 (2023). https://doi.org/10.1109/ACCESS.2023.3329068
Soylu, E., Soylu, T.: A performance comparison of YOLOv8 models for traffic sign detection in the Robotaxi-full scale autonomous vehicle competition. Multimed. Tools Appl. 8, 1–31 (2023)
Gray, N., et al.: GLARE: a dataset for traffic sign detection in sun glare. IEEE Trans. Intell. Transport. Syst. 24(11), 12323–12330 (2023). https://doi.org/10.1109/TITS.2023.3294411
Liu, S., et al.: Path aggregation network for instance segmentation. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 8759–8768 (2018). https://doi.org/10.1109/CVPR.2018.00913
Yu, F., Koltun, V.: Multi-scale context aggregation by dilated convolutions (2015). arXiv preprint arXiv:1511.07122
Tan, M., Pang, R., Le, Q.V.: Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10781–10790 (2020)
Han, K., et al.: Ghostnet: more features from cheap operations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1580–1589 (2020)
Zhang, J.M., et al.: “Cctsdb 2021: a more comprehensive traffic sign detection benchmark”, human-centric comput. Inf. Sci. 12, 55 (2022)
Zhu, Z., et al.: Traffic-sign detection and classification in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2110–2118 (2016)
Houben, S., et al.: Detection of traffic signs in real-world images: the German traffic sign detection benchmark. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2013)
Ren, S., et al.: Faster R-CNN: towards real-time object detection with region proposal networks. Adv. Neural. Inf. Process. Syst. 5, 28 (2015)
Lin, T.Y., et al.: Focal loss for dense object detection. In: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 2999–3007 (2017). https://doi.org/10.1109/ICCV.2017.324
Jocher, G.: Ultralytics/yolov5: v3.1-bug fixes and performance improvements. https://github.com/ultralytics/yolov5. Version v3.1. Oct. 2020. https://doi.org/10.5281/zenodo.4154370. https://doi.org/10.5281/zenodo.4154370
Li, C., et al.: YOLOv6: a single-stage object detection framework for industrial applications (2022). arXiv:2209.02976
Wang, C.Y., Bochkovskiy, A., Liao, H.Y.M.: YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors (2022). arXiv:2207.02696
Ge, Z., et al.: Yolox: exceeding yolo series in 2021 (2021). arXiv preprint arXiv:2107.08430
Cao, L., Kang, S., Chen, J.: Improved lightweight YOLOv5s algorithm for traffic sign recognition. In: 2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS), pp. 289–294. IEEE (2023)
Bai, W., et al.: Two novel models for traffic sign detection based on YOLOv5s. Axioms 12(2), 160 (2023)
Tang, S., Fang, Y., Zhang, S.: HIC-YOLOv5: improved YOLOv5 for small object detection (2023). arXiv preprint arXiv:2309.16393
Xie, Z.Y., Li, T.J.: Traffic sign detection based on depth improved YOLO-V5. In: 2023 8th International Conference on Intelligent Computing and Signal Processing (ICSP), pp. 1896–1899 (2023). https://doi.org/10.1109/ICSP58490.2023.10248695
Liu, M., et al.: LF-YOLO: a lighter and faster YOLO for weld defect detectionof X-ray image. IEEE Sens. J. 23(7), 7430–7439 (2023). https://doi.org/10.1109/JSEN.2023.3247006
Di, Y., et al.: TP-YOLO: a lightweight attention-based architecture for tiny pest detection. In: 2023 IEEE International Conference on Image Processing (ICIP), pp. 3394–3398 (2023). https://doi.org/10.1109/ICIP49359.2023.10222202
Wang, X., et al.: C2Net-YOLOv5: a bidirectional Res2Net-based traffic sign detection algorithm (2023). Available at SSRN 4406700
Wang, Q., et al.: Real time traffic sign recognition algorithm based on SG-YOLO. In: Asian Simulation Conference, pp. 86–99. Springer (2022)
Sun, X., et al.: LLTH-YOLOv5: a real-time traffic sign detection algorithm for low-light scenes. Automot. Innov. 7(1), 121–137 (2024)
Jia, Z., Sun, S., Liu, G.: Real-time traffic sign detection based on weighted attention and model refinement. Neural. Process. Lett. 55(6), 7511–7527 (2023)
Xiao, Y., et al.: E-YOLOv4-tiny: a traffic sign detection algorithm for urban road scenarios. Front. Neurorobotics 17, 34 (2023)
Zhang, J., et al.: A robust real-time anchor-free traffic sign detector with one-level feature. IEEE Trans. Emerg. Top. Comput. Intell. 8, 24 (2024)
Wang, J., et al.: Improved YOLOv5 network for real-time multi-scale traffic sign detection (2021). arXiv preprint arXiv:2112.08782
Wang, J., et al.: A lightweight vehicle mounted multi-scale traffic sign detector using attention fusion pyramid. J. Supercomput. 80(3), 3360–3381 (2024)
Zhang, L.J., et al.: CR-YOLOv8: multiscale object detection in traffic sign images. IEEE Access 12, 219–228 (2023)
Yao, Y., et al.: Traffic sign detection algorithm based on improved YOLOv4-Tiny. Signal Process. Image Commun. 107, 116783 (2022)
Wang, H., Yu, H.: Traffic sign detection algorithm based on improved YOLOv4. In: 2020 IEEE 9th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), vol. 9, pp. 1946–1950 (2020). https://doi.org/10.1109/ITAIC49862.2020.9339181
She, F., et al.: Improved traffic sign detection model based on YOLOv7-Tiny. IEEE Access 11, 126555–126567 (2023). https://doi.org/10.1109/ACCESS.2023.3331426
Yuan, Xu., et al.: Faster light detection algorithm of traffic signs based on YOLOv5s-A2. IEEE Access 11, 19395–19404 (2023). https://doi.org/10.1109/ACCESS.2022.3204818
Han, T., Sun, L., Dong, Q.: An improved YOLO model for traffic signs small target image detection. Appl. Sci. 13(15), 8754 (2023)
Funding
This work is supported by the National Natural Science Foundation of China (62002070), the Science and Technology Plan Project of Guangzhou City (202102021236).
Author information
Authors and Affiliations
Contributions
The submission has been received explicitly from all co-authors. And authors whose names appear on the submission have contributed sufficiently to the scientific work and therefore share collective responsibility and accountability for the results.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no competing interests to declare that are relevant to the content of this article.
Ethics approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
Not applicable.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Xie, G., Xu, Z., Lin, Z. et al. GRFS-YOLOv8: an efficient traffic sign detection algorithm based on multiscale features and enhanced path aggregation. SIViP 18, 5519–5534 (2024). https://doi.org/10.1007/s11760-024-03252-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-024-03252-8