Abstract
Vehicle detection and tracking play a critical role in Intelligent Traffic Systems (ITS) for managing, identifying, and understanding the behaviour of vehicles on the road. In recent years, researchers have focused on developing computer vision-based approaches to improve the accuracy of vehicle detection and tracking. However, state-of-the-art approaches face challenges such as uncontrollable environmental conditions, occlusion of vehicles in a single frame, and high levels of noise, which can affect the accuracy of vehicle detection. In this study, we propose a computer vision-based approach to identify and track the movement of vehicles using the “YOU ONLY LOOK ONCE” (YOLO) version 7 Convolutional Neural Network (CNN) model. The YOLO model is fine-tuned to detect different types of vehicles, including cars, ambulances, buses, trucks, motorcycles, and bicycles. We utilized the Open Images Dataset from Google to test and validate our approach. Our experimental results demonstrate that the proposed approach achieves a higher detection accuracy of 81.28% mean Average Precision (mAP) compared to the state-of-the-art approaches. Furthermore, we tested our approach on the DAWN dataset to demonstrate its effectiveness as a multi-detector of vehicles in different weather conditions and online videos on the road for vehicle detection and tracking. Despite the challenges in the state-of-the-art computer vision-based ITS, our proposed approach demonstrates that it is possible to achieve higher accuracy using the YOLO version 7 CNN model. This study highlights the importance of developing accurate and efficient vehicle detection and tracking techniques to improve the operational functions of Intelligent Traffic Systems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Akhtar, M., Moridpour, S.: A review of traffic congestion prediction using artificial intelligence. J. Adv. Transp. 8878011 (2021)
Feniche, M., Mazri, T.: Lane detection and tracking for intelligent vehicles: a survey. In: 2019 International Conference of Computer Science and Renewable Energies (ICCSRE), pp. 1–4 (2019)
Tian, B., et al.: Hierarchical and networked vehicle surveillance in its: a survey. IEEE Trans. Intell. Transp. Syst. 16(2), 557–580 (2014)
Kuang, H., Chen, L., Chan, L.L.H., Cheung, R.C., Yan, H.: Feature selection based on tensor decomposition and object proposal for night-time multiclass vehicle detection. IEEE Trans. Syst. Man Cybernet. Syst. 49(1), 71–80 (2018)
Wu, J., Xu, H., Tian, Y., Pi, R., Yue, R.: Vehicle detection under adverse weather from roadside lidar data. Sensors 20(12), 3433 (2020)
Wang, C.Y., Bochkovskiy, A., Liao, H.Y.M.: Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv:2207.02696 (2022)
Rodriguez-Galiano, V.F., Ghimire, B., Rogan, J., Chica-Olmo, M., Rigol-Sanchez, J.P.: An assessment of the effectiveness of a random forest classifier for land-cover classification. ISPRS J. Photogram. Rem. Sens. 67 (2012)
Shih, A., Choi, A., Darwiche, A.: Compiling bayesian network classifiers into decision graphs. Proc. AAAI Conf. Artif. Intell. 33, 7966–7974 (2019)
Hoang, M.T., et al.: A soft range limited k-nearest neighbors algorithm for indoor localization enhancement. IEEE Sens. J. 18(24), 10208–10216 (2018)
Sheykhmousa, M., Mahdianpari, M., Ghanbari, H., Mohammadimanesh, F., Ghamisi, P., Homayouni, S.: Support vector machine versus random forest for remote sensing image classification: a meta-analysis and systematic review. IEEE J. Sel. Topics Appl. Earth Observ. Rem. Sens. 13, 6308–6325 (2020)
Rybski, P.E., Huber, D., Morris, D.D., Hoffman, R.: Visual classification of coarse vehicle orientation using histogram of oriented gradients features. In: 2010 IEEE Intelligent vehicles symposium, pp. 921–928. IEEE
Adouani, A., Henia, W.M.B., Lachiri, Z.: Comparison of haar-like, hog and lbp approaches for face detection in video sequences. In: 2019 16th International Multi-Conference on Systems, Signals & Devices (SSD), pp. 266–271. IEEE (2021)
Shobha, B.S., Deepu, R.: A review on video based vehicle detection, recognition and tracking. In: 2018 3rd International Conference on Computational Systems and Information Technology for Sustainable Solutions (CSITSS), pp. 183–186. IEEE (2018)
Everingham, M., Winn, J.: The pascal visual object classes challenge 2007 (voc2007) development kit. University of Leeds, Tech. Rep (2007)
Kuznetsova, A., et al.: The open images dataset v4. Int. J. Comput. Vision 128(7), 1956–1981 (2020)
Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll ́ar, P., Zitnick, C.L.: Microsoft coco: common objects in context. In: European conference on computer vision, pp. 740–755. Springer (2014)
Deschaud, J.E.: Kitti-carla: a kitti-like dataset generated by Carla simulator. arXiv preprint arXiv:2109.00892 (2021)
Wen, L., et al.: Ua-detrac: a new benchmark and protocol for multi-object detection and tracking. Comput. Vis. Image Underst. 193, 102907 (2020)
Pillai, U.K.K., Valles, D.: Vehicle type and color classification and detection for amber and silver alert emergencies using machine learning. In,: IEEE Inter-national IOT. Electronics and Mechatronics Conference (IEMTRONICS). 2020, 1–5 (2020)
Piedad, E.J., Le, T.T., Aying, K., Pama, F.K., Tabale, I.: Vehicle count system based on time interval image capture method and deep learning mask r-cnn. In: TENCON 2019—2019 IEEE Region 10 Conference (TENCON), pp. 2675–2679 (2019)
Muchtar, K., Afdhal, A., Nasaruddin, N.: Convolutional network and moving object analysis for vehicle detection in highway surveillance videos. In: 2020 3rd International Seminar on Research of Information Technology and Intelligent Systems ISRITI), pp. 509–513 (2020)
Segol, N., and Nadler, B.: Improved convergence guarantees for learning Gaussian mixture models by EM and gradient EM. Electron. J. Stat. 4510–4544(2021)
Naik, U.P., Rajesh, V., and Kumar, R.: Implementation of YOLOv4 algorithm for multiple object detection in image and video dataset using deep learning and artificial intelligence for urban traffic video surveillance application. In: Book Implementation of YOLOv4 algorithm for multiple object detection in image and video dataset using deep learning and artificial intelligence for urban traffic video surveillance application, pp. 1–6. IEEE (2021)
Mahto, P., Garg, P., Seth, P., Panda, J.: Refining yolov4 for vehicle detection. Int. J. Adv. Res. Eng. Technol. IJARET (2020)
Kenk, M.A., Hassaballah, M.: DAWN: vehicle detection in adverse weather nature dataset. ArXiv preprint arXiv:2008.05402 (2020)
AIGuysCode: Github-the AIGuysCode/yolov4deepsort. In Book Github-the AIGuysCode/yolov4deepsort (2021)
Chiu, Y.-C., Tsai, C.-Y., Ruan, M.-D., Shen, G.-Y., Lee, T.-T.: Mobilenet-SSDv2: An improved object detection model for embedded systems. In : 2020 International conference on system science and engineering (ICSSE), pp. 1–6. IEEE (2020)
Tan, M., Pang, R., Le, Q.V.: Efficientdet: Scalable and efficient object detection. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp/ 10781–10790 (2020)
Acknowledgments
To the Tshwane University of Technology (TUT) Department of Computer Systems. Engineering for providing the research opportunity.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Moaga, M., Chunling, T., Owolawi, P. (2024). Vision-Based Multi-detection and Tracking of Vehicles Using the Convolutional Neural Network Model YOLO. In: Arai, K. (eds) Intelligent Systems and Applications. IntelliSys 2023. Lecture Notes in Networks and Systems, vol 823. Springer, Cham. https://doi.org/10.1007/978-3-031-47724-9_34
Download citation
DOI: https://doi.org/10.1007/978-3-031-47724-9_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47723-2
Online ISBN: 978-3-031-47724-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)