Abstract
Pedestrian detection from a drone-based images has many potential applications such as searching for missing persons, surveillance of illegal immigrants, and monitoring of critical infrastructure. However, it is considered as a very challenge computer vision problem due to the variations in camera point of view, distance from pedestrian, changes in illuminations and weather conditions, variation in the surrounding objects, as well as present of human-like objects. Recently, deep learning-based models are getting more attention, and they have proven a great success in many object detection problems such as the detection of faces, breast masses, and vehicles. As such, this work aims to develop a deep learning-based model that will be applied for the problem of pedestrian detection from a drone-based images. Particularly, faster region-based convolutional neural network (Faster R-CNN) will be used to search for the present of a pedestrian inside the captured drone-based images. To assess the performances, a total of 1500 images were collected by S30W drone and these images were captured at different places, with various views and weather conditions, and at daytime and night-time. Results show that Faster R-CNN was able to achieve a promising result with 98% precision, 99% recall, and 98% F1 measure. Further analysis has been conducted by comparing the outcomes of Faster R-CNN with YOLO deep model on UAV123 publicly available dataset. The reported results indicated that both detection models almost reported very similar results.











Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Times NS. Over 1,800 teenagers, children went missing last year. 2017; https://www.nst.com.my/news/nation/2017/11/303741/over-1800-teenagers-children-went-missing-last-year. Accessed 15 Jan 2020.
Zhang H, et al. Pedestrian detection method based on Faster R-CNN. In: 2017 13th international conference on computational intelligence and security (CIS), IEEE. 2017.
Lan W, et al. Pedestrian detection based on YOLO network model. In: 2018 IEEE international conference on mechatronics and automation (ICMA), IEEE. 2018.
Yi Z, Yongliang S, Jun Z. An improved tiny-yolov3 pedestrian detection algorithm. Optik. 2019;183:17–23.
Dalal N, Triggs B. Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05). vol. 1. IEEE; 2005. pp. 886–893.
Chowdhury SA, Kowsar MMS, Deb K. Human detection utilizing adaptive background mixture models and improved histogram of oriented gradients. ICT Express. 2018;4(4):216–20.
Zhu Q, et al. Fast human detection using a cascade of histograms of oriented gradients. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), IEEE. 2006.
Wei Y, Tian Q, Guo T. An improved pedestrian detection algorithm integrating haar-like features and hog descriptors. Adv Mech Eng. 2013;5:546206.
Seemanthini K, Manjunath S. Human detection and tracking using HOG for action recognition. Procedia Comput Sci. 2018;132:1317–26.
Fradi H, et al. Autonomous person detection and tracking framework using unmanned aerial vehicles (UAVs). In: 2018 26th European signal processing conference (EUSIPCO), IEEE. 2018.
Bhattarai N, Nakamura T, Mozumder C. Real time human detection and localization using consumer grade camera and commercial UAV. 2018.
Park K-Y, Hwang S-Y. An improved Haar-like feature for efficient object detection. Pattern Recognit Lett. 2014;42:148–53.
Li C, et al. Illumination-aware Faster R-CNN for robust multispectral pedestrian detection. Pattern Recognit. 2019;85:161–71.
Huang H, et al. Faster R-CNN for marine organisms detection and recognition using data augmentation. Neurocomputing. 2019;337:372–84.
Li H, Wu Z, Zhang J. Pedestrian detection based on deep learning model. In: 2016 9th international congress on image and signal processing, biomedical engineering and informatics (CISP-BMEI), IEEE. 2016.
Ren S, et al. Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems. 2015.
Tzutalin. LabelImg. 2015; https://github.com/tzutalin/labelImg. Accessed 15 Jan 2020.
He K, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.
Redmon J, Farhadi A. YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017.
Buric M, Pobar M, Ivasic-Kos M. Ball detection using YOLO and mask R-CNN. In: 2018 international conference on computational science and computational intelligence (CSCI), IEEE. 2018.
Mueller M, Smith N, Ghanem B. A benchmark and simulator for UAV tracking. In: European conference on computer vision, Springer. 2016.
Acknowledgements
This paper was fully supported by Universiti Sains Malaysia (USM) Short Term Research Grant (Grant No. 304/PELECT/6315293).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Goon Li Hung, Mohamad Safwan Bin Sahimi, Hussein Samma, Tarik Adnan Almohamad, and Badr Lahasan declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hung, G.L., Sahimi, M.S.B., Samma, H. et al. Faster R-CNN Deep Learning Model for Pedestrian Detection from Drone Images. SN COMPUT. SCI. 1, 116 (2020). https://doi.org/10.1007/s42979-020-00125-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s42979-020-00125-y