Skip to main content
Log in

Faster R-CNN Deep Learning Model for Pedestrian Detection from Drone Images

  • Original Research
  • Published:
SN Computer Science Aims and scope Submit manuscript

Abstract

Pedestrian detection from a drone-based images has many potential applications such as searching for missing persons, surveillance of illegal immigrants, and monitoring of critical infrastructure. However, it is considered as a very challenge computer vision problem due to the variations in camera point of view, distance from pedestrian, changes in illuminations and weather conditions, variation in the surrounding objects, as well as present of human-like objects. Recently, deep learning-based models are getting more attention, and they have proven a great success in many object detection problems such as the detection of faces, breast masses, and vehicles. As such, this work aims to develop a deep learning-based model that will be applied for the problem of pedestrian detection from a drone-based images. Particularly, faster region-based convolutional neural network (Faster R-CNN) will be used to search for the present of a pedestrian inside the captured drone-based images. To assess the performances, a total of 1500 images were collected by S30W drone and these images were captured at different places, with various views and weather conditions, and at daytime and night-time. Results show that Faster R-CNN was able to achieve a promising result with 98% precision, 99% recall, and 98% F1 measure. Further analysis has been conducted by comparing the outcomes of Faster R-CNN with YOLO deep model on UAV123 publicly available dataset. The reported results indicated that both detection models almost reported very similar results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Times NS. Over 1,800 teenagers, children went missing last year. 2017; https://www.nst.com.my/news/nation/2017/11/303741/over-1800-teenagers-children-went-missing-last-year. Accessed 15 Jan 2020.

  2. Zhang H, et al. Pedestrian detection method based on Faster R-CNN. In: 2017 13th international conference on computational intelligence and security (CIS), IEEE. 2017.

  3. Lan W, et al. Pedestrian detection based on YOLO network model. In: 2018 IEEE international conference on mechatronics and automation (ICMA), IEEE. 2018.

  4. Yi Z, Yongliang S, Jun Z. An improved tiny-yolov3 pedestrian detection algorithm. Optik. 2019;183:17–23.

    Article  Google Scholar 

  5. Dalal N, Triggs B. Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR'05). vol. 1. IEEE; 2005. pp. 886–893.

  6. Chowdhury SA, Kowsar MMS, Deb K. Human detection utilizing adaptive background mixture models and improved histogram of oriented gradients. ICT Express. 2018;4(4):216–20.

    Article  Google Scholar 

  7. Zhu Q, et al. Fast human detection using a cascade of histograms of oriented gradients. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), IEEE. 2006.

  8. Wei Y, Tian Q, Guo T. An improved pedestrian detection algorithm integrating haar-like features and hog descriptors. Adv Mech Eng. 2013;5:546206.

    Article  Google Scholar 

  9. Seemanthini K, Manjunath S. Human detection and tracking using HOG for action recognition. Procedia Comput Sci. 2018;132:1317–26.

    Article  Google Scholar 

  10. Fradi H, et al. Autonomous person detection and tracking framework using unmanned aerial vehicles (UAVs). In: 2018 26th European signal processing conference (EUSIPCO), IEEE. 2018.

  11. Bhattarai N, Nakamura T, Mozumder C. Real time human detection and localization using consumer grade camera and commercial UAV. 2018.

  12. Park K-Y, Hwang S-Y. An improved Haar-like feature for efficient object detection. Pattern Recognit Lett. 2014;42:148–53.

    Article  Google Scholar 

  13. Li C, et al. Illumination-aware Faster R-CNN for robust multispectral pedestrian detection. Pattern Recognit. 2019;85:161–71.

    Article  Google Scholar 

  14. Huang H, et al. Faster R-CNN for marine organisms detection and recognition using data augmentation. Neurocomputing. 2019;337:372–84.

    Article  Google Scholar 

  15. Li H, Wu Z, Zhang J. Pedestrian detection based on deep learning model. In: 2016 9th international congress on image and signal processing, biomedical engineering and informatics (CISP-BMEI), IEEE. 2016.

  16. Ren S, et al. Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems. 2015.

  17. Tzutalin. LabelImg. 2015; https://github.com/tzutalin/labelImg. Accessed 15 Jan 2020.

  18. He K, et al. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.

  19. Redmon J, Farhadi A. YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2017.

  20. Buric M, Pobar M, Ivasic-Kos M. Ball detection using YOLO and mask R-CNN. In: 2018 international conference on computational science and computational intelligence (CSCI), IEEE. 2018.

  21. Mueller M, Smith N, Ghanem B. A benchmark and simulator for UAV tracking. In: European conference on computer vision, Springer. 2016.

Download references

Acknowledgements

This paper was fully supported by Universiti Sains Malaysia (USM) Short Term Research Grant (Grant No. 304/PELECT/6315293).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hussein Samma.

Ethics declarations

Conflict of interest

Goon Li Hung, Mohamad Safwan Bin Sahimi, Hussein Samma, Tarik Adnan Almohamad, and Badr Lahasan declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hung, G.L., Sahimi, M.S.B., Samma, H. et al. Faster R-CNN Deep Learning Model for Pedestrian Detection from Drone Images. SN COMPUT. SCI. 1, 116 (2020). https://doi.org/10.1007/s42979-020-00125-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s42979-020-00125-y

Keywords

Navigation