Advertisement

Crowd Detection for Drone Safe Landing Through Fully-Convolutional Neural Networks

  • Giovanna Castellano
  • Ciro Castiello
  • Corrado Mencar
  • Gennaro VessioEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12011)

Abstract

In this paper, we propose a novel crowd detection method for drone safe landing, based on an extremely light and fast fully convolutional neural network. Such a computer vision application takes advantage of the technical tools some commercial drones are equipped with. The proposed architecture is based on a two-loss model in which the main classification task, aimed at distinguishing between crowded and non-crowded scenes, is simultaneously assisted by a regression task, aimed at people counting. In addition, the proposed method provides class activation heatmaps, useful to semantically augment the flight maps. To evaluate the effectiveness of the proposed approach, we used the challenging VisDrone dataset, characterized by a very large variety of locations, environments, lighting conditions, and so on. The model developed by the proposed two-loss deep architecture achieves good values of prediction accuracy and average precision, outperforming models developed by a similar one-loss architecture and a more classic scheme based on MobileNet. Moreover, by lowering the confidence threshold, the network achieves very high recall, without sacrificing too much precision. The method also compares favorably with the state-of-the-art, providing an effective and efficient tool for several safe drone applications.

Keywords

Unmanned aerial vehicles Crowd detection Public safety Safe landing Computer vision Convolutional neural networks 

Notes

Acknowledgement

The research is supported by Ministero dell’Istruzione, del-l’ Università e della Ricerca (MIUR) under grant PON ARS01_00820 “RPASInAir – Integrazione dei Sistemi Aeromobili a Pilotaggio Remoto nello spazio aereo non segregato per servizi”.

References

  1. 1.
    Boominathan, L., Kruthiventi, S.S., Babu, R.V.: CrowdNet: a deep convolutional network for dense crowd counting. In: Proceedings of the 24th ACM International Conference on Multimedia, pp. 640–644. ACM (2016)Google Scholar
  2. 2.
    Castelli, T., Sharghi, A., Harper, D., Tremeau, A., Shah, M.: Autonomous navigation for low-altitude UAVs in urban areas. arXiv preprint arXiv:1602.08141 (2016)
  3. 3.
    Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., Adam, H.: MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)
  4. 4.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  5. 5.
    Küchhold, M., Simon, M., Eiselein, V., Sikora, T.: Scale-adaptive real-time crowd detection and counting for drone images. In: 2018 25th IEEE International Conference on Image Processing (ICIP), pp. 943–947. IEEE (2018)Google Scholar
  6. 6.
    Lin, S., Garratt, M.A., Lambert, A.J.: Monocular vision-based real-time target recognition and tracking for autonomously landing an UAV in a cluttered shipboard environment. Auton. Robots 41(4), 881–901 (2017)CrossRefGoogle Scholar
  7. 7.
    Marcu, A., Costea, D., Licaret, V., Pirvu, M., Slusanschi, E., Leordeanu, M.: SafeUAV: learning to estimate depth and safe landing areas for UAVs from synthetic data. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 0–0 (2018)Google Scholar
  8. 8.
    Mukadam, K., Sinh, A., Karani, R.: Detection of landing areas for unmanned aerial vehicles. In: 2016 International Conference on Computing Communication Control and Automation (ICCUBEA), pp. 1–5. IEEE (2016)Google Scholar
  9. 9.
    Nguyen, P., Arsalan, M., Koo, J., Naqvi, R., Truong, N., Park, K.: LightDenseYOLO: a fast and accurate marker tracker for autonomous UAV landing by visible light camera sensor on drone. Sensors 18(6), 1703 (2018) CrossRefGoogle Scholar
  10. 10.
    Polvara, R., Sharma, S., Wan, J., Manning, A., Sutton, R.: Towards autonomous landing on a moving vessel through fiducial markers. In: 2017 European Conference on Mobile Robots (ECMR), pp. 1–6. IEEE (2017)Google Scholar
  11. 11.
    Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., Batra, D.: Grad-CAM: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 618–626 (2017)Google Scholar
  12. 12.
    Tzelepi, M., Tefas, A.: Human crowd detection for drone flight safety using convolutional neural networks. In: 2017 25th European Signal Processing Conference (EUSIPCO), pp. 743–747. IEEE (2017)Google Scholar
  13. 13.
    Tzelepi, M., Tefas, A.: Graph embedded convolutional neural networks in human crowd detection for drone flight safety. IEEE Trans. Emerg. Top. Comput. Intell. (2019).  https://doi.org/10.1109/TETCI.2019.2897815
  14. 14.
    Valavanis, K.P., Vachtsevanos, G.J.: Handbook of Unmanned Aerial Vehicles. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  15. 15.
    Zeng, Y., Zhang, R., Lim, T.J.: Wireless communications with unmanned aerial vehicles: opportunities and challenges. IEEE Commun. Mag. 54(5), 36–42 (2016)CrossRefGoogle Scholar
  16. 16.
    Zhang, C., Li, H., Wang, X., Yang, X.: Cross-scene crowd counting via deep convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 833–841 (2015)Google Scholar
  17. 17.
    Zhu, P., Wen, L., Bian, X., Ling, H., Hu, Q.: Vision meets drones: a challenge. arXiv preprint arXiv:1804.07437 (2018)

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Giovanna Castellano
    • 1
  • Ciro Castiello
    • 1
  • Corrado Mencar
    • 1
  • Gennaro Vessio
    • 1
    Email author
  1. 1.Department of Computer ScienceUniversity of BariBariItaly

Personalised recommendations