Advertisement

A Technique About Neural Network for Passageway Detection

  • Pedro Lucas de Brito
  • Félix Mora-Camino
  • Luiz Gustavo Miranda Pinto
  • José Renato Garcia Braga
  • Alexandre C. Brandão RamosEmail author
  • Hildebrando F. Castro Filho
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 800)

Abstract

This article brings a proposal to implement a passageway detector for a drone, like windows, doors, holes etc. In this case, it was applied on the model Tello of Ryze Tech. The modeling technique uses a Neural Convolutional Deep Learning Network, with a pre-supervised training. This training is done with three image classes: unobstructed path, obstructed path, and the passageway inside of the path, to a specific environment, such as a school or a hospital. After the detection of a way defined by the user, the technique uses image filters to find a polygon through the window and compare the returned data with the values stored in the neural network dataset. To find the best parameters to identify the passage in the processing, the algorithm makes an adjustment through parameters interpolation that allows the drone to perceive its crossing for many cases of environmental variations. The Network model used is the SSD implemented on Google’s TensorFlow framework and for the image processing, it uses filters and functions from OpenCV library, where both codes are implemented in Python programming language.

Keywords

Image processing Neural network Deep learning Supervised training Quadrotor Drone Passageway detection Way detection Window detection Door detection 

Notes

Acknowledgment

The authors would like to gratefully thank the founding institution CAPES.

References

  1. 1.
    Barták, R., Vyskovský, A.: Any Object Tracking and Following by a Flying Drone. Charles University in Prague, Faculty of Mathematics and Physics, Prague (2015)CrossRefGoogle Scholar
  2. 2.
    Martins, W.M., Braga, R.G., Ramos, A.C.B., Camino, F.M.: A computer vision based algorithm for obstacle avoidance. In: Springer International Publishing AG. (Org.) (ed.) Advances in Intelligent Systems and Computing, vol. 738, 1st edn, pp. 569–575. Springer International Publishing AG, Las Vegas (2018)Google Scholar
  3. 3.
    Ramos, A.C.B., Shiguemori, E.H., Serokhvostov, S.V., Gupta, P.K., Zhong, L., Hu, X.B.: Solar-powered UAV platform system: a case study for ground change detection in BRIC countries. In: Advances in Intelligent Systems and Computing, vol. 738, 1st edn, pp. 613–618. Springer International Publishing AG, Las Vegas (2018)Google Scholar
  4. 4.
    TelloPy Library. Available in: https://github.com/hanyazou/TelloPy
  5. 5.
    Vargas, A., Paes, A., Vasconcelos N.: Um Estudo sobre Redes Neurais Convolucionais e sua Aplicação em Detecção de Pedestres. Institute of Computing from Federal University Fluminense Niterói (2016)Google Scholar
  6. 6.
    Girshick, R.: Fast R-CNN. In: The IEEE International Conference on Computer Vision ICCV, Las Condes, Chile (2015)Google Scholar
  7. 7.
    He, K., Zhang, X., Ren, S., Sun, J.: Spatial pyramid pooling in deep convolutional networks for visual recognition. In: European Conference on Computer Vision ECCV, Zurich, Switzerland (2014)Google Scholar
  8. 8.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Neural Information Processing Systems NIPS, Montréal Canada (2015)Google Scholar
  9. 9.
    Liu, W., Anguelov, D., Erhan, D., Szegedy, C.: SSD: Single Shot MultiBox Detector. From University of Michigan In: European Conference on Computer Vision ECCV, Amsterdam, The Netherlands (2016)Google Scholar
  10. 10.
    Ning, C.; Zhou, H.; Song, Y.; Tang, J.: Inception single shot multibox detector for object detection. In: IEEE International Conference on Multimedia & Expo Workshops ICMEW, Hong Kong (2017)Google Scholar
  11. 11.
    TensorFlow. Available in: https://www.tensorflow.org
  12. 12.
  13. 13.
    Venugopala, P.S., Sarojadevi, H., Ankitha, A., Niranjan, N.: An Approach to Improvise Canny Edge Detection using Morphological FiltersGoogle Scholar
  14. 14.
    Lee, K., Lee, Y.: Threshold boolean filter. IEEE T. SIGNAL PROCES. 42(8), (1994)Google Scholar
  15. 15.
  16. 16.
  17. 17.
    Braga, R.G., da Silva, R.C., Ramos, A.C.B., Mora-Camino, F.: Collision avoidance based on reynolds rules: a case study using quadrotors. In: Advances in Intelligent Systems and Computing, 1st edn. Springer International Publishing, Las Vegas (2018)Google Scholar
  18. 18.
    PixHawk. Available in: http://pixhawk.org/
  19. 19.
    ROS. Available in: http://www.ros.org/
  20. 20.

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Pedro Lucas de Brito
    • 1
  • Félix Mora-Camino
    • 2
  • Luiz Gustavo Miranda Pinto
    • 1
  • José Renato Garcia Braga
    • 3
  • Alexandre C. Brandão Ramos
    • 1
    Email author
  • Hildebrando F. Castro Filho
    • 4
  1. 1.Institute of Mathematics and ComputingFederal University of ItajubáItajubáBrazil
  2. 2.Federal Fluminense University, Brazil ComputingRio De JaneiroBrazil
  3. 3.Nacional Research Institute (INPE)São José dos CamposBrazil
  4. 4.Aeronautical Institute of Technology, Brazil ComputingRio De JaneiroBrazil

Personalised recommendations