Advertisement

Autonomous Compact Monitoring of Large Areas Using Micro Aerial Vehicles with Limited Sensory Information and Computational Resources

  • Petr Ješke
  • Štěpán Klouček
  • Martin SaskaEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11472)

Abstract

In this paper, a new approach for autonomous real-time monitoring of large areas using small unmanned areal vehicles with limited sensory and computational resources is proposed. Most of the existing solutions of area monitoring require large aerial vehicles to be equipped with a list of expensive sensors and powerful computational resources. Recent progress in Micro Aerial Vehicles (MAVs) allows us to consider their utilization in new tasks, such as the considered compact monitoring, which are dedicated to large well-equipped aerial vehicles so-far only. The proposed solution enables online area monitoring using MAVs equipped with minimal sensory and computational resources and to process the obtained data only with cell phones capabilities, which considerably extends application possibilities of the drone technology. The proposed methodology was verified under various outdoor conditions of real application scenarios with a simple autonomous MAV controlled by the onboard model predictive control in a robotic operation system (ROS), while the user interface was provided on a standard smartphone with Android OS.

Keywords

Autonomous monitoring Micro Aerial Vehicles Surveillance Sensor fusion State estimation Visual reconnaissance 

Notes

Acknowledgments

This research was supported by CTU grant no. SGS17/187/OHK3/3T/13, by the Grant Agency of the Czech Republic under grant no. 17-16900Y and by OP VVV MEYS funded project CZ.02.1.01/0.0/0.0/16_019/0000765 “Research Center for Informatics”.

References

  1. 1.
    Rosjava an implementation of ROS in pure java with android support. https://github.com/rosjava/rosjava_core. Accessed 12 Dec 2017
  2. 2.
    The Autopano stitching software. http://www.kolor.com/autopano. Accessed 12 Dec 2017
  3. 3.
    Adão, T., et al.: Hyperspectral imaging: a review on uav-based sensors, data processing and applications for agriculture and forestry. Remote Sens. 9, 1110 (2017)CrossRefGoogle Scholar
  4. 4.
    Atkar, P.N., Greenfield, A., Conner, D.C., Choset, H., Rizzi, A.A.: Uniform coverage of automotive surface patches. Int. J. Robot. Res. 24(11), 883–898 (2005).  https://doi.org/10.1177/0278364905059058CrossRefGoogle Scholar
  5. 5.
    Baca, T., Hert, D., Loianno, G., Saska, M., Kumar, V.: Model predictive trajectory tracking and collision avoidance for reliable outdoor deployment of unmanned aerial vehicles (2018)Google Scholar
  6. 6.
    Baca, T., Loianno, G., Saska, M.: Embedded model predictive control of unmanned micro aerial vehicles. In: 2016 21st International Conference on Methods and Models in Automation and Robotics (MMAR), pp. 992–997, August 2016.  https://doi.org/10.1109/MMAR.2016.7575273
  7. 7.
    Baca, T., Stepan, P., Saska, M.: Autonomous landing on a moving car with unmanned aerial vehicle. In: 2017 European Conference on Mobile Robots (ECMR), pp. 1–6, September 2017.  https://doi.org/10.1109/ECMR.2017.8098700
  8. 8.
    Cheng, C., Wang, X., Li, X.: UAV image matching based on surf feature and Harris corner algorithm. In: 4th International Conference on Smart and Sustainable City (ICSSC 2017), pp. 1–6, June 2017.  https://doi.org/10.1049/cp.2017.0116
  9. 9.
    Galceran, E., Carreras, M.: A survey on coverage path planning for robotics. Robot. Auton. Syst. 61(12), 1258–1276 (2013).  https://doi.org/10.1016/j.robot.2013.09.004CrossRefGoogle Scholar
  10. 10.
    Ha, Y., Kang, H.: Evaluation of feature based image stitching algorithm using OpenCV. In: 2017 10th International Conference on Human System Interactions (HSI), pp. 224–229, July 2017.  https://doi.org/10.1109/HSI.2017.8005034
  11. 11.
    Honkavaara, E., et al.: Processing and assessment of spectrometric, stereoscopic imagery collected using a lightweight UAV spectral camera for precision agriculture. Remote Sens. 5(10), 5006–5039 (2013).  https://doi.org/10.3390/rs5105006. http://www.mdpi.com/2072-4292/5/10/5006CrossRefGoogle Scholar
  12. 12.
    Swain, K.C., Thomson, S.J., Jayasuriya, H.P.: Adoption of an unmanned helicopter for lowaltitude remote sensing to estimate yield and total biomass of a rice crop. Trans. ASABE 13, 21–27 (2010)CrossRefGoogle Scholar
  13. 13.
    Katsigiannis, P., Misopolinos, L., Liakopoulos, V., Alexandridis, T.K., Zalidis, G.: An autonomous multi-sensor UAV system for reduced-input precision agriculture applications. In: 2016 24th Mediterranean Conference on Control and Automation (MED), pp. 60–64, June 2016.  https://doi.org/10.1109/MED.2016.7535938
  14. 14.
    Piermattei, L.: EGU general assembly (2017)Google Scholar
  15. 15.
    Loianno, G., et al.: Localization, grasping, and transportation of magnetic objects by a team of mavs in challenging desert-like environments. IEEE Robot. Autom. Lett. 3(3), 1576–1583 (2018).  https://doi.org/10.1109/LRA.2018.2800121CrossRefGoogle Scholar
  16. 16.
    Lukas, V., et al.: The combination of UAV survey and landsat imagery for monitoring of crop vigor in precision agriculture. ISPRS-Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. XLI-B8, 953–957 (2016).  https://doi.org/10.5194/isprs-archives-XLI-B8-953-2016
  17. 17.
    MRS CTU: Micro aerial vehicle (2017). http://mrs.felk.cvut.cz/research/micro-aerial-vehicles. Accessed December 2017
  18. 18.
    Ollis, M., Stentz, A.: First results in vision-based crop line tracking. In: Proceedings of IEEE International Conference on Robotics and Automation, vol. 1, pp. 951–956, April 1996.  https://doi.org/10.1109/ROBOT.1996.503895
  19. 19.
    Quigley, M., Gerkey, B., Smart, W.D.: Programming Robots with ROS: A Practical Introduction to the Robot Operating System, 1st edn. O’Reilly Media Inc., Sebastopol (2015)Google Scholar
  20. 20.
    Saska, M., et al.: System for deployment of groups of unmanned micro aerial vehicles in GPS-denied environments using onboard visual relative localization. Auton. Robots 41(4), 919–944 (2017).  https://doi.org/10.1007/s10514-016-9567-zCrossRefGoogle Scholar
  21. 21.
    Sheusi, J.C.: Android Application Development for Java Programmers. Cengage Learning (2012)Google Scholar
  22. 22.
    Spurný, V., et al.: Cooperative autonomous search, grasping, and delivering in a treasure hunt scenario by a team of unmanned aerial vehicles. J. Field Robot. 36(1), 125–148 (2019).  https://doi.org/10.1002/rob.21816. https://onlinelibrary.wiley.com/doi/abs/10.1002/rob.21816CrossRefGoogle Scholar
  23. 23.
    Szeliski, R.: Image alignment and stitching: a tutorial, October 2004. https://www.microsoft.com/en-us/research/publication/image-alignment-and-stitching-a-tutorial/
  24. 24.
    Štěpán, P., Krajník, T., Petrlk, M., Saska, M.: Vision techniques for on-board detection, following, and mapping of moving targets. J. Field Robot. 36, 252–269 (2018).  https://doi.org/10.1002/rob.21850CrossRefGoogle Scholar
  25. 25.
    Yasutomi, F., Yamada, M., Tsukamoto, K.: Cleaning robot control. In: Proceedings of 1988 IEEE International Conference on Robotics and Automation, pp. 1839–1841, vol. 3, April 1988.  https://doi.org/10.1109/ROBOT.1988.12333
  26. 26.
    Zelinsky, A., Jarvis, R., Byrne, J.C., Yuta, S.: Planning paths of complete coverage of an unstructured environment by a mobile robot. In: Proceedings of International Conference on Advanced Robotics, pp. 533–538 (1993)Google Scholar
  27. 27.
    Zhang, C., Kovacs, J.M.: The application of small unmanned aerial systems for precision agriculture: a review. Precision Agric. 13(6), 693–712 (2012).  https://doi.org/10.1007/s11119-012-9274-5CrossRefGoogle Scholar
  28. 28.
    Zhou, X., Zhang, H., Wang, Y.: A multi-image stitching method and quality evaluation. In: 2017 4th International Conference on Information Science and Control Engineering (ICISCE), pp. 46–50, July 2017.  https://doi.org/10.1109/ICISCE.2017.20
  29. 29.
    Zhu, L., Wang, Y., Zhao, B., Zhang, X.: A fast image stitching algorithm based on improved surf. In: 2014 Tenth International Conference on Computational Intelligence and Security, pp. 171–175, November 2014.  https://doi.org/10.1109/CIS.2014.67

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of CyberneticsCzech Technical University in PraguePragueCzech Republic

Personalised recommendations