A Collaborative Framework for 3D Mapping Using Unmanned Aerial Vehicles

  • Patrick Doherty
  • Jonas Kvarnström
  • Piotr Rudol
  • Marius Wzorek
  • Gianpaolo Conte
  • Cyrille Berger
  • Timo Hinzmann
  • Thomas Stastny
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9862)

Abstract

This paper describes an overview of a generic framework for collaboration among humans and multiple heterogeneous robotic systems based on the use of a formal characterization of delegation as a speech act. The system used contains a complex set of integrated software modules that include delegation managers for each platform, a task specification language for characterizing distributed tasks, a task planner, a multi-agent scan trajectory generation and region partitioning module, and a system infrastructure used to distributively instantiate any number of robotic systems and user interfaces in a collaborative team. The application focusses on 3D reconstruction in alpine environments intended to be used by alpine rescue teams. Two complex UAV systems used in the experiments are described. A fully autonomous collaborative mission executed in the Italian Alps using the framework is also described.

Keywords

Emergency and disaster management Robotics and multi-robot systems Human-robot interaction Distributed planning and collaboration Teamwork Unmanned aircraft systems Middleware and interaction protocols 
This is a preview of subscription content, log in to check access

Notes

Acknowledgments

This work is partially supported by the Swedish Research Council (VR) Linnaeus Center CADICS, the ELLIIT network organization for Information and Communication Technology, the Swedish Foundation for Strategic Research (CUAS Project, SymbiKCloud Project), the EU FP7 project SHERPA (grant agreement 600958), and Vinnova NFFP6 Project 2013-01206.

References

  1. 1.
    Murphy, R.R.: A national initiative in emergency informatics. In: Computing Community Consortium, version 1, 3 November 2010Google Scholar
  2. 2.
    Marconi, L. et al.: The SHERPA project: smart collaboration between humans and ground-aerial robots for improving rescuing activities in alpine environments. In: IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR) (2012)Google Scholar
  3. 3.
    Castelfranchi, C., Falcone, R.: Toward a theory of delegation for agent-based systems. Robot. Auton. Syst. 24, 141–157 (1998)CrossRefGoogle Scholar
  4. 4.
    Falcone, R., Castelfranchi, C.: The human in the loop of a delegated agent: the theory of adjustable social autonomy. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 31(5), 406–418 (2001)CrossRefGoogle Scholar
  5. 5.
    Cohen, P., Levesque, H.: Intention is choice with commitment. Artif. Intell. 42(3), 213–261 (1990)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Doherty, P., Heintz, F., Kvarnström, J.: High-level mission specification and planning for collaborative unmanned aircraft systems using delegation. Unmanned Syst. 1(1), 75–119 (2013)CrossRefGoogle Scholar
  7. 7.
    Austin, J.L.: How to Do Things with Words. Harvard University Press, Cambridge (1975)CrossRefGoogle Scholar
  8. 8.
    Searle, J.R.: Speech Acts: An Essay in the Philosophy of Language. Cambridge University Press, Cambridge (1969)CrossRefGoogle Scholar
  9. 9.
    Doherty, P., Kvarnström, J., Szalas, A.: Temporal composite actions with constraints. In: Proceedings of the 13th International Conference on Principles of Knowledge Representation and Reasoning (KR), pp. 478–488. AAAI Press (2012)Google Scholar
  10. 10.
    FIPA-ACL, FIPA Communicative Act Library Specification. Foundation for Intelligent Physical Agents (2002)Google Scholar
  11. 11.
    Kvarnström, J.: Planning for loosely coupled agents using partial order forward-chaining. In: Proceedings of the 21st International Conference on Automated Planning and Scheduling (ICAPS), pp. 138–145. AAAI Press (2011)Google Scholar
  12. 12.
    Hert, S., Lumelsky, V.: Polygon area decomposition for multiple-robot workspace division. Int. J. Comput. Geom. Appl. 8, 437–466 (1998)MathSciNetCrossRefMATHGoogle Scholar
  13. 13.
    Hinzmann, T., Stastny, T., Conte, G., Doherty, P., Rudol, P., Wzorek, M., Gilitschenski, I., Galceran, E., Siegwart, R.: Collaborative 3D reconstruction using heterogeneous unmanned aerial vehicles. In: International Symposium on Robotics (2016)Google Scholar
  14. 14.
    Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 239–256 (1992)CrossRefGoogle Scholar
  15. 15.
    Chen, Y., Medioni, G.: Object modelling by registration of multiple range images. Image Vis. Comput. 10, 145–155 (1992)CrossRefGoogle Scholar
  16. 16.
    Zhang, Z.: Iterative point matching for registration of free-form curves and surfaces. Int. J. Comput. Vis. 13, 119–152 (1994)CrossRefGoogle Scholar
  17. 17.
    Segal, A., Haehnel, D., Thrun, S.: Generalized-ICP. In: Proceedings of Robotics: Science and Systems, Seattle, USA, June 2009Google Scholar
  18. 18.
    Agamennoni, G., Fontana, S., Siegwart, R.Y., Sorrenti, D.G.: Point clouds registration with probabilistic data association. IEEE (2016, submitted)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Patrick Doherty
    • 1
  • Jonas Kvarnström
    • 1
  • Piotr Rudol
    • 1
  • Marius Wzorek
    • 1
  • Gianpaolo Conte
    • 1
  • Cyrille Berger
    • 1
  • Timo Hinzmann
    • 2
  • Thomas Stastny
    • 2
  1. 1.Department of Computer and Information ScienceLinköping UniversityLinköpingSweden
  2. 2.Autonomous Systems LabETH ZurichZurichSwitzerland

Personalised recommendations