Skip to main content
SpringerLink
Log in

Autonomous Navigation of Multiple Robots with Sensing and Communication Constraints Based on Mixed Reality

Journal of Control, Automation and Electrical Systems volume 31, pages 1165–1176 (2020)Cite this article

We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

This paper presents a robotic navigation system that uses mixed reality concepts to develop sensing and communication virtual devices, based on the visual localization of the robot in the environment. The main objective of the navigation system is to provide conditions for the use of very simple robots with severe limitations on the mentioned peripheral devices for simulation, analysis and test of multi-robot applications. In an experiment with real robots, each one receives its virtual navigation skills in an independent way from the tool that emulates the function of such peripherals. Thus, the behavior of a group of robots, independently commanded, is implemented in the virtual environment and accomplished in the real world. An experiment composed by real multiple Sphero robots executing an exploratory task within an unknown dynamic environment is carried out to validate the proposed navigation system. The use of mixed reality concepts allows an easy implementation of cooperation mechanisms based on indirect communication skill and fuzzy controllers for the robots’ movement. The results confirm the feasibility of the proposed autonomous navigation system.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Notes

  1. http://wiki.ros.org.

  2. https://sphero.com/collections/for-school

  3. https://github.com/darin-costello/sphero

  4. http://wiki.ros.org/ar_track_alvar.

  5. http://wiki.ros.org/costmap_2d.

  6. http://wiki.ros.org/rviz.

  7. https://youtu.be/BgoTA0FDzgQ

References

  • Almeida, J. P. L. S., Nakashima, R. T., Neves-Jr, F., & de Arruda, L. V. R. (2019). Bio-inspired on-line path planner for cooperative exploration of unknown environment by a multi-robot system. Robotics and Autonomous Systems, 112, 32–48. https://doi.org/10.1016/j.robot.2018.11.005.

    Article  Google Scholar 

  • Antoun, A., Valentini, G., Hocquard, E., Wiandt, B., Trianni, V., & Dorigo, M. (2016). Kilogrid: A modular virtualization environment for the kilobot robot. In 2016 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 3809–3814). https://doi.org/10.1109/IROS.2016.7759560.

  • Arvin, F., Krajník, T., Turgut, A. E., & Yue, S. (2015). Cos: Artificial pheromone system for robotic swarms research. In 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 407–412). https://doi.org/10.1109/IROS.2015.7353405.

  • da Silva Guerra, R., Boedecker, J., Mayer, N., Yanagimachi, S., Hirosawa, Y., Yoshikawa, K., Namekawa, M., Asada, M. (2006). Citizen eco-be! league: Bringing new flexibility for research and education to robocup. In Proceedings of the meeting of special interest group on AI challenges (vol. 23, pp. 13–18).

  • da Silva Guerra, R., Boedecker, J., Mayer, N., Yanagimachi, S., Ishiguro, H., & Asada, M. (2007a). A new minirobotics system for teaching and researching agent-based programming. In Computers and advanced technology in education (pp. 39–44).

  • da Silva Guerra, R., Boedecker, J., Yamauchi, K., Maekawa, T., Asada, M., Hirosawa, Y., Namekawa, M., Yoshikawa, K., Yanagimachi, S., Masubuchi, S., & Nishimura, K. (2007b). Citizen eco-be! and the robocup physical visualization league.

  • Dorigo, M., Birattari, M., & Stützle, T. (2006). Ant colony optimization—Artificial ants as a computational intelligence technique. IEEE Computational Intelligence Magazine, 1, 28–39.

    Article  Google Scholar 

  • Dorigo, M., Maniezzo, V., & Colorni, A. (1996). Ant system: Optimization by a colony of cooperating agents. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 26(1), 29–41. https://doi.org/10.1109/3477.484436.

    Article  Google Scholar 

  • Fiala, M. (2005). Artag, a fiducial marker system using digital techniques. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05) (Vol. 2, pp. 590–596 ). https://doi.org/10.1109/CVPR.2005.74.

  • Gerndt, R., Schridde, C., & da Silva Guerra, R. (2008). On the aspects of simulation in the robocup mixed reality soccer systems. In Workshop at international conference on simulation, modeling and programming for autonomous robots (pp. 159–166).

  • Hönig, W., Milanes, C., Scaria, L., Phan, T., Bolas, M., & Ayanian, N. (2015). Mixed reality for robotics. In 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 5382–5387). https://doi.org/10.1109/IROS.2015.7354138.

  • Millard, A. G., Redpath, R., Jewers, A. M., Arndt, C., Joyce, R., Hilder, J. A., et al. (2018). Ardebug: An augmented reality tool for analysing and debugging swarm robotic systems. Frontiers in Robotics and AI, 5, 87. https://doi.org/10.3389/frobt.2018.00087.

    Article  Google Scholar 

  • Passino, K. M., & Yurkovich, S. (1998). Fuzzy control. Boston: Addison-Wesley.

    MATH  Google Scholar 

  • Quigley, M., Conley, K., Gerkey, B. P., Faust, J., Foote, T., Leibs, J., Wheeler, R., & Ng, A. Y. (2009). ROS: An open-source robot operating system. In ICRA workshop on open source software.

  • Reina, A., Cope, A. J., Nikolaidis, E., Marshall, J. A. R., & Sabo, C. (2017). Ark: Augmented reality for kilobots. IEEE Robotics and Automation Letters, 2(3), 1755–1761. https://doi.org/10.1109/LRA.2017.2700059.

    Article  Google Scholar 

  • Reina, A., Salvaro, M., Francesca, G., Garattoni, L., Pinciroli, C., Dorigo, M., & Birattari, M. (2015). Augmented reality for robots: Virtual sensing technology applied to a swarm of e-pucks. In 2015 NASA/ESA conference on adaptive hardware and systems (AHS) (pp. 1–6). https://doi.org/10.1109/AHS.2015.7231154.

  • Sabattini, L., Secchi, C., & Fantuzzi, C. (2017). Multi-robot systems implementing complex behaviors under time-varying topologies. European Journal of Control, 38, 73–87. https://doi.org/10.1016/j.ejcon.2017.08.006.

    Article  MathSciNet  MATH  Google Scholar 

  • Santos, H. B., Teixeira, M. A. S., de Oliveira, A. S., de Arruda, L. V. R., & Neves, F. (2017). Control of mobile robots using actionlib. In A. Koubaa (Ed.), Robot operating system (ROS): The complete reference (volume 2) (pp. 161–189). Cham: Springer.

    Chapter  Google Scholar 

  • Simões, M. A. C., de Souza, J. R., de Assis Moura Pimentel, F., & Frias, D. (2011). Mr-simulator: A simulator for the mixed reality competition of robocup. In: J. Ruiz-del Solar, E. Chown, & P. G. Plöger (eds.) RoboCup 2010: Robot soccer world cup XIV (pp. 82–96). Berlin, Heidelberg: Springer.

Download references

Author information

Authors and Affiliations

  1. Federal Institute of Paraná (IFPR), Jacarezinho, Paraná, Brazil

    João Paulo Lima Silva de Almeida

  2. Federal University of Technology - Paraná (UTFPR), Curitiba, Brazil

    Renan Taizo Nakashima, Flávio Neves-Jr, André Schneider de Oliveira & Lúcia Valéria Ramos de Arruda

Authors
  1. João Paulo Lima Silva de Almeida
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Renan Taizo Nakashima
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Flávio Neves-Jr
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. André Schneider de Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lúcia Valéria Ramos de Arruda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to João Paulo Lima Silva de Almeida.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The authors acknowledge financial support from Brazilian Research Council (CNPq): Grants 305816/2014-4 and 309119/2015-4.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 7260 KB)

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

de Almeida, J.P.L.S., Nakashima, R.T., Neves-Jr, F. et al. Autonomous Navigation of Multiple Robots with Sensing and Communication Constraints Based on Mixed Reality. J Control Autom Electr Syst 31, 1165–1176 (2020). https://doi.org/10.1007/s40313-020-00629-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40313-020-00629-1

Keywords

search

Navigation