Skip to main content

Augmented Reality for Real-Time Control of a Robotic Arm with IoT Connection

  • Conference paper
  • First Online:
Doctoral Symposium on Information and Communication Technologies (DSICT 2022)

Abstract

Augmented Reality (AR) is one of the most important technologies that takes part in the Fourth Industrial Revolution, and for this reason, this document presents the development of an AR application for real-time control of a Robotic Arm with IoT communication. The application provides AR visualization of the state of the process in real-time, as well as an interface for controlling the position of the robotic arm. The document presents a detailed description of the hardware architecture that includes the AR device, the AR marker, and the infrastructure used for interacting with the robot. In addition, it is presented the architecture of the software for communication of the AR application with the process, to establish remote and real-time control of the position of the robotic arm using IoT. The AR application has been tested with a robotic arm used in the field of medicine, participating in the analysis process of blood chemistry in biological tests carried out in clinical laboratories. The development of this application has various advantages, highlighting the use of low-cost technological devices, easy acquisition, and the remote connection that improves the control efficiency of the robot, improving the security for user integrity because he/she is not exposed to dangerous environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 84.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Guhl, J., Nguyen, S.T., Krüger, J.: Concept and architecture for programming industrial robots using augmented reality with mobile devices like microsoft HoloLens. In: IEEE International Conference on Emerging Technologies and Factory Automation, ETFA, pp. 1–4 (2017). https://doi.org/10.1109/ETFA.2017.8247749. Author, F., Author, S.: Title of a proceedings paper. In: Editor, F., Editor, S. (eds.) Conference 2016, LNCS, vol. 9999, pp. 1–13. Springer, Heidelberg (2016)

  2. Caiza, G., Bonilla-Vasconez, P., Garcia, C.A., Garcia, M.V.: Augmented reality for robot control in low-cost automation context and IoT. IEEE International Conference on Emerging Technologies and Factory Automation, ETFA, vol. 2020-Septe, no. i, pp. 1461–1464 (2020). https://doi.org/10.1109/ETFA46521.2020.9212056. Author, F.: Contribution title. In: 9th International Proceedings on Proceedings, pp. 1–2. Publisher, Location (2010)

  3. Bravo, D.C.: Aplicación de asistencia basada en realidad aumentada para la industria (2019)

    Google Scholar 

  4. Masoni, R., et al.: Supporting remote maintenance in industry 4.0 through augmented reality. Procedia Manufact. 11(June), 1296–1302 (2017). https://doi.org/10.1016/j.promfg.2017.07.257

    Article  Google Scholar 

  5. Maly, I., Sedlacek, D., Leitao, P.: Augmented reality experiments with industrial robot in industry 4.0 environment. In: IEEE International Conference on Industrial Informatics (INDIN), vol. 0, pp. 176–181 (2016).https://doi.org/10.1109/INDIN.2016.7819154

  6. Pierdicca, R., Frontoni, E., Pollini, R., Trani, M., Verdini, L.: The use of augmented reality glasses for the application in industry 4.0. In: De Paolis, L.T., Bourdot, P., Mongelli, A. (eds.) AVR 2017. LNCS, vol. 10324, pp. 389–401. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-60922-5_30

    Chapter  Google Scholar 

  7. Hashimoto, S., Ishida, A., Inami, M., Igarash, T.: TouchMe: an augmented reality based remote robot manipulation. In: The 21st International Conference on Artificial Reality and Telexistence (ICAT), pp. 1–6 (2011)

    Google Scholar 

  8. Mourtzis, D., Zogopoulos, V., Vlachou, E.: Augmented reality application to support remote maintenance as a service in the robotics industry. Procedia CIRP 63, 46–51 (2017). https://doi.org/10.1016/j.procir.2017.03.154

    Article  Google Scholar 

  9. Peña-Tapia, E., Roldán, J.J., Garzón, M., Martín-Barrio, A., Barrientos, A.: Interfaz de control para un robot manipulador mediante realidad virtual, pp. 829–835 (2020). https://doi.org/10.17979/spudc.9788497497749.0829

  10. Cañadillas, F., Jardón, J., Balaguer, C.: Diseño preliminar de interfaces de realidad aumentada para el robot asistencial ASIBOT (2013)

    Google Scholar 

  11. Romero, M.A., Hernández, W., Abreu, D.P.: NxtAR : un sistema de control para robots móviles basado en realidad aumentada, pp. 147–159

    Google Scholar 

  12. Reina, M., González, M., Francisco, C., Galicia, A., Flores, P., Manuel, J., Marcadores para la realidad aumentada para fines educativos. http://www.redalyc.org/articulo.oa?id=512251564004

  13. Alvarez-Marin, A., Castillo-Vergara, M., Pizarro-Guerrero, J., Espinoza-Vera, E.: Realidad aumentada como apoyo a la formación de ingenieros industriales. Formacion Universitaria 10(2), 31–42 (2017). https://doi.org/10.4067/S0718-50062017000200005

    Article  Google Scholar 

  14. Durani, H., Sheth, M., Vaghasia, M., Kotech, S.: Smart automated home application using IoT with Blynk app. In: Proceedings of the International Conference on Inventive Communication and Computational Technologies, ICICCT 2018, pp. 393–397, September 2018. https://doi.org/10.1109/ICICCT.2018.8473224

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gustavo Caiza .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Montenegro, G., Salvador, J., Caiza, G. (2022). Augmented Reality for Real-Time Control of a Robotic Arm with IoT Connection. In: Abad, K., Berrezueta, S. (eds) Doctoral Symposium on Information and Communication Technologies. DSICT 2022. Communications in Computer and Information Science, vol 1647. Springer, Cham. https://doi.org/10.1007/978-3-031-18347-8_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-18347-8_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-18346-1

  • Online ISBN: 978-3-031-18347-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics