Abstract
The document proposes the development of a 3D virtual environment, oriented to the common work activities between a unicycle type mobile manipulator robot and a human operator, in collaborative tasks. This strategy is focuses on the incorporation of virtual reality (VR), in which the operator will have access to visualize in an immersive way the behavior of the mobile manipulator robot in common tasks where the human being and the mobile manipulator robot interact. For the interaction between the human operator and the mobile manipulator robot, the graphic engine Unity 3D is used, which exchanges information with the mathematical software Matlab, in order to execute the control algorithm through the use of shared memories. The Novint Falcon haptic device allows human-robot interaction, which provides the operator with force feedback on what is happening in the virtual environment generated by the Unity 3D software and the interaction it has with the mobile manipulator. The HTC Vive immersion device allows the operator to visualize the virtual environment created for the execution of the task. In this work, the design and simulation of the locomotion system of a mobile manipulator robot is carried out for manipulation and object transfer tasks together with the human operator. Finally, the simulation results that validate the proposed control strategy are presented and discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Beck, S., Kunert, A., Kulik, A., Froehlich, B.: Immersive group-to-group telepresence. IEEE Trans. Visual. Comput. Graph. 19(4), 616–625 (2013)
Selzer, M., Gazcón, N., Nagel, J.T., Larrea, M., Castro, S., Bjerg, E.: Tecnologías Inmersivas Aplicadas: Realidad Virtual y Aumentada. In: XX Workshop de Investigadores en Ciencias de la Computación, pp. 366–370 (2018)
Pilatásig, M., Tobar, E., Paredes, L., Silva, F.M., Acurio, A., Pruna, E., Escobar, I., Sánchez, Z.: Virtual system for teaching-learning of initial education using a haptic device. Springer International Publishing AG, vol. AVR 2018, pp. 118–132 (2018)
Pruna, E., Rosero, M., Pogo, R., Escobar, I., Acosta, J.: Virtual reality as a tool for the cascade control learning. Springer International Publishing AG., vol. AVR 2018, pp. 243–251 (2018)
Gutiérrez-Maldonado, J., Alsina-Jurnet, I., Carvallo-Becíu, C., Letosa-Porta, A., Magallón-Neri, E.: Aplicaciones clínicas de la realidad virtual en el ámbito escolar. In: Medicina psicosomatica y psiquiatrica en enlace, nº 82, pp. 32–51 (2007)
Hilera, J.R., Otón, S., Martínez, J.: Aplicación de la realidad virtual en la enseñanza a través de internet, vol. 8, pp. 25–35 (1999)
Jiménez, S.M.S., Macías J.L.H., Lumbreras, M.A.M.: La Revolución Industrial a través de Realidad Virtual. Revista Iztatl Computación 13(7), 56–64 (2018)
Garcia, R.: Realidad virtual como herramienta en fisioterapia, ficción o realiad. ScienceDirect 40, 1–3 (2018)
Escobar, I., Gálvez, C., Corrales, G., Pruna, E., Pilatasig, M., Montaluisa, J.: Virtual System using haptic devicefor real-time tele-rehabilitationof upper limbs. Springer International Publishing AG., vol. AVR 2018, pp. 136–152 (2018)
Herrera, D.F., Acosta, S.B., Quevedo, W.X., Balseca, J.A., Andaluz, V.H.: Training for bus bodywork in virtual realityenvironments. Springer International Publishing AG., vol. AVR 2018, pp. 67–85 (2018)
Zhang, Y., Wang, Z.: Towards Visual Comfort: Disciplines on the Scene Structure Design for VR Contents,» Springer International Publishing AG., vol. AVR 2018, pp. 190–196 (2018)
Pace, F.D., Manuri, F., Sanna, A., Zappia, D.: An Augmented Interface to DisplayIndustrial Robot Faults. Springer International Publishing AG., vol. AVR 2018, pp. 403–421 (2018)
López, V.M., Zambrano, P.A., Pilatasig, M., Silva, F.M.: Interactive System Using Myoelectric MuscleSensors for the Strengthening Upper Limbsin Children. Springer International Publishing AG., vol. AVR 2018, pp. 18–29 (2018)
Ortiz, J.S., Sánchez, J.S., Velasco, P.M., Quevedo, W.X., Carvajal, C.P., Morales, V., Ayala, P., Andaluz, V.H.: Virtual Training for Industrial Automation Processes Through Pneumatic Controls. Springer International Publishing AG, vol. AVR 2018, pp. 516–532 (2018)
Roldán, J.J., Garcia-Aunon, P., Garzón, M., Garzón, M., de León, J., del Cerro, J., Barrientos, A.: Heterogeneous multi-robot system for mappingenvironmental variables of greenhouses. In: Centre for Automation and Robotics (UPM-CSIC), nº 1018, pp. 1–24 (2016)
Lin, A., Milshteyn, A., Herman, G., Garcia, M., Liu, C., Rad, K., Guillaume, D., Boussalis, H.: Virtual reality head-tracking observation system for mobile robot. In: Mediterranean Conference on Embedded Computing, nº 3, pp. 152–157 (2014)
Matsas, E., Vosniakos, G.-C.: Design of a virtual reality training system for human–robot collaboration in manufacturing tasks. Springer-Verlag France 2015, nº 15780, pp. 139–153 (2015)
Su, H., Yang, C., Ferrigno, G., Momi, E.D.: Improved human–robot collaborative control of redundant robot for teleoperated minimally invasive surgery. IEEE Robotics Autom. Lett. 4(2), 1447–1453 (2019)
Andaluz, V.H., Leica, P., Roberti, F., Toibero, M., Carelli, R.: Adaptive coordinated cooperative controlof multi-mobile manipulators. Frontiers in Advanced Control Systems, pp. 163–190 (2012)
Chheang, V., Saalfeld, P., Huber, T., Huettl, F., Kneist, W., Preim, B., Hansen, C.: Collaborative virtual reality for laparoscopic liver surgery training. In: Conference on Artificial Intelligence and Virtual Reality (AIVR) 2019, pp. 1–9 (2019)
Carvajal, C.P., Méndez, M.G, Torres, D.C., Terán, C., Arteaga, O.B., Andaluz, V.H.: Autonomous and tele-operated navigation of aerial manipulator robots in digitalized virtual environments. Springer International Publishing AF, vol. AVR 2018, pp. 496–515 (2018)
Andaluz, V., Flavio, R., Toibero, J.M., Carel, R.: Adaptive unified motion control of mobile manipulators. Control Eng. Practice 20(12), 1337–1352 (2012)
Acknowledgements
The authors would like to thank the Corporación Ecuatoriana para el Desarrollo de la Investigación y Academia - CEDIA for their contribution in innovation, through the CEPRA projects, especially the project CEPRA-XIV-2020–08-RVA “Tecnologías Inmersivas Multi-Usuario Orientadas a Sistemas Sinérgicos de Enseñanza y Aprendizaje”; also the Universidad de las Fuerzas Armadas ESPE and the Research Group ARSI, for the support for the development of this work.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Moreno, G.P., De la Cruz, N.D., Ortiz, J.S., Andaluz, V.H. (2021). Human-Robot Collaborative Control for Handling and Transfer Objects. In: Botto-Tobar, M., Montes León, S., Camacho, O., Chávez, D., Torres-Carrión, P., Zambrano Vizuete, M. (eds) Applied Technologies. ICAT 2020. Communications in Computer and Information Science, vol 1388. Springer, Cham. https://doi.org/10.1007/978-3-030-71503-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-030-71503-8_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-71502-1
Online ISBN: 978-3-030-71503-8
eBook Packages: Computer ScienceComputer Science (R0)