Abstract
This paper proposes action input interface of IntelligentBox for multi-persons’ collaborative VR applications. IntelligentBox ia a component-based constructive 3D graphics application development system. One of the application fields of IntelligentBox is VR. VR applications should support various types of VR peripherals, e.g., HMD (Head Mount Display), Data Gloves and so on. IntelligentBox supports most of them as dedicated software components. As for action input interfaces of VR applications, they support a motion capture system and MS Kinect. However, basically, such input interface supports one person’s actions. For multi-persons’ collaborative VR applications, the other action input interface is needed. Then, this paper proposes such an action input interface using 360° VR camera and OpenPose. In the interface, first a 360° VR camera captures all the persons’ images in the real world at the same time. Then, OpenPose recognizes all the persons’ poses in real time and output those poses as their skeletons in the json format. This time, the authors developed one dedicated software that generates multi-persons’ motion data from the output json format data and send them into a certain component of IntelligentBox through socket communication. The developed software works as a server of the server-client framework so that it can be used as a general action input interface for other client applications.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Noguchi, K., Okada, Y.: IntelligentBox for Web: A Constructive Visual Development System for Interactive Web 3D Graphics Applications. In: Barolli, Leonard, Hussain, Farookh Khadeer, Ikeda, Makoto (eds.) CISIS 2019. AISC, vol. 993, pp. 757–767. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-22354-0_69
Okada, Y., Tanaka, Y.: Collaborative environments of IntelligentBox for distributed 3D graphics applications. Vis. Comput. 14(4), 140–152 (1998). https://doi.org/10.1007/s003710050130
Okada, Y.: 3D visual component based approach for immersive collaborative virtual environments. In: Proceedings of the 2003 ACM SIGMM Workshop on Experiential Telepresence, ETP 2003, pp. 84–90 (2003)
Okada, Y.: IntelligentBox as component based development system for body action 3D games. In: ACM SIGCHI International Conference on Advances in Computer Entertainment Technology (ACE 2005), pp. 454–457 (2005)
Miyahara, K., Okada, Y.: Collada-based file format for various attributes of realistic objects in networked VR applications supporting various peripherals. J. Mob. Multimedia 6(2), 128–144 (2010)
Kosuki, Y., Okada, Y.: 3D visual component based development system for medical training systems supporting haptic devices and their collaborative environments. In: VENOA 2012 in Proceedings of the 6th International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS-2012), pp. 687–692. IEEE CS Press (2012)
Nomi, M., Okada, Y.: Improvement of dental treatment training system using a haptic device. In: Barolli, Leonard, Takizawa, Makoto, Enokido, Tomoya, Chen, Hsing-Chung., Matsuo, Keita (eds.) Advances on Broad-Band Wireless Computing, Communication and Applications: Proceedings of the 15th International Conference on Broad-Band and Wireless Computing, Communication and Applications (BWCCA-2020), pp. 143–153. Springer International Publishing, Cham (2021). https://doi.org/10.1007/978-3-030-61108-8_14
Miyahara, K., Okada, Y., Niijima, K.: A cloth design system using haptic device and its collaborative environment. In: Proceedings of the 2006 IEEE International Workshop on Haptic Audio Visual Environments and Their Applications, HAVE 2006, pp. 48–53 (2006)
Okada, Y., Ogata, T., Matsuguma, H.: Component-based approach for prototyping of Tai Chi-based physical therapy game and its performance evaluations. ACM Comput. Entertain. 14(1), 41–420 (2016)
Okada, Y., Kaneko, K., Fujibuchi, T.: IntelligentBox based training system for operation of radiation therapy devices. In: Barolli, L., Poniszewska-Maranda, A., Enokido, T. (eds.) CISIS 2020. AISC, vol. 1194, pp. 188–198. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-50454-0_18
Okada, Y.: Real-time motion generation of articulated figures using puppet/marionette metaphor for interactive animation systems. In: Proceedings of the 3rd IASTED International Conference on Visualization, Imaging, and Image Processing (VIIP03), pp. 13–18. ACTA Press (2003)
Open Inventor. http://oss.sgi.com/projects/inventor/
Coin3D. http://www.coin3d.org/
3D Widget. http://www.viewpoint.com/widgets/
Unity3D. https://unity.com/
Unreal Engine. https://www.unrealengine.com/
Acknowledgements
This research was partially supported by the project grant from the Kyushu University Education Innovation Initiative.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Yu, B., Shi, W., Okada, Y. (2021). Action Input Interface of IntelligentBox Using 360-Degree VR Camera and OpenPose for Multi-persons’ Collaborative VR Applications. In: Barolli, L., Yim, K., Enokido, T. (eds) Complex, Intelligent and Software Intensive Systems. CISIS 2021. Lecture Notes in Networks and Systems, vol 278. Springer, Cham. https://doi.org/10.1007/978-3-030-79725-6_75
Download citation
DOI: https://doi.org/10.1007/978-3-030-79725-6_75
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-79724-9
Online ISBN: 978-3-030-79725-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)