The Journal of Supercomputing

, Volume 73, Issue 7, pp 2851–2866 | Cite as

Design of hand gesture interaction framework on clouds for multiple users

  • Yeji Kim
  • Seoungjae Cho
  • Simon Fong
  • Yong Woon Park
  • Kyungeun ChoEmail author


To develop cooperative content based on the hand gestures of multiple users, typical frameworks must be separately used for the communication among computers and hand gesture recognition. In this paper, we propose a framework that enables users who are far apart to interact using hand gestures in the same virtual environment. This approach makes possible remote cooperative education content. We present the design of a server and client, as well as techniques for respectively managing multiple users, controlling crashes among multiple users, and managing gesture data for activating the proposed framework on clouds. To verify that the framework enables multiple users to interact, we developed a virtual chemical experiment based on the proposed design and performed the simulation with it. The framework can be used for a variety of educational content using interactions among multiple users.


Cloud computing Remote education Virtual environments  Hand gesture Multi-user interaction 



This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2016-H8501-16-1014) supervised by the IITP (Institute for Information & communications Technology Promotion) and by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and future Planning (NRF-2015R1A2A2A01003779).


  1. 1.
    Kim Y (2011) Study on the development of a virtual reality experiment program in the chemistry education: centering the chemistry unit in the 10th grade science textbook. Dissertation, Kongju National UniversityGoogle Scholar
  2. 2.
    Lee Y (1997) Design and implementation of cyber science experiment. Thesis, Ewha Womans UniversityGoogle Scholar
  3. 3.
    Lee S (2001) A design and implementation of the virtual experimental laboratory for common science. Thesis, Hanseo UniversityGoogle Scholar
  4. 4.
    Chung KS, Kwon S, Huang W-H (2013) Design and development of sensor-based virtual experiment contents for smart phone. J Digit Contents Soc 14(2):161–169. doi: 10.9728/dcs.2013.14.2.161 CrossRefGoogle Scholar
  5. 5.
    Matsuda H, Shindo Y (2008) Virtual chemical experiment using cyber assistant professor: CAP. In: Eighth IEEE international conference on advanced learning technologies, 2008. ICALT’08, pp 977–981. doi: 10.1109/ICALT.2008.109
  6. 6.
    Ebert LC, Flach P, Thali MJ, Ross S (2014) Out of touch—a plugin for controlling OsiriX with gestures using the leap controller. J Forensic Radiol Imaging 2(3):126–128. doi: 10.1016/j.jofri.2014.05.006 CrossRefGoogle Scholar
  7. 7.
    Marton F, Agus M, Gobbetti E, Pintore G, Balsa Rodriguez M (2012) Natural exploration of 3D massive models on large-scale light field displays using the FOX proximal navigation technique. Comput Graph 36(8):893–903. doi: 10.1016/j.cag.2012.06.005 CrossRefGoogle Scholar
  8. 8.
    Xu W, Lee EJ (2013) A new NUI method for hand tracking and gesture recognition based on user experience. Int J Secur Appl 7(2):149–155Google Scholar
  9. 9.
    Hwang T (2012) Development of architectural design support tools using the natural user interface (NUI). Thesis, Seoul National University of Science and TechnologyGoogle Scholar
  10. 10.
    Shin Y (2013) Design and implementation of the virtual education system focusing on interactions using the gesture-based 3D avatar. Thesis, Korea National University of TransportationGoogle Scholar
  11. 11.
    Kolici V, Herrero A, Xhafa F (2014) On the performance of Oracle grid engine queuing system for computing intensive applications. J Inf Process Syst 10(4):491–502. doi: 10.3745/JIPS.01.0004 CrossRefGoogle Scholar
  12. 12.
    Salam MI, Yau W-C, Chin J-J, Heng S-H, Ling H-C, Phan RC-W, Poh GS, Tan S-Y, Yap W-S (2015) Implementation of searchable symmetric encryption for privacy-preserving keyword search on cloud storage. Human-centric Comput Inf Sci 5(19):1–16. doi: 10.1186/s13673-015-0039-9 Google Scholar
  13. 13.
    Cho H, Choi M (2014) Personal mobile album/diary application development. J Converg 5(1):32–37Google Scholar
  14. 14.
    Low Y, Gonzalez J, Kyrola A, Bickson D, Guestrin C, Hellerstein JM (2012) Distributed graph lab: a framework for machine learning and data mining in the cloud. Proceedings of the VLDB endowment 5(8):716–727. doi: 10.14778/2212351.2212354 CrossRefGoogle Scholar
  15. 15.
    Bae Y (2000) Development of real-time interactive lecture support tool on client/server environment. Thesis, Anyang UniversityGoogle Scholar
  16. 16.
    Hwang K, Choi CY (1998) Design and implementation of multimedia server for distance learning. KIISE Trans Comput Pract 4(3):325–336Google Scholar
  17. 17.
    Jang SW, Jeon YJ (2000) Design and implementation of a group-based real-time distance learning system. KIISE Trans Comput Pract 6(5):543–554Google Scholar
  18. 18.
    Kim J-O, Jung J-S, Kim D-H, Kwon S-O, Lee J, Ju S, Park C, Jang R-H, Yoo K-H (2014) Development of interactive 3D video education system based on gesture interface. J HCI Soc Korea 2014(2):551–554Google Scholar
  19. 19.
    Tam V, Ling-Shan L (2012) Integrating the Kinect camera, gesture recognition and mobile devices for interactive discussion. In: 2012 IEEE international conference on Teaching, Assessment and Learning for Engineering (TALE), pp H4C-11–H4C-13, 20–23. doi: 10.1109/TALE.2012.6360362

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Yeji Kim
    • 1
  • Seoungjae Cho
    • 1
  • Simon Fong
    • 2
  • Yong Woon Park
    • 3
  • Kyungeun Cho
    • 1
    Email author
  1. 1.Department of Multimedia EngineeringDongguk University-SeoulSeoulRepublic of Korea
  2. 2.Department of Computer and Information ScienceUniversity of MacauMacauChina
  3. 3.Agency for Defense DevelopmentDaejeonRepublic of Korea

Personalised recommendations