Abstract
This study looks into users’ gesture-based operations to be performed on smartphone interface, and focuses on the factor of realistic experience each operation produces. Then we devise a new interface design concept by incorporating the element of reality in the design theory of Natural User Interface (NUI). The element of reality constitutes the user experience of digital content, and NUI forms the sensory reality of operating the digital content. Proposed here is an interaction system in which the realistic experience of digital content use is emphasized using the two characteristics of gesture operations: “expressiveness” and “problem-solving ability based on spatial thinking”. This study takes as an example the emailing tasks which anyone today has had experience with, and attempts to solve the everyday issues of incorrect email transmission, based on the design concepts the authors propose. Focusing on the action of sending emails, the study is aimed at raising users’ awareness of emailing practice by creating a realistic experience of “sending something to a recipient”, using three-dimensional gesture operations on the app’s interface. On top of this, a practical email transmission/interaction system will be built by integrating the incorrect transmission prevention mechanism into the realistic experience of “sending things”, which was represented by gesture operations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Horioka, H., Okamoto, Y.: A study of gesture recognition using smartphone sensors. In: The 1st IEEE Global Conference on Consumer Eletronics (2012)
Liu, W.: Natural user interface - next mainstream product user interface. In: IEEE 11th International Conference on Computer-Aided Industrial Design & Conceptual Design (2010)
Zao, J.K., Lin, C.-T., Ko, L.-W., She, H.-C., Dung, L.-R., Chen, B.-Y.: Natural user interfaces: cyber-physical challenges and pervasive applications. In: IEEE International Conference on Internet of Things, and IEEE Green Computing and Communications and IEEE Cyber, Physical and Social Computing (2014)
Furui, N., Sakamoto, D., Sugiura, Y.: Gesture design and implementation for smart-home control by cushion interface. J. Inf. Process. Soc. 60(10), 1859–1868 (2019)
Hatori, A., Kobayashi, H.: A preliminary study of IoT-device control using gestures recognition. In: 56th Annual Conference of the Society of Instrument and Control Engineers of Japan (2017)
Kato, K., Matsumura, K., Sugiura, Y.: Inputting method applying method performed outside smartphone. In: Proceedings of Entertainment Computing Symposium, pp. 87–92 (2019)
Yamashita, D., Aida, H., Yamamoto, T., Miki, M.: Gesture recognition using built-in illuminance sensor for one-hand operation of smartphone. Harris Sci. Rev. Doshisha University 58(4), 196–201 (2018)
Mankar, S.M., Chhabria, S.A.: Review on hand gesture based mobile control application. In: International Conference on Pervasive Computing (2015)
Dawes, J., Brian, M., Bialek, H., Johnston, M.L.: Wireless smartphone control using electromyography and automated gesture recognition. In: 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Science (2018)
Fujimoto, T.: Ideology of AoD: analog on digital -operating digitized objects and experiences with analog-like approach. In: Proceedings of the 7th International Congress on Advanced Applied Informatics (2018)
Dong, H., Danesh, A., Figueroa, N., El Saddik, A.: An elicitation study on gesture preferences and memorability toward a practical hand-gesture vocabulary for smart televisions. IEEE Access 3, 543–555 (2015)
Thomas, L.E., Lleras, A.: Swinging into thought: directed movement guides insight in problem solving. Psychon. Bull. Rev. 16(4), 719–723 (2009)
Fang, W., Lin, Y., Sheu, F., Chen, N.: Exploring problem solving performance through natural user interfaces. In: IEEE 13th International Conference on Advanced learning Technologies (2013)
Ministry of Internal Affairs and Communications of Japan: 2018 White Paper on Information and Communications in Japan (2018). https://www.soumu.go.jp/johotsusintokei/whitepaper/ja/h30/html/nd252120.html
ITmedia Inc. White Paper of the Solutions of the 3 subjects in the use of email (2014). https://www.itmedia.co.jp/enterprise/articles/1407/17/news003.html
Acknowledgement
This work was supported by JSPS KAKENHI Grant Number 17K00730.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Fan, Z., Fujimoto, T. (2021). Interaction Design for Email Client: User Movements Reflected in Gesture-based Operation. In: Selvaraj, H., Chmaj, G., Zydek, D. (eds) Proceedings of the 27th International Conference on Systems Engineering, ICSEng 2020. ICSEng 2020. Lecture Notes in Networks and Systems, vol 182. Springer, Cham. https://doi.org/10.1007/978-3-030-65796-3_22
Download citation
DOI: https://doi.org/10.1007/978-3-030-65796-3_22
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-65795-6
Online ISBN: 978-3-030-65796-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)