Abstract
Interfaces are needed for humans and machines to interact with each other. Recently, various interface methods have been used in real life. Especially for those who cannot use the hand, it is not possible to use the hand movement or finger contact-based interface. Therefore, research is needed for user-friendly interfaces for users who are difficult to use by hand.
The extended sensory interface described in this paper is an interface that utilizes the heat generated by the convection generated by the user in the exhaled breath.
The exhaled breath can be a new invisible hand. And, in this paper, this is expressed as an extended sensation. The exhaled breath towards the surface of things convection causes the surface temperature to rise above the surroundings. By analyzing these temperature differences with a thermal image camera, it is possible to detect traces of conduction heat points due to the extended sensation. Since the traces of conduction heat point is directly generated by the user, it can be utilized for the interface.
In this study, we explain the results derived through various experiments and discuss how the extended sensory interface can be utilized by impaired per-son who have difficulty using their hands.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dietz, P., Leigh, D.: DiamondTouch: a multi-user touch technology. In: Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, pp. 219–226 (2001)
Rekimoto, J.: SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 113–120 (2002)
Kane, S.K., et al.: Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 129–138 (2009)
Oka, K., Sato, Y., Koike, H.: Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems. In: Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, pp. 429–434 (2002)
Wilson, A.D.: PlayAnywhere: a compact interactive tabletop projection-vision system. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, pp. 83–92 (2005)
Grudin, J.: Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. ACM Trans. Comput.-Hum. Interact. (TOCHI), 8(4), 307–322 (2001)
Iwai, D., Sato, K.: Heat sensation in image creation with thermal vision. In: Proceedings of the 2005 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, pp. 213–216 (2005)
Larson, E., et al.: Heatwave: thermal imaging for surface user interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2565–2574 (2011)
Saba, E.N., Larson, E.C., Patel, S.N.: Dante vision: in-air and touch gesture sensing for natural surface interaction with combined depth and thermal cameras. In: 2012 IEEE International Conference on Emerging Signal Processing Applications, pp. 167–170 (2012)
Funk, M., Schneegass, S., Behringer, M., Henze, N., Schmidt, A.: An interactive curtain for media usage in the shower. In: Proceedings of the 4th International Symposium on Pervasive Displays, pp. 225–231 (2015)
Dunn, T., Banerjee, S., Banerjee, N.K.: User-independent detection of swipe pressure using a thermal camera for natural surface interaction. In: 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP), pp. 1–6 (2018)
Cook, A.M., Polgar, J.M.: Cook and Hussey’s Assistive Technologies-E-Book: Principles and Practice. Elsevier Health Sciences (2013)
Sra, M., Xu, X., Maes, P.: BreathVR: leveraging breathing as a directly controlled interface for virtual reality games. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, pp. 1–12 (2018)
Lee, K., Lee, S.H., Park, J.-I.: Hands-free interface using breath residual heat. In: Yamamoto, S., Mori, H. (eds.) HIMI 2018. LNCS, vol. 10904, pp. 204–217. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92043-6_18
Acknowledgements
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No.2019R1A4A 1029800).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Lee, K., Park, JI. (2021). Toward Extended Sensory Interface for Impaired Person. In: Rauterberg, M. (eds) Culture and Computing. Interactive Cultural Heritage and Arts. HCII 2021. Lecture Notes in Computer Science(), vol 12794. Springer, Cham. https://doi.org/10.1007/978-3-030-77411-0_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-77411-0_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-77410-3
Online ISBN: 978-3-030-77411-0
eBook Packages: Computer ScienceComputer Science (R0)