Evaluating Somatosensory Interactions: Designing a Handheld Tactile Acoustic Device for Mobile Phones
We present the details of preliminary development efforts to create a tactile acoustic device (TAD) for the hands. The Model Human Cochlea (MHC) is a method for conveying sound to the body in a chair form factor, and originally developed as a sensory substitution system to provide some access to sounds from movies or music to deaf and hard of hearing people. We present initial design research on modifying the MHC system from a chair to a mobile handheld tactile device, towards improving mobile-phone speech comprehension in noisy environments. Scaling the MHC from the back, which has the least sensitive skin on the body, to the highly sensitive skin on the hands, requires an understanding of the physiology, psychology, electronics, and software applicable to this kind of sensation. This research addresses factors critical to expanding the design of tactile acoustic devices for somatosensory system interactions to different areas of the body.
KeywordsInteractive displays Somatosensory systems Crossmodal systems Mobile phone interaction Multimodal HCI systems Sensory substitution Tactile acoustic devices
- Bach-y-Rita, P., Webster, J.G., Tompkins, W.J., Crabb, T.: Sensory substitution for space gloves and space robots. In: Space Telerobotics Workshop, Jet Propulsion Laboratory, Pasadena, CA, 20–22 1987, pp. 51–57 (1987)Google Scholar
- Gemperle, F., Nathan O., Siewiorek, D.: Design of a wearable tactile display. In: Proceedings of the 5th IEEE International Symposium on Wearable Computers ISWC 2001. IEEE Computer Society, Washington (2001)Google Scholar
- Meenowa, J., Hameed, M., Furner, S., Langdon, P.M.: Using haptic displays for workload reduction and inclusive control. In: 11th International Conference on Human Computer Interaction (HCII 2005), 2005-7-22 to 2005-7-27, Las Vegas, Nevada, USA (2005)Google Scholar
- Wall, B., Brewster, S.: Feeling what you hear: tactile feedback for navigation of audio graphs. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2006), pp. 1123–1132. ACM, New York (2006)Google Scholar
- Withana, A., Koyama, S., Saakes, D., Minamizawa, K., Inami, M., Nanayakkara, S.: RippleTouch: initial exploration of a wave resonant based full body haptic interface. In: Proceedings of the 6th Augmented Human International Conference (AH 2015), pp. 61–68. ACM, New York (2015)Google Scholar