Abstract
This paper identifies a new physical correlate of finger pressure that can be detected and measured visually in a wide variety of situations. When a human finger is pressed onto a hard object the flesh is compressed between two rigid surfaces: the surface of the target object and the fingernail. This forces blood out of the vessels in the fingertip, changing its colour slightly, but systematically. The effect is visible to the naked eye and can be measured using techniques from computer vision. As measurements are made of properties of the hand, and not the target surface, multiple-touch and pressure sensing can be added to a range of surfaces - including opaque, transparent, smooth, textured and non-planar examples - without modification of the underlying physical object. The proposed approach allows touch sensing to be fitted to surfaces unsuitable for previous technologies, and objects which cannot be altered, without forfeiting the extra range of expression of pressure sensitivity. The methods involved are simple to set up and low cost, requiring only a domestic-quality camera and a typical computer in order to augment a surface. Two systems which exploit this cue to generate a response to pressure are presented, along with a case study of an interactive art installation contructed using the resulting technology. Initial experiments are reported which suggest that visual monitoring of finger colour will support recogntion of push events.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Synaptics Capacitive sensing technical description, http://www.synaptics.com/technology/tcps.cfm
Bérard, F.: The magic table: Computer-vision based augmentation of a whiteboard for creative meetings. In: IEEE workshop on Projector-Camera Systems (2003)
Morrison, G.D.: A cmos camera-based man-machine input device for large-format interactive displays. In: SIGGRAPH (2007)
Malik, S., Laszlo, J.: Visual touchpad: A two-handed gestural input device. In: ACM Int. Conference on Multimodel Interfaces (2004)
Wilson, A.: Touchlight: An imaging touch screen and display for gesture-based interaction. In: Int. Conf. on Multimodal Interfaces (2004)
Wacom Graphics tablets, http://www.wacom.com
MagicTouch Touch screens, http://www.magictouch.com
Synaptics Touch pads, http://www.synaptics.com
Dietz, P., Leigh, D.: Diamondtouch: A multi-user touch technology. In: UIST (2003)
Schmidt, A., Strohbach, M., van Laerhoven, K., Friday, A., Gellersen, H.W.: Context acquisition based on load sensing. In: Borriello, G., Holmquist, L.E. (eds.) UbiComp 2002. LNCS, vol. 2498, Springer, Heidelberg (2002)
Strickon, J., Paradiso, J.: Tracking hands above large interactive surfaces with a low-cost scanning laser rangefinder. In: CHI (1998)
Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST (2005)
Tosas, M., Li, B.: Virtual touch screen for mixed reality. In: Proc. of ECCV Workshop on HCI, (2004)
Benko, H., Wilson, A.D., Baudisch, P.: Precise selection techniques for multi-touch screens. In: CHI (2006)
Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., Shen, C.: Lucidtouch: A see-through mobile device. In: UIST (2007)
McKenna, S., Gong, S., Raja, Y.: Face recognition in dynamic scenes. In: British Machine Vision Conference (1997)
Yang, J., Fu, Z., Tan, T., Hu, W.: Skin color detection using multiple cues. In: Int. Conference on Pattern Recognition (2004)
Zarit, B.D., Super, B.J., Quek, F.K.H.: Comparison of five colour models in skin pixel classification. In: ICCC International Workshop on recognition, analysis and tracking of faces and gestures in Real-Time systems (1999)
Störring, M., Andersen, H.J., Granum, E.: Skin colour detection under changing lighting conditions. In: 7th Symposium on Intelligent Robotics Systems (1999)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Marshall, J., Pridmore, T., Pound, M., Benford, S., Koleva, B. (2008). Pressing the Flesh: Sensing Multiple Touch and Finger Pressure on Arbitrary Surfaces. In: Indulska, J., Patterson, D.J., Rodden, T., Ott, M. (eds) Pervasive Computing. Pervasive 2008. Lecture Notes in Computer Science, vol 5013. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79576-6_3
Download citation
DOI: https://doi.org/10.1007/978-3-540-79576-6_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-79575-9
Online ISBN: 978-3-540-79576-6
eBook Packages: Computer ScienceComputer Science (R0)