Abstract
Pervasive Computing has postulated to invisibly integrate technology into everyday objects in such a way, that these objects turn into smart things. Not only a single object of this kind is supposed to represent the interface among the "physical world" of atoms and the "digital world" of bits, but a whole landscapes of them. The interaction among humans and such landscapes of technology rich artifacts happens to be more confluently, rather than on a per device basis. To address the confluence among humans and computing landscapes we study we study human gesticulation and the manipulation of graspable and movable everyday artifacts as a potentially effective means for the interaction with the physical environment. In detail, we consider gestures in the general sense of a movement or a state (posture) of the human body, as well as a movement or state of any physical object resulting from human manipulation. Further, based on the tangible user interface paradigm, we propose employing intuitive tangible universal controls that translate physical motions into actions for controlling landscapes of smart things. Such intuitive "everyday"-gestures have been collected in a series of user tests, yielding a catalogue of generic body and artifact gesture dynamics. We present a systematic approach to selecting and steering using tangible artifacts by associating a flip-movement to service selection and a turn-movement to parameter steering. An implementation of this approach in a general software framework and several experiments with various fully functional artifacts and devices are described.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Amft, O., Junker, H., Tröster, G.: Detection of Eating and Drinking Arm Gestures Using Inertial Body-Worn Sensors. In: ISWC 2005, pp. 160–163. IEEE Computer Society Press, Los Alamitos (2005)
Bahlmann, C., Haasdonk, B., Burkhardt, H.: On-line Handwriting Recognition with Support Vector Machines - A Kernel Approach. In: Proc. of the 8th Int. Workshop on Frontiers in Handwriting Recognition (IWFHR), pp. 49–54 (2002)
Benbasat, A.Y., Paradiso, J.A.: An Inertial Measurement Framework for Gesture Recognition and Applications. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 9–20. Springer, Heidelberg (2002)
Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2(2), 1–47 (1998)
Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines (2001), Software available at, http://www.csie.ntu.edu.tw/cjlin/libsvm
Dourish, P.: Where the action is: the foundations of embodied interaction. MIT Press, Cambridge (2001)
Eustice, K.F., Lehman, T.J., Morales, A., Munson, M.C., Edlund, S., Guillen, M.: A universal information appliance. IBM Systems Journal 38(4), 575–601 (1999)
Fishkin, K., Moran, T., Harrison, B.: Embodied user interfaces: towards invisible user interfaces. In: Proceedings of the 7th international conference on engineering for human-computer interaction (EHCI’98), Heraklion, Crete, Greece, September (1998)
Fitzmaurice, G.W.: Graspable user interfaces. Ph.D thesis, University of Toronto (1996)
Fitzmaurice, G.W., Ishii, H., Buxton, W.: Bricks: laying the foundations for graspable user interfaces. In: Proceedings of the ACM conference on human factors in computing systems (CHI’95), Denver, Colorado, May, ACM, New York (1995)
Greenberg, S., Fitchett, C.: Phidgets: easy development of physical interfaces through physical widgets. In: Proceedings of ACM symposium on user interface software and technology (UIST 2001), Orlando, FLorida, November, ACM, New York (2001)
Holmquist, L.E., Redström, J., Ljungstrand, P.: Token-based access to digital information. In: Proceedings of the first international symposium on handheld and ubiquitous computing (HUC’99), Karlsruhe, Germany, September (1999)
Hodes, T.D., Katz, R.H., Servan-Schreiber, E., Rowe, L.: Composable Ad-hoc Mobile Services for Universal Interaction. In: Proceedings of the Third Annual ACM/IEEE International Conference on Mobile Computing and Networking, pp. 1–12. IEEE Computer Society Press, Los Alamitos (1997)
Holzmann, C., Resmerita, S., Leitner, M., Ferscha, A., Paradigm, A.: for Orientation-Based Universal Remote Control. In: Proceedings of the International Workshop on the Tangible Space Initiative, in conjunction with Pervasive 2006, Dublin, Ireland, May 7 (2006)
Ishii, H., Ullmer, B.: Tangible Bits: Towards Seamless Interface to Access Digital Information. In: Extended Abstracts of Conference on Human Factors in Computing Systems (CHI ’01), Seattle, Washington, USA, March 31 - April 5, pp. 187–188. ACM Press, New York (2001)
Kaowthumrong, K., Lebsack, J., Han, R.: Automated Selection of the Active Device in Interactive Multi-Device Smart Spaces. In: Spontaneity Workshop at Ubicomp (2002)
Kray, C., Strohbach, M.: Gesture-based Interface Reconfiguration. In: Workshop “AI mobile systems” (AIMS 2003) at Ubicomp’03, Seattle, WA, USA (2003)
Koleva, B., Benford, S., Hui Ng, K., Rodden, T.: A framework for tangible user interfaces. In: Proceedings of the real world user interfaces workshop at the 5th international symposium on human-computer interaction with mobile devices and services (MobileHCI 2003), Udine, Italy, September (2003)
Lementec, J.C., Bajcsy, P.: Recognition of Arm Gestures Using Multiple Orientation Sensors: Gesture Classification. In: 7th International IEEE Conference on Intelligent Transportation Systems, Washington, D.C., October 3-6 2004, pp. 965–970. IEEE Press, Los Alamitos (2004)
Lenman, S., Bretzner, L., Thuresson, B.: Computer Vision Based Hand Gesture Interfaces for Human-Computer Interaction. Technical Report TRITA-NA-D0209, CID-172, Royal Institute of Technology, Sweden (2002)
Myers, B.A.: Using handhelds for wireless remote control of PCs and appliances. Interacting with Computers 17(3), 251–264 (2005)
Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for man-machine interaction. Technical report CVMT 03-01, Aalborg University (2003)
Orientation Sensing for Gesture-Based Interaction with Smart Artifacts. Computer Communications 28(13), 1552–1563 (2005)
Ponnekanti, S.R., Lee, B., Fox, A., Hanrahan, P., Winograd, T.: ICrafter: A Service Framework for Ubiquitous Computing Environments. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) Ubicomp 2001: Ubiquitous Computing. LNCS, vol. 2201, pp. 56–75. Springer, Heidelberg (2001)
Rekimoto, J.: Tilting operations for small screen interfaces. In: Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 1996), pp. 167–168. ACM Press, New York (1996)
Rekimoto, J., Sciammarella, E.: ToolStone: Effective Use of the Physical Manipulation Vocabularies of Input Devices. In: Proceedings of ACM User Interface Software and Technology (UIST), pp. 109–117. ACM Press, New York (2000)
Shimodaira, H., Noma, K., Nakai, M., Sagayama, S.: Dynamic Time-Alignment Kernel in Support Vector Machine. Advances in Neural Information Processing Systems 14, NIPS2001, 2:921-928 (Dec. 2001)
The Bluetooth specification. http://www.bluetooth.org
The InertiaCube3 orientation sensor. http://www.isense.com/products/prec/ic3/wirelessic3.htm
The Near Field Communication Forum. http://www.nfc-forum.org
The OSGi Service Platform. http://www.osgi.org
The Wireless Fidelity Alliance. http://www.wi-fi.org
The ZigBee Alliance. http://www.zigbee.org
Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Syst. 39(3-4), 915–931
Ullmer, B., Ishii, H., Glas, D.: mediaBlocks: Physical Containers, Transports, and Controls for Online Media. In: Proceedings of SIGGRAPH ’98, Orlando, Florida USA, pp. 379–386. ACM Press, New York (1998)
Universal Plug and Play. http://www.upnp.org/
Välkkynen, P., Korhonen, I., Plomp, J., Tuomisto, T., Cluitmans, L., Ailisto, H., Seppä, H.: A user interaction paradigm for physical browsing and near-object control based on tags. In: Proceedings of the Physical Interaction Workshop at Mobile HCI Conference, Udine, Italy (2003), http://www.medien.informatik.unimuenchen.de/en/events/pi03/proceeding.htm
Vanderheiden, G., Zimmermann, G., Trevin, S.: Interface Sockets, Remote Consoles, and Natural Language Agents: A V2 URC Standards Whitepaper (2005), http://myurc.com/whitepaper.php
Waldo, J.: The Jini Architecture for Network-centric Computing. Communications of the ACM, 76–82 (July 1999)
Weiser, M.: The Computer for the 21st Century. Scientific American 265(3), 94–104 (1991)
Westeyn, T., Brashear, H., Atrash, A., Starner, T.: Georgia Tech Gesture Toolkit: Supporting Experiments in gesture Recognition. In: Proceedings of ICMI 2003, Vancouver, British Columbia, Canada, November 5-7, pp. 5–7 (2003)
Williams, A., Kabisch, E., Dourish, P.: From Interaction to Participation: Configuring Space Through Embodied Interaction. In: Beigl, M., Intille, S.S., Rekimoto, J., Tokuda, H. (eds.) UbiComp 2005. LNCS, vol. 3660, pp. 287–304. Springer, Heidelberg (2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Ferscha, A., Resmerita, S., Holzmann, C. (2007). Human Computer Confluence. In: Stephanidis, C., Pieper, M. (eds) Universal Access in Ambient Intelligence Environments. Lecture Notes in Computer Science, vol 4397. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71025-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-540-71025-7_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71024-0
Online ISBN: 978-3-540-71025-7
eBook Packages: Computer ScienceComputer Science (R0)