Controlling and Coordinating Computers in a Room with In-Room Gestures
To interact with a computer, a user can walk up to it and interact with it through its local interaction space defined by its input devices. With multiple computers in a room, the user can walk up to each computer and interact with it. However, this can be logistically impractical and forces the user to learn each computer’s local interaction space. Interaction involving multiple computers also becomes hard or even impossible to do. We propose to have a global interaction space letting users, through in-room gestures, select and issue commands to one or multiple computers in the room. A global interaction space has functionality to sense and record the state of a room, including location of computers, users, and gestures, and uses this to issue commands to each computer. A prototype has been implemented in a room with multiple computers and a high-resolution, wall-sized display. The global interaction space is used to issue commands, moving display output from on-demand selected computers to the large display and back again. It is also used to select multiple computers and concurrently execute commands on them.
Unable to display preview. Download preview PDF.
- Bragdon, A., DeLine, R., Hinckley, K., Ringel, M.: Code Space: Touch + Air Gesture Hybrid Interactions for Supporting Developer Meetings. In: Proc. ACM International Conference on Interactive Tabletops and Surfaces, pp. 212–221 (2011)Google Scholar
- Kim, D., Hilliges, O., Izadi, S., Butler, A.D., Chen, J., Oikonomidis, I., Olivier, P.: Digits: Freehand 3D Interactions Anywhere Using a Wrist-worn Gloveless Sensor. In: Proc. of the 25th Annual ACM Symposium on User Interface Software and Technology, pp. 167–176 (2012)Google Scholar
- Kin, K., Björn, H., DeRose, T., Agrawala, M.: Proton: Multitouch Gestures as Regular Expressions. In: Proc. SIGCHI Conference on Human Factors in Computing Systems, pp. 2885–2894 (2012)Google Scholar
- Stødle, D., Bjørndalen, J.M., Anshus, O.J.: A System for Hybrid Vision- and Sound-Based Interaction with Distal and Proximal Targets on Wall-Sized, High-Resolution Tiled Displays. In: Lew, M., Sebe, N., Huang, T.S., Bakker, E.M. (eds.) HCI 2007. LNCS, vol. 4796, pp. 59–68. Springer, Heidelberg (2007)Google Scholar
- Stødle, D., Troyanskaya, O., Li, K., Anshus, O.J.: Tech-note: Device-free Interaction Spaces. In: IEEE Symposium on 3D User Interfaces (2009)Google Scholar
- Tartari, G., Stødle, D., Bjørndalen, J.M.: Phuong Hoai Ha, and Anshus OJ Global Interaction Space for User Interaction with a Room of Computers. In: Proc.: 2013 The 6th International Conference on Human System Interaction (HSI), pp. 84–89 (2013)Google Scholar
- Van den Bergh, M., Van Gool, L.: Combining RGB and ToF Cameras for Real-time 3D Hand Gesture Interaction. In: 2011 IEEE Workshop on Applications of Computer Vision (WACV), pp. 66–72 (2011)Google Scholar
- Wilson, A.D., Benko, H.: Combining Multiple Depth Cameras and Projectors for Interactions on, Above and Between Surfaces. In: Proc 23nd Annual ACM Symposium on User Interface Software and Technology, pp. 273–282 (2010)Google Scholar