Mobile Devices for Control
With today’s and tomorrow’s wireless technologies, such as IEEE 802.11, BlueTooth, RF-Lite, and G3, mobile devices will frequently be in close, interactive communication. Many environments, including offices, meeting rooms, automobiles and classrooms, already contain many computers and computerized appliances, and the smart homes of the future will have ubiquitous embedded computation. When the user enters one of these environments carrying a mobile device, how will that device interact with the immediate environment? We are exploring, as part of the Pebbles research project, the many ways that mobile devices such as PalmOS Organizers or PocketPC / Windows CE devices, can serve as useful adjuncts to the “fixed” computers in the user’s vicinity. This brings up many interesting research questions, such as how to provide a user interface that spans multiple devices that are in use at the same time? How will users and systems decide which functions should be presented and in what manner on what device? How can the user’s mobile device be effectively used as a “Personal Universal Controller” to provide an easy-to-use and familiar interface to all of the complex appliances available to a user? How can communicating mobile devices enhance the effectiveness of meetings and classroom lectures? I will describe some preliminary observations on these issues, and discuss some of the systems that we have built to investigate them.
KeywordsMobile Device Smart Home Public Display Army Research Laboratory Interaction Institute
Unable to display preview. Download preview PDF.
- 1.Brouwer-Janse, M.D., Bennett, R.W., Endo, T., van Nes, F.L., Strubbe, H.J., and Gentner, D.R. “Interfaces for consumer products: “how to camouflage the computer?”” in CHI’1992: Human factors in computing systems. 1992. Monterey, CA: pp. 287–290.Google Scholar
- 2.Chen, F., Myers, B., and Yaron, D., Using Handheld Devices for Tests in Classes. Carnegie Mellon University, School of Computer Science Technical Report no. CMU-CS-00-152 and Human Computer Interaction Institute Technical Report no. CMU-HCII-00-101, July, 2000. Pittsburgh, PA. http://www.cs.cmu.edu/~pebbles/papers/CMU-CS-00-152.pdf.
- 3.Haartsen, J., Naghshineh, M., Inouye, J., Joeressen, O.J., and Allen, W., “Bluetooth: Vision, Goals, and Architecture.” ACM Mobile Computing and Communications Review, 1998. 2(4): pp. 38–45. Oct. http://www.bluetooth.com.
- 4.Myers, B., Malkin, R., Bett, M., Waibel, A., Bostwick, B., Miller, R.C., Yang, J., Denecke, M., Seemann, E., Zhu, J., Peck, C.H., Kong, D., Nichols, J., and Scherlis, B., Flexi-modal and Multi-Machine User Interfaces. submitted for publication, 2002. http://www.cs.cmu.edu/~cpof/papers/cpoficmi02.pdf.
- 6.Myers, B.A., Bhatnagar, R., Nichols, J., Peck, C.H., Kong, D., Miller, R., and Long, A.C. “Interacting At a Distance: Measuring the Performance of Laser Pointers and Other Devices,” in ACM CHI’2002 Conference Proceedings: Human Factors in Computing Systems. 2002. Minn, MN: pp. 33–40.Google Scholar
- 7.Myers, B.A., Lie, K.P.L., and Yang, B.-C.J. “Two-Handed Input Using a PDA And a Mouse,” in Proceedings CHI’2000: Human Factors in Computing Systems. 2000. The Hague, The Netherlands: pp. 41–48.Google Scholar
- 8.Myers, B.A., Miller, R.C., Bostwick, B., and Evankovich, C. “Extending the Windows Desktop Interface With Connected Handheld Computers,” in 4th USENIX Windows Systems Symposium. 2000. Seattle, WA: pp. 79–88.Google Scholar
- 9.Myers, B.A., Peck, C.H., Nichols, J., Kong, D., and Miller, R. “Interacting At a Distance Using Semantic Snarfing,” in ACM UbiComp’2001. 2001. Atlanta, Georgia: pp. 305–314.Google Scholar
- 10.Myers, B.A., Stiel, H., and Gargiulo, R. “Collaboration Using Multiple PDAs Connected to a PC,” in Proceedings CSCW’98: ACM Conference on Computer-Supported Cooperative Work. 1998. Seattle, WA: pp. 285–294. http://www.cs.cmu.edu/~pebbles.
- 11.Myers, B.A., Wobbrock, J.O., Yang, S., Yeung, B., Nichols, J., and Miller, R. “Using Handhelds to Help People with Motor Impairments,” in Fifth International ACM SIGCAPH Conference on Assistive Technologies; ASSETS’02. 2002. Scotland: pp. To appear.Google Scholar
- 12.Nichols, J. “Informing Automatic Generation of Remote Control Interfaces with Human Designs,” in ACM CHI’2002 Extended Abstracts. 2002. Minneapolis, Minnesota: pp. 864–865. http://www-2.cs.cmu.edu/~jeffreyn/papers/chi2002puc.pdf.
- 13.Nichols, J., Myers, B.A., Harris, T.K., Rosenfeld, R., Shriver, S., Higgins, M., and Hughes, J. “Requirements for Automatically Generating Multi-Modal Interfaces for Complex Appliances,” in Submitted for Publication. 2002. http://www.cs.cmu.edu/~pebbles/papers/pucICMI.pdf.
- 14.Nichols, J., Myers, B.A., Higgins, M., Hughes, J., Harris, T.K., Rosenfeld, R., and Pignol, M. “Generating Remote Control Interfaces for Complex Appliances,” in Submitted for Publication. 2002. http://www.cs.cmu.edu/~pebbles/papers/PebblesPUCuist.pdf.
- 15.Nichols, J.W. “Using Handhelds as Controls for Everyday Appliances: A Paper Prototype Study,” in ACM CHI’2001 Extended Abstracts. 2001. Seattle, WA: pp. 443–444. http://www.cs.cmu.edu/~pebbles/papers/NicholsRemCtrlShortPaper.pdf.
- 16.V2 Working Group, Universal Remote Console Specification (AIAP-URC) of the Alternate Interface Access Prototocol (AIAP). http://www.ncits.org/tc_home/v2.htm, 2002.
- 17.Want, R., Schilit, B.N., Adams, N., Gold, R., Petersen, K., Goldberg, D., Ellis, J.R., and Weiser, M., “An Overview of the ParcTab Ubiquitous Computing Experiment.” IEEE Personal Communications, 1995. pp. 28–43. December. Also appears as Xerox PARC Technical Report CSL-95-1, March, 1995.Google Scholar
- 18.Zigbee Alliance, Zigbee Working Group Web Page for RF-Lite. 2002. http://www.zigbee.org/.