iCam: Precise at-a-Distance Interaction in the Physical Environment

  • Shwetak N. Patel
  • Jun Rekimoto
  • Gregory D. Abowd
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3968)


Precise indoor localization is quickly becoming a reality, but application demonstrations to date have been limited to use of only a single piece of location information attached to an individual sensing device. The localized device is often held by an individual, allowing applications, often unreliably, to make high-level predictions of user intent based solely on that single piece of location information. In this paper, we demonstrate how effective integration of sensing and laser-assisted interaction results in a handheld device, the iCam, which simultaneously calculates its own location as well as the location of another object in the environment. We describe how iCam is built and demonstrate how location-aware at-a-distance interaction simplifies certain location-aware activities.


Physical Space Augmented Reality Ubiquitous Computing Laser Pointer Tour Guide 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abowd, G.D., Atkeson, C.G., Hong, J., Long, S., Kooper, R., Pinkerton, M.: Cyberguide: A Mobile Context-Aware Tour Guide. ACM Wireless Networks 3, 421–433 (1997)CrossRefGoogle Scholar
  2. 2.
    Active Bat. The BAT Ultrasonic Location System (2006),
  3. 3.
    Bahl, P., Padmanabhan, V.: RADAR: An In-Building RF-Based User Location and Tracking System. In: The proceedings of IEEE Infocom 2000, Los Alamitos, pp. 775–784 (2000)Google Scholar
  4. 4.
    Cheverst, K., Davies, N., Mitchell, K., Friday, A., Efstratiou, C.: Developing a Context-aware Electronic Tourist Guide: Some Issues and Experiences. In: The proceedings of Conference on Human Factors in Computing Systems (CHI) 2000, Netherlands, April 2000, pp. 17–24 (2000)Google Scholar
  5. 5.
    Cooperstock, J.R., Fels, S.S., Buxton, W., Smith, K.C.: Reactive Environments: Throwing Away Your Keyboard and Mouse. Communications of the ACM 40, 65–73 (1997)CrossRefGoogle Scholar
  6. 6.
    Dey, A.K., Abowd, G.D.: CybreMinder: A Context-Aware System for Supporting Reminders. In: The Proceedings of The 2nd International Symposium on Handheld and Ubiquitous Computing (HUC2K), Bristol, UK, September 2000, pp. 172–186 (2000)Google Scholar
  7. 7.
    Dey, A.K., Hamid, R., Beckmann, C., Li, I., Hsu, D.: aCAPpella: Programming by Demonstration of Context-Aware Applications. In: Proceedings of Conference on Human Factors in Computing Systems (CHI) 2004, April 2004, pp. 33–40 (2004)Google Scholar
  8. 8.
    Dow, S., Lee, J., Oezbek, C., MacIntyre, B., Bolter, J.D., Gandy, M.: Exploring Spatial Narratives and Mixed Reality Experiences in Oakland Cemetery. In: The proceedings of ACM SIGCHI Conference on Advances in Computer Entertainment (ACE 2005), Valencia, Spain (June 2005)Google Scholar
  9. 9.
    Hightower, J., Borriello, G.: A Survey and Taxonomy of Location Systems for Ubiquitous Computing, University of Washington Tech Report CSC-01-08-03 (2001)Google Scholar
  10. 10.
    Kirstein, C., Mueller, H.: Interaction with a Projection Screen using a Camera-tracked Laser Pointer. In: The Proceedings of The International Conference on Multimedia Modeling, Lausanne, Switzerland (1998)Google Scholar
  11. 11.
    Lamming, M., Flynn, M.: Forget-me-not: Intimate Computing in Support of Human Memory. In: The Proceedings of The Symposium on Next Generation Human Interfaces, Tokyo, Japan (1994)Google Scholar
  12. 12.
    LaMarca, A., Chawathe, Y., Consolvo, S., Hightower, J., Smith, I., Scott, J., Sohn, T., Howard, J., Hughes, J., Potter, F., Tabert, J., Powledge, P.S., Borriello, G., Schilit, B.N.: Place lab: Device positioning using radio beacons in the wild. In: Gellersen, H.-W., Want, R., Schmidt, A. (eds.) PERVASIVE 2005. LNCS, vol. 3468, pp. 116–133. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  13. 13.
    Li, Y., Hong, J.I., Landay, J.A.: Topiary: a tool for prototyping location-enhanced applications. In: The Proceedings of The ACM Symposium on User interface Software and Technology (UIST 2004), Santa Fe, NM, October 2004, pp. 217–226 (2004)Google Scholar
  14. 14.
    Madhavapeddy, A., Tse, A.: A study of bluetooth propagation using accurate indoor location mapping. In: Beigl, M., Intille, S.S., Rekimoto, J., Tokuda, H. (eds.) UbiComp 2005. LNCS, vol. 3660, pp. 105–122. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  15. 15.
    Myers, B.A., Bhatnagar, R., Nichols, J., Peck, C.H., Kong, D., Miller, R., Long, A.C.: Interacting at a Distance: Measuring the Performance of Laser Pointers and Other Devices. In: The Proceedings of Conference on Human Factors in Computing Systems (CHI 2002), Minneapolis, Minnesota (2002)Google Scholar
  16. 16.
    Mynatt, E.D., Back, M., Want, R., Baer, M., Ellis, J.B.: Designing Audio Aura. In: The Proceedings of Conference on Human Factors in Computing Systems (CHI 1998), April 1998, pp. 566–573 (1998)Google Scholar
  17. 17.
    Olsen, D.R., Nielsen, T.: Laser Pointer Interaction. In: The Proceedings of Conference on Human Factors in Computing Systems (CHI 2001), Seattle, Washington (2001)Google Scholar
  18. 18.
    Otsason, V., Varshavsky, A., LaMarca, A., de Lara, E.: Accurate GSM indoor localization. In: Beigl, M., Intille, S.S., Rekimoto, J., Tokuda, H. (eds.) UbiComp 2005. LNCS, vol. 3660, pp. 141–158. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  19. 19.
    Patel, S.N., Abowd, G.D.: A 2-way laser-assisted selection scheme for handhelds in a physical environment. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 200–207. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  20. 20.
    Priyantha, N.B., Chakraborty, A., Balakrishnan, H.: The Cricket Location-Support System. In: The Proceedings of The International Conference on Mobile Computing and Networking (Mobicom 2000), Boston, MA (August 2000)Google Scholar
  21. 21.
    Ringwald, M.: Spontaneous Interaction with Everyday Devices Using a PDA. In: Workshop on Supporting Spontaneous Interaction in Ubiquitous Computing Settings. Ubicomp 2002. Goeteborg, Sweden (2002)Google Scholar
  22. 22.
    Rekimoto, J., Ayatsuka, Y.: CyberCode: Designing Augmented Reality Environments with Visual Tags. In: The Proceedings of Designing Augmented Reality Environments (DARE 2000), Elsinore, Denmark, pp. 1–10 (2000)Google Scholar
  23. 23.
    Rekimoto, J., Katashi, N.: The World through the Computer: Computer Augmented Interaction with Real World Environments. In: The Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 1995), Pittsburgh, PA, pp. 29–36 (1995)Google Scholar
  24. 24.
    Ubisense (2005),
  25. 25.
    Want, R., Fishkin, K., Gujar, A., Harrison, B.: Bridging physical and virtual worlds with electronic tags. In: The Proceedings of Conference on Human Factors in Computing Systems (CHI 2001), Pittsburgh, PA (1999)Google Scholar
  26. 26.
    Want, R., Hopper, A., Falcao, V., Gibbons, J.: The active badge location system. ACM Transactions on Information Systems 10, 91–102 (1992)CrossRefGoogle Scholar
  27. 27.
    Wilson, A., Pham, H.: Pointing in Intelligent Environments with the WorldCursor. In: The Proceedings of Interact 2003, Zurich, Switzerland (September 2003)Google Scholar
  28. 28.
    Wilson, A., Shafer, S., XWand, U.I.: for intelligent spaces. In: The Proceedings of Conference on Human Factors in Computing Systems (CHI 2003), April 2003, pp. 545–552. Ft. Lauderdale, Florida (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Shwetak N. Patel
    • 1
  • Jun Rekimoto
    • 2
  • Gregory D. Abowd
    • 1
  1. 1.College of Computing & GVU Center, Georgia Institute of TechnologyAtlantaUSA
  2. 2.Interaction Laboratory, Sony Computer Science Laboratories, Inc.TokyoJapan

Personalised recommendations