Changing Interfaces Using Natural Arm Posture – A New Interaction Paradigm for Pedestrian Navigation Systems on Mobile Devices

  • Ceren Kayalar
  • Selim Balcisoy
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4555)


This paper presents a new interaction technique, which is based on arm posture recognition, for mobile computing devices to switch between different visualization modes seamlessly. We implemented a pedestrian navigation system on Pocket PC, which is connected to a GPS receiver and an inertial orientation tracker. In the global coordinate system, user’s position is tracked with GPS data, and in the local coordinate system user’s arm posture is mapped into two application dependent states with inertial orientation tracker data. Hence, natural interaction and different levels of information is provided by processing orientation tracker data. As unnecessary computation and rendering increase power consumption in small devices, we introduced another state to our system, which saves battery according to the user’s idle arm posture.


Context-aware retrieval mobile computing interaction techniques posture recognition 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abowd, G.D., Dey, A.K., Brown, P.J., Davies, N., Smith, M., Steggles, P.: Towards a Better Understanding of Context and Context-Awareness. In: Gellersen, H.-W. (ed.) HUC 1999. LNCS, vol. 1707, Springer, Heidelberg (1999)Google Scholar
  2. 2.
    Amft, O., Junker, H., Troster, G.: Detection of eating and drinking arm gestures using intertial body-worn sensors. IEEE Symposium on Wearable Computers (2005)Google Scholar
  3. 3.
    Bao, L., Intille, S.S.: Activity Recognition from User-Annotated Acceleration Data. In: Ferscha, A., Mattern, F. (eds.) PERVASIVE 2004. LNCS, vol. 3001, pp. 1–17. Springer, Heidelberg (2004)Google Scholar
  4. 4.
    Burigat, S., Chittaro, L.: Location-aware visualization of VRML models in GPS-based mobile guides. In: Web3D 2005: Proceedings of the tenth international conference on 3D Web technology, pp. 57–64. ACM Press, New York (2005)CrossRefGoogle Scholar
  5. 5.
    Cheng, Y., Chawathe, Y., Lamarca, A., Krumm, J.: Accuracy characterization for metropolitanscale wi-fi localization. Third International Conference on Mobile Systems, Applications and Services (2005)Google Scholar
  6. 6.
    Feiner, S., MacIntyre, B., Höllerer, T., Webster, A.: A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment. In: Proc. ISWC 1997. Cambridge, MA, USA, pp. 74–81 (1997)Google Scholar
  7. 7.
    Foxlin, E.: Pedestrian Tracking with Shoe-Mounted Intertial Sensors. IEEE Computer Graphics and Applications (November/December 2005)Google Scholar
  8. 8.
    GLUT|ES - The OpenGL|ES Utility Toolkit (April 2006),
  9. 9.
    Howard, A., Siddiqi, S., Sukhatme, G.S.: An experimental study of localization using wireless ethernet. In: Proceedings of the 4th International Conference on Field and Service Robotics, Lake Yamanaka, Japan (2003)Google Scholar
  10. 10.
    Lee, S., Mase, K.: Activity and Location Recognition Using Wearable Sensors. IEEE Pervasive Computing 1(3), 24–32 (2002)CrossRefGoogle Scholar
  11. 11.
    Lee, S., Mase, K.: Recognition of Walking Behaviors for Pedestrian Navigation. In: Proc. of IEEE International Conference on Control Applications, Mexico City, Mexico (2001)Google Scholar
  12. 12.
    Peternier, A., Vexo, F., Thalmann, D.: Wearable Mixed Reality System In Less Than 1 Pound. Eurographics Symposium on Virtual Environments (2006)Google Scholar
  13. 13.
    Rohs, M.: Real-world interaction with camera-phones. In: International Symposium on Ubiquitous Computing Systems (2004)Google Scholar
  14. 14.
    Schmalstieg, D., Reitmayr, G.: Augmented Reality as a Medium for Cartography. In: Cartwright, W., Peterson, M., Gartner, G. (eds.) Multimedia Cartography, 2nd edn. Springer, Heidelberg (2006)Google Scholar
  15. 15.
    Shimada, S., Tanizaki, M., Maruyama, K.: Ubiquitous Spatial-Information Services Using Cell Phones. IEEE Micro (2002)Google Scholar
  16. 16.
    Vincent Mobile 3D Rendering Library (2006),
  17. 17.
    Wagner, D., Schmalstieg, D.: First Steps Towards Handheld Augmented Reality. In: Proc. Seventh IEEE International Symposium on Wearable Computers (2003)Google Scholar
  18. 18.
    Widgor, D., Balakrishnan, R.: TiltText: Using Tilt for Text Input to Mobile Phones, UIST 2003, CHI Letters, vol. 5(2) (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Ceren Kayalar
    • 1
  • Selim Balcisoy
    • 1
  1. 1.Sabanci University, Computer Graphics Laboratory, Istanbul, 34956Turkey

Personalised recommendations