Lateral Touch Detection and Localization for Interactive, Augmented Planar Surfaces

  • A. NtelidakisEmail author
  • X. Zabulis
  • D. Grammenos
  • P. Koutlemanis
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9474)


This work regards fingertip contact detection and localization upon planar surfaces to provide interactivity in augmented displays implemented upon these surfaces, by projector-camera systems. In contrast to the widely employed approach where user hands are observed from above, lateral camera placement avails increased sensitivity to touch detection. An algorithmic approach for the treatment of the laterally acquired visual input is proposed and is comparatively evaluated against the conventional.



This work has been supported by the FORTH-ICS internal RTD Programme “Ambient Intelligence and Smart Environments”.


  1. 1.
    Bimber, O., Raskar, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. A.K. Peters Ltd., Natick (2005)CrossRefGoogle Scholar
  2. 2.
    Zabulis, X., Koutlemanis, P., Grammenos, D.: Augmented multitouch interaction upon a 2-DOF rotating disk. In: Bebis, G., et al. (eds.) ISVC 2012, Part I. LNCS, vol. 7431, pp. 642–653. Springer, Heidelberg (2012) CrossRefGoogle Scholar
  3. 3.
    Koutlemanis, P., et al.: A steerable multitouch display for surface computing and its evaluation. IJAIT 22, 1–29 (2013). doi: 10.1142/S0218213013600166 Google Scholar
  4. 4.
    Matsushita, N., Rekimoto, J.: Holowall: designing a finger, hand, body, and object sensitive wall. In: ACM UIST, pp. 209–210 (1997)Google Scholar
  5. 5.
    Han, J.: Low-cost multi-touch sensing through frustrated total internal reflection. In: ACM UIST, pp. 115–118 (2005)Google Scholar
  6. 6.
    Michel, D., et al.: Building a multi-touch display based on computer vision techniques. In: MVA, pp. 74–77 (2009)Google Scholar
  7. 7.
    Leibe, B., et al.: Toward spontaneous interaction with the perceptive workbench. IEEE CG&A 20, 54–65 (2000)Google Scholar
  8. 8.
    Wilson, A.: Using a depth camera as a touch sensor. In: ACM ITS, New York, NY, USA, pp. 69–72 (2010)Google Scholar
  9. 9.
    Klompmaker, F., et al.: Authenticated tangible interaction using RFID and depth-sensing cameras. In: ACHI, pp. 141–144 (2012)Google Scholar
  10. 10.
    Klompmaker, F., et al.: dSensingNI: a framework for advanced tangible interaction using a depth camera. In: TEI, pp. 217–224 (2012)Google Scholar
  11. 11.
    Wilson, A., Benko, H.: Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: ACM UIST, pp. 273–282 (2010)Google Scholar
  12. 12.
    Xiao, R., et al.: WorldKit: rapid and easy creation of ad-hoc interactive applications on everyday surfaces. In: CHI, pp. 879–888 (2013)Google Scholar
  13. 13.
    Harrison, C., et al.: OmniTouch: wearable multitouch interaction everywhere. In: UIST, pp. 441–450 (2011)Google Scholar
  14. 14.
    Jones, B., et al.: Build your world and play in it: Interacting with surface particles on complex objects. In: ISMAR, pp. 165–174 (2010)Google Scholar
  15. 15.
    Hilliges, O., et al.: HoloDesk: direct 3D interactions with a situated see-through display. In: ACM CHI, pp. 2421–2430 (2012)Google Scholar
  16. 16.
    Benko, H., Jota, R., Wilson, A.: MirageTable: freehand interaction on a projected augmented reality tabletop. In: ACM SIGCHI, pp. 199–208 (2012)Google Scholar
  17. 17.
    Jones, B., et al.: Roomalive: Magical experiences enabled by scalable, adaptive projector-camera units. In: ACM UIST, pp. 637–644 (2014)Google Scholar
  18. 18.
    Ntelidakis, A., Zabulis, X., Grammenos, D., Koutlemanis, P.: Lateral touch detection based on depth cameras. Technical report FORTH-ICS-459, Foundation for Research and Technology - Hellas, Institute for Computer Science (2015)Google Scholar
  19. 19.
    Smisek, J., et al.: 3D with Kinect. In: ICCV Workshops, pp. 1154–1160. IEEE (2011)Google Scholar
  20. 20.
    Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer, New York (2006)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • A. Ntelidakis
    • 1
    Email author
  • X. Zabulis
    • 1
  • D. Grammenos
    • 1
  • P. Koutlemanis
    • 1
  1. 1.Institute for Computer ScienceFoundation for Research and Technology - Hellas (FORTH)HeraklionGreece

Personalised recommendations