Skip to main content
SpringerLink
Log in

Review on Methods in Touch Tracking for Tabletop Projections

  • Conference paper
  • First Online:
HCI International 2020 - Posters (HCII 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1224))

Included in the following conference series:

  • 2332 Accesses

Abstract

Interactive tabletop projections overlay an interface into the spatial environment and enable new and frameless fields of interaction. The continually evolving technology has potential in several application areas. In contrast to traditional invasive technology setups such as displays, capacitive foils, or infrared grids, projected systems do not require any construction of the interaction surface. This overview intends to present the current state of the art in touch tracking methods for tabletop projections and identify the potential of such environments as a new generation of interfaces for current and future research in this emerging field. It reviews selected novel methods for touch input, using sensors, on a flat surface projection, including a timeline of selected recent work, and a summary showing the characteristics, primary strengths, and drawbacks. Methods using machine learning are promising and linked to research in mid-air fingertip recognition, as implementations using depth and infrared sensors are more sophisticated in terms of fingertip recognition and accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Cadena, A., Carvajal, R., Guaman, B., Granda, R., Pelaez, E., Chiluiza, K.: Fingertip detection approach on depth image sequences for interactive projection system. In: 2016 IEEE Ecuador Technical Chapters Meeting, ETCM 2016. pp. 1–6. Institute of Electrical and Electronics Engineers Inc. (10 2016). https://doi.org/10.1109/ETCM.2016.7750827. http://ieeexplore.ieee.org/document/7750827/

  2. Chai, Z., Shilkrot, R.: Enhanced touchable projector-depth system with deep hand pose estimation. CoRR abs/1812.11090 (2018). http://arxiv.org/abs/1812.11090

  3. Cheng, J., Wang, Q., Song, R., Wu, X.: Fingertip-based interactive projector-camera system. Sig. Process. 110, 54–66 (2015). https://doi.org/10.1016/j.sigpro.2014.08.043

    Article  Google Scholar 

  4. Choi, O., Son, Y.J., Lim, H., Ahn, S.C.: Co-recognition of multiple fingertips for tabletop human-projector interaction. IEEE Trans. Multimed. 21(6), 1487–1498 (2019). https://doi.org/10.1109/TMM.2018.2880608. https://ieeexplore.ieee.org/document/8528493/

    Article  Google Scholar 

  5. Dolata, M., et al.: Welcome, computer! How do participants introduce a collaborative application during face-to-face interaction? In: Lamas, D., Loizides, F., Nacke, L., Petrie, H., Winckler, M., Zaphiris, P. (eds.) INTERACT 2019. LNCS, vol. 11748, pp. 600–621. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-29387-1_35

    Chapter  Google Scholar 

  6. Fujinawa, E., Goto, K., Irie, A., Wu, S., Xu, K.: Occlusion-aware hand posture based interaction on tabletop projector. In: UIST 2019 Adjunct - Adjunct Publication of the 32nd Annual ACM Symposium on User Interface Software and Technology, pp. 113–115. Association for Computing Machinery, Inc. (10 2019). https://doi.org/10.1145/3332167.3356890

  7. Gao, Y., Huang, C.M.: PATI: A projection-based augmented table-top interface for robot programming. In: International Conference on Intelligent User Interfaces, Proceedings IUI, vol. Part F1476, pp. 345–355. Association for Computing Machinery (2019). https://doi.org/10.1145/3301275.3302326

  8. Gregor, D., Prucha, O., Rocek, J., Kortan, J.: Digital playgroundz ACM reference format. ACM SIGGRAPH 2017 VR Village on - SIGGRAPH 2017, pp. 1–2 (2017). https://doi.org/10.1145/3089269.3089288. http://dl.acm.org/citation.cfm?doid=3089269.3089288

  9. Laput, G., Harrison, C.: SurfaceSight: a new spin on touch, user, and object sensing for IoT experiences. In: Conference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery, May 2019. https://doi.org/10.1145/3290605.3300559

  10. Lee, D.S., Kwon, S.K.: Virtual touch sensor using a depth camera. Sensors (Switzerland) 19(4) (2019). https://doi.org/10.3390/s19040885

  11. Matsubara, T., Mori, N., Niikura, T., Tano, S.: Touch detection method for non-display surface using multiple shadows of finger. In: 2017 IEEE 6th Global Conference on Consumer Electronics, GCCE 2017, vol. 2017-January, pp. 1–5. Institute of Electrical and Electronics Engineers Inc., December 2017. https://doi.org/10.1109/GCCE.2017.8229364

  12. Murugappan, S., Vinayak, Elmqvist, N., Ramani, K.: Extended multitouch: recovering touch posture and differentiating users using a depth camera. In: UIST 2012 - Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, pp. 487–496 (2012). https://doi.org/10.1145/2380116.2380177

  13. Son, Y.J., Choi, O., Lim, H., Ahn, S.C.: Depth-based fingertip detection for human-projector interaction on tabletop surfaces. In: 2016 IEEE International Conference on Consumer Electronics-Asia, ICCE-Asia 2016. Institute of Electrical and Electronics Engineers Inc., January 2017. https://doi.org/10.1109/ICCE-Asia.2016.7804809

  14. Wilson, A.D.: Using a depth camera as a touch sensor. In: ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, pp. 69–72 (2010). https://doi.org/10.1145/1936652.1936665

  15. Wu, Q., Wang, J., Wang, S., Su, T., Yu, C.: MagicPAPER. In: ACM SIGGRAPH 2019 Posters on - SIGGRAPH 2019, pp. 1–2. ACM Press, New York (2019). https://doi.org/10.1145/3306214.3338575. https://dl.acm.org/citation.cfm?doid=3306214.3338575

  16. Xiao, R.: SIGCHI outstanding dissertation award: on-world computing. In: Conference on Human Factors in Computing Systems - Proceedings, pp. 1–4. ACM Press, New York (2019). https://doi.org/10.1145/3290607.3313774. http://dl.acm.org/citation.cfm?doid=3290607.3313774

  17. Xiao, R., Harrison, C., Hudson, S.E.: WorldKit: rapid and easy creation of ad-hoc interactive applications on everyday surfaces. In: Conference on Human Factors in Computing Systems - Proceedings, pp. 879–888 (2013). https://doi.org/10.1145/2470654.2466113

  18. Xiao, R., Hudson, S., Harrison, C.: DIRECT: making touch tracking on ordinary surfaces practical with hybrid depth-infrared sensing. In: Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces: Nature Meets Interactive Surfaces, ISS 2016, pp. 85–94. Association for Computing Machinery, Inc., November 2016. https://doi.org/10.1145/2992154.2992173

  19. Zhang, L., Matsumaru, T.: Near-field touch interface using time-of-flight camera. J. Robot. Mechatron. 28(5), 759–775 (2016). https://doi.org/10.20965/jrm.2016.p0759. https://www.fujipress.jp/jrm/rb/robot002800050759

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Interactive Technologies, University of Applied Sciences and Arts Northwestern, Brugg-Windisch, Switzerland

    Severin Pereto & Doris Agotai

Authors
  1. Severin Pereto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Doris Agotai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Severin Pereto or Doris Agotai .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pereto, S., Agotai, D. (2020). Review on Methods in Touch Tracking for Tabletop Projections. In: Stephanidis, C., Antona, M. (eds) HCI International 2020 - Posters. HCII 2020. Communications in Computer and Information Science, vol 1224. Springer, Cham. https://doi.org/10.1007/978-3-030-50726-8_37

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-50726-8_37

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-50725-1

  • Online ISBN: 978-3-030-50726-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation