HDCMD: A Clustering Algorithm to Support Hand Detection on Multitouch Displays

  • Bojan Blažica
  • Daniel Vladušič
  • Dunja Mladenić
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7946)

Abstract

This paper describes our approach to hand detection on a multitouch surface i.e. detecting how many hands are currently on the surface and associating each touch point to its corresponding hand. Our goal was to find a general software-based solution to this problem applicable to all multitouch surfaces regardless of their construction. We therefore approached hand detection with a limited amount of information: the position of each touch point. We propose HDCMD (Hand Detection with Clustering on Multitouch Displays), a simple clustering algorithm based on heuristics that exploit the knowledge of the anatomy of the human hand. The proposed hand detection algorithm’s accuracy evaluated on synthetic data (97%) significantly outperformed XMeans (21%) and DBScan (67%).

Keywords

Hand Detection Multitouch Clustering Co-located Groupware 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Buxton, W.: Multi-Touch Systems That I Have Known and Loved, http://www.billbuxton.com/multitouchOverview.html (last accessed January 25, 2013)
  2. 2.
    Benko, H., Morris, M.R., Brush, A.J.B., Wilson, A.D.: Insights on Interactive Tabletops: A Survey of Researchers and Developers (2009), http://research.microsoft.com
  3. 3.
    Leganchuk, A., Zhai, S., Buxton, W.: Manual and cognitive benefits of two-handed input: an experimental study. ACM Transactions on Computer-Human Interaction (TOCHI) 5(4), 326–359 (1998)CrossRefGoogle Scholar
  4. 4.
    Kin, K., Agrawala, M., DeRose, T.: Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. In: Proceedings of Graphics Interface, pp. 119–124. Canadian Information Processing Society, Ontario (2009)Google Scholar
  5. 5.
    Ringel Morris, M., Huang, A., Paepcke, A., Winograd, T.: Cooperative Gestures: Multi-User Gestural Interactions For Co-Located Groupware. In: Proceedings of the ACM Chi Conference on Human Factors in Computing Systems, pp. 1201–1210. ACM (2006)Google Scholar
  6. 6.
    Terrenghi, L., Kirk, D., Sellen, A., Izadi, S.: Affordances For Manipulation of Physical Versus Digital Media on Interactive Surfaces. In: Proceedings of the Sigchi Conference on Human Factors in Computing Systems, Chi 2007, pp. 1157–1166. ACM (2007)Google Scholar
  7. 7.
    Rogers, Y., Lim, Y.K., Hazlewood, W.R., Marshall, P.: Equal Opportunities: Do Shareable Interfaces Promote More Group Participation Than Single Users Displays? In: Human-Computer Interaction, vol. 24(1-2), pp. 79–116. Taylor & Francis (2009)Google Scholar
  8. 8.
    Malik, S., Laszlo, J.: Visual Touchpad: A Two-Handed Gestural Input Device. In: Icmi 2004: Proceedings of the 6th International Conference On Multimodal Interfaces, pp. 289–296. ACM, New York (2004)Google Scholar
  9. 9.
    Wu, M., Balakrishnan, R.: Multi-Finger and Whole Hand Gestural Interaction Techniques For Multi-User Tabletop Displays. In: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology, Uist 2003, pp. 193–202. ACM, New York (2003)CrossRefGoogle Scholar
  10. 10.
    Peltonen, P., Kurvinen, E., Salovaara, A., Jacucci, G., Ilmonen, T., Evans, J., Oulasvirta, A., Saarikko, P.: It’s Mine, Don’t Touch!: Interactions At A Large Multi-Touch Display in A City Centre. In: Proceeding of the Twenty-Sixth Annual Sigchi Conference on Human Factors in Computing Systems, Chi 2008, pp. 1285–1294. ACM, New York (2008)CrossRefGoogle Scholar
  11. 11.
    Dietz, P., Leigh, D.: DiamondTouch: a multi-user touch technology. In: Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology, pp. 219–226. ACM (2001)Google Scholar
  12. 12.
    Schmidt, D.: Know Thy Toucher. In: CHI 2009 Workshop Multitouch and Surface Computing, Boston (2009)Google Scholar
  13. 13.
    Schmidt, D., Chong, M.K., Gellersen, H.: Handsdown: Hand-Contour-Based User Identification For Interactive Surfaces. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, Nordichi 2010, pp. 432–441. ACM, New York (2010)CrossRefGoogle Scholar
  14. 14.
    Dohse, K.C., Dohse, T., Still, J.D., Parkhurst, D.J.: Enhancing multi-user interaction with multi-touch tabletop displays using hand tracking. In: 2008 First International Conference on Advances in Computer-Human Interaction, pp. 297–302. IEEE (2008)Google Scholar
  15. 15.
    Echtler, F., Huber, M., Klinker, G.: Shadow Tracking on Multi-Touch Tables. In: Proceedings of the Working Conference on Advanced Visual Interfaces, Avi 2008, pp. 388–391. ACM, New York (2008)CrossRefGoogle Scholar
  16. 16.
    Marquardt, N., Kiemer, J., Greenberg, D.: What Caused That Touch?: Expressive Interaction With A Surface Through Fiduciary-Tagged Gloves. In: ACM International Conference on Interactive Tabletops and Surfaces, Its 2010, pp. 139–142. ACM, New York (2010)CrossRefGoogle Scholar
  17. 17.
    Ringel Morris, M., Huang, A., Paepcke, A., Winograd, T.: Cooperative Gestures: Multi-User Gestural Interactions For Co-Located Groupware. In: Proceedings of the ACM Chi Conference on Human Factors in Computing Systems, pp. 1201–1210. ACM (2006)Google Scholar
  18. 18.
    Han, J.Y.: Low-Cost Multi-Touch Sensing Through Frustrated Total Internal Reflection. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, Uist 2005, pp. 115–118. ACM, New York (2005)CrossRefGoogle Scholar
  19. 19.
    Çetin, G., Bedi, R., Sandler, S.: Multi-touch Technologies, 1st edn. (2009)Google Scholar
  20. 20.
    Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E.: Tuio: a Protocol for Table-Top Tangible User Interfaces. In: Proceedings of the 6th International Workshop on Gesture in Human Computer Interaction and Simulation GW, pp. 1–5 (2005)Google Scholar
  21. 21.
    Kotsiantis, S., Pintelas, P.: Recent advances in clustering: A brief survey. WSEAS Transactions on Information Science and Applications 1(1), 73–81 (2004)Google Scholar
  22. 22.
    Schmidt, D., Chong, M.K., Gellersen, H.: Handsdown: Hand-Contour-Based User Identification For Interactive Surfaces. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, Nordichi 2010, pp. 432–441. ACM, New York (2010)CrossRefGoogle Scholar
  23. 23.
    Ester, M., Kriegel, H.P., Jörg, S., Xu, X.: A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases With Noise. In: Proceedings of The ACM Sigkdd International Conference on Knowledge Discovery And Data Mining, pp. 226–231. AAAI Press (1996)Google Scholar
  24. 24.
    Laufs, U., Ruff, C., Zibuschka, J.: Mt4j – A Cross-Platform Multi-Touch Development Framework. In: Engineering Patterns for Multi-Touch Interfaces, Workshop of the ACM Sigchi Symposium on Engineering Interactive Computing Systems (2010)Google Scholar
  25. 25.
    Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.: The Weka Data Mining Software: an Update. Special Interest Group on Knowledge Discovery and Data Mining Explorer Newsletter 11(1), 10–18 (2009)Google Scholar
  26. 26.
    Scott, S.D., Sheelagh, M., Carpendale, T., Inkpen, K.M.: Territoriality in Collaborative Tabletop Workspaces. In: Proceedings of Cscw 2004, pp. 294–303. ACM (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Bojan Blažica
    • 1
    • 2
  • Daniel Vladušič
    • 1
  • Dunja Mladenić
    • 2
  1. 1.XLAB ResearchLjubljnaSlovenia
  2. 2.Jožef Stefan International Postgraduate SchoolLjubljanaSlovenia

Personalised recommendations