Advertisement

Towards Multimodal 3D Tabletop Interaction Using Sensor Equipped Mobile Devices

  • Florian Klompmaker
  • Karsten Nebe
  • Julien Eschenlohr
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 110)

Abstract

Interactive tabletops have been proven to be very suitable setups for collaborative work especially in combination with mobile devices. Further on, many application scenarios require the visualization of 3D data. Therefore we present multimodal 3D interaction techniques for tabletops that allow simultaneous control of six degrees of freedom using sensor equipped mobile devices. In two early user studies we compared multitouch, tangible interaction and sensor equipped smartphones in order to start a User Centered Design process. We got important results regarding effectiveness, intuitiveness and user experience. Most notably we figured out that mobile devices equipped with acceleration sensors are very suitable for 3D rotation tasks.

Keywords

Tabletop Multitouch 3D User Interface Mobile 3D Interaction Smartphone User Centered Design 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Akaoka, E., Ginn, T., Vertegaal, R.: DisplayObjects: prototyping functional physical interfaces on 3d styrofoam, paper or cardboard models. In: Fourth International Conference on Tangible, Embedded, and Embodied Interaction (TEI), pp. 49–56. ACM Press, New York (2010)CrossRefGoogle Scholar
  2. 2.
    Ishii, H., Ratti, C., Piper, B., Wang, Y., Biderman, A., Ben-Joseph, E.: Bringing Clay and Sand into Digital Design - Continuous Tangible user Interfaces. BT Technology Journal 22, 287–299 (2004)CrossRefGoogle Scholar
  3. 3.
    Piper, B., Ratti, C., Ishii, H.: Illuminating clay: Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 355–362. ACM Press, New York (2002)Google Scholar
  4. 4.
    Nebe, K., Klompmaker, F., Jung, H., Fischer, H.: Exploiting New Interaction Techniques for Disaster Control Management Using Multitouch-, Tangible- and Pen-Based-Interaction. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 100–109. Springer, Heidelberg (2011)Google Scholar
  5. 5.
    Nebe, K., Müller, T., Klompmaker, F.: An Investigation on Requirements for Co-located Group-Work Using Multitouch-, Pen-Based- and Tangible-Interaction. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part II, HCII 2011. LNCS, vol. 6762, pp. 90–99. Springer, Heidelberg (2011)Google Scholar
  6. 6.
    Kaschny, M., Buron, S., von Zadow, U., Sostmann, K.: Medical education on an interactive surface. In: ACM International Conference on Interactive Tabletops and Surfaces (IST), pp. 267–268. ACM Press, New York (2010)CrossRefGoogle Scholar
  7. 7.
    Conradi, B., Hommer, M., Kowalski, R.: From digital to physical: learning physical computing on interactive surfaces. In: ACM International Conference on Interactive Tabletops and Surfaces (IST), pp. 249–250. ACM Press, New York (2010)CrossRefGoogle Scholar
  8. 8.
    McCrindle, C., Hornecker, E., Lingnau, A., Rick, J.: The design of t-vote: a tangible tabletop application supporting children’s decision making. In: 10th International Conference on Interaction Design and Children, pp. 181–184. ACM Press, New York (2011)Google Scholar
  9. 9.
    Hornecker, E.: Tangible User Interfaces als kooperationsunterstützendes Medium, Doctoral Thesis, Elektronische Bibliothek, Staats und UniversitŁtsbibliothek Bremen (2004)Google Scholar
  10. 10.
    Shen, C., Ryall, K., Forlines, C., Esenther, A., Vernier, F.D., Everitt, K., Wu, M., Wigdor, D., Morris, M.R., Hancock, M., Tse, E.: Informing the Design of Direct-Touch Tabletops. IEEE Comput. Graph. Appl. 26, 36–46 (2006)CrossRefGoogle Scholar
  11. 11.
    Shen, C., Everitt, K., Ryall, K.: UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces. In: Dey, A.K., Schmidt, A., McCarthy, J.F. (eds.) UbiComp 2003. LNCS, vol. 2864, pp. 281–288. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  12. 12.
    Morris, M.R., Cassanego, A., Paepcke, A., Winograd, T., Piper, A.M., Huang, A.: Mediating Group Dynamics through Tabletop Interface Design. IEEE Comput. Graph. Appl. 26(5), 65–73 (2006)CrossRefGoogle Scholar
  13. 13.
    Kin, K., Agrawala, M., DeRose, T.: Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation. In: Graphics Interface, pp. 119–124. Canadian Information Processing Society (2009) Google Scholar
  14. 14.
    Yu, L., Svetachov, P., Isenberg, P., Everts, M.H., Isenberg, T.: FI3D: direct-touch interaction for the exploration of 3D scientific visualization spaces. IEEE Trans. Vis. Comput. Graph. 16(6), 1613–1622 (2010)CrossRefGoogle Scholar
  15. 15.
    Hancock, M., ten Cate, T., Carpendale, S.: Sticky tools: full 6DOF force-based interaction for multi-touch tables. In: ACM International Conference on Interactive Tabletops and Surfaces (IST), pp. 133–140. ACM Press, New York (2009)CrossRefGoogle Scholar
  16. 16.
    Martinet, A., Casiez, G., Grisoni, L.: The design and evaluation of 3D positioning techniques for multi-touch displays. In: IEEE Symposium on 3D User Interfaces, pp. 115–118. IEEE Press, New York (2010)Google Scholar
  17. 17.
    Reisman, J.L., Davidson, P.L., Han, J.Y.: A screen-space formulation for 2D and 3D direct manipulation. In: 22nd Annual ACM Symposium on User Interface Software and Technology (UIST), pp. 69–78. ACM Press, New York (2009)CrossRefGoogle Scholar
  18. 18.
    Klompmaker, F., Nebe, K.: Towards 3D Multitouch Interaction & Widgets. In: Workshop on Interaction Techniques in Real and Simulated Assistive Smart Environment, Workshop at the First International Joint Conference on Ambient Intelligence, AmI (2009)Google Scholar
  19. 19.
    Martinet, A., Casiez, G., Grisoni, L.: 3D positioning techniques for multi-touch displays. In: 16th ACM Symposium on Virtual Reality Software and Technology (VRST), pp. 227–228. ACM Press, New York (2009)CrossRefGoogle Scholar
  20. 20.
    Hilliges, O., Izadi, S., Wilson, A., Hodges, S., Garcia-Mendoza, A., Butz, A.: Interactions in the air: adding further depth to interactive tabletops. In: 22nd Annual ACM Symposium on User interface Software and Technology (UIST), pp. 139–148. ACM Press, New York (2009)CrossRefGoogle Scholar
  21. 21.
    Klompmaker, F., Nebe, K., Fast, A.: dSensingNI - A Framework for Advanced Tangible Interaction using a Depth Camera. In: Sixth International Conference on Tangible, Embedded, and Embodied Interaction (TEI), pp. 217–224. ACM Press, New York (2012)CrossRefGoogle Scholar
  22. 22.
    Cuypers, T., Francken, Y., Vanaken, C., van Reeth, F., Bekart, P.: Smartphone Localization on Interactive Surfaces Using the Built-in Camera. In: Procams, p. 448 (2009)Google Scholar
  23. 23.
    Wilson, A.D., Sarin, R.: BlueTable: connecting wireless mobile devices on interactive surfaces using vision-based handshaking. In: Graphics Interface, pp. 119–125. ACM Press, New York (2007)Google Scholar
  24. 24.
    Schmidt, D., Chehimi, F., Rukzio, E., Gellersen, H.: Phone- Touch: a technique for direct phone interaction on surfaces. In: 23nd Annual ACM Symposium on User Interface Software and Technology (UIST), pp. 13–16. ACM Press, New York (2010)CrossRefGoogle Scholar
  25. 25.
    Kaltenbrunner, M., Bovermann, T., Bencina, R., Costanza, E.: TUIO - A Protocol for Table Based Tangible User Interfaces. In: 6th International Workshop on Gesture in Human-Computer Interaction and Simulation (2005)Google Scholar
  26. 26.
    Ullrich, D., Diefenbach, S.: INTUI. Exploring the Facets of Intuitive Interaction. In: Mensch & Computer, p. 251. Oldenbourg Verlag (2010)Google Scholar

Copyright information

© ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering 2013

Authors and Affiliations

  • Florian Klompmaker
    • 1
  • Karsten Nebe
    • 2
  • Julien Eschenlohr
    • 1
  1. 1.C-LABUniversity of PaderbornPaderbornGermany
  2. 2.Rhine-Waal University of Applied SciencesKamp-LintfortGermany

Personalised recommendations