Skip to main content
SpringerLink
Log in

Multi-touch user interface evaluation for 3D object manipulation on mobile devices

  • Original Paper
  • Published:
Journal on Multimodal User Interfaces Aims and scope Submit manuscript

Abstract

Multi-touch user interfaces (MTUIs) can represent a valuable tool for enhancing human-machine interaction. The naturalness and variety of hand gestures offer a more direct and intuitive form of interaction that can be exploited in a large spectrum of applications. Moreover, 3D visualization on mobile devices is a task required by increasing number of scenarios ranging from video games to engineering. In this paper, the impact of MTUIs when applied to 3D scene navigation on handheld devices is investigated. Numerical measures as well as subjective results (based on user feedback) are exploited in order to analyze the effectiveness of MTUIs compared with a traditional button-based user interface. The two GUIs are compared in terms of time and number of interactions to complete three reference tests. In particular, a statistical analysis based on paired t-tests shows how the proposed MTUI can, in general, outperform a traditional button GUI; differences between GUIs are strongly reduced when a fine control of objects is required.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Courtemanche AA, Micire M, Holly Y (2007) Human-robot interaction using a multi-touch display. In: Proceedings of the 2nd annual IEEE tabletop workshop, poster presentation. IEEE, New York

    Google Scholar 

  2. Benko H, Wilson AD, Balakrishnan R (2008) Sphere: multi-touch interactions on a spherical display. In: UIST ’08: proceedings of the 21st annual ACM symposium on user interface software and technology. ACM, New York, pp 77–86

    Chapter  Google Scholar 

  3. Bredies K, Mann NA, Ahrens J, Geier M, Spors S, Nischt M (2008) The multi-touch soundscape renderer. In: AVI ’08: proceedings of the working conference on advanced visual interfaces. ACM, New York, pp 466–469

    Chapter  Google Scholar 

  4. Davidson PL, Han JY (2006) Synthesis and control on large scale multi-touch sensing displays. In: NIME ’06: proceedings of the 2006 conference on new interfaces for musical expression, Paris, France, pp 216–219.

  5. Dietz P, Leigh D (2001) Diamondtouch: a multi-user touch technology. In: UIST ’01: proceedings of the 14th annual ACM symposium on user interface software and technology. ACM, New York, pp 219–226

    Chapter  Google Scholar 

  6. Echtler F, Klinker G (2008) A multitouch software architecture. In: NordiCHI ’08: proceedings of the 5th Nordic conference on human-computer interaction. ACM, New York, pp 463–466

    Chapter  Google Scholar 

  7. Fisher Box J (1987) Guinness, Gosset, Fisher, and Small samples. Stat Sci 2(1):45–52

    Article  Google Scholar 

  8. Goose S, Güven S, Zhang X, Sudarsky S, Navab N (2003) Mobile 3D visualization and interaction in an industrial environment. In: Proceedings of the 10th international conference on human-computer interaction (HCI), pp 379–383

  9. Gross T, Fetter M, Liebsch S (2008) The cuetable: cooperative and competitive multi-touch interaction on a tabletop. In: CHI ’08: proceedings of the SIGCHI conference on human factors in computing systems, extended abstract. ACM, New York, pp 3465–3470

    Chapter  Google Scholar 

  10. Grossman T, Wigdor D (2007) Going deeper: a taxonomy of 3d on the tabletop. In: TABLETOP ’07: proceedings of the 2nd annual IEEE international workshop on horizontal interactive human-computer systems, pp 137–144

  11. Hafeneger S, Weiss M, Herkenrath G, Borchers J (2008) Pockettable: Mobile devices as multi-touch controllers for tabletop application development. In: Extended abstracts of tabletop ’08

  12. Han JY (2005) Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST ’05: proceedings of the 18th annual ACM symposium on user interface software and technology. ACM, New York, pp 115–118

    Chapter  Google Scholar 

  13. Han JY (2006) Multi-touch interaction wall. In: SIGGRAPH ’06: ACM SIGGRAPH 2006 emerging technologies. ACM, New York, p 25

    Chapter  Google Scholar 

  14. Hancock M, Carpendale S, Cockburn A (2007) Shallow-depth 3D interaction: design and evaluation of one-, two and three-touch techniques. In: CHI ’07: proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 1147–1156

    Chapter  Google Scholar 

  15. Hilli W (1982) A high resolution imaging touch sensor. Int J Robot Res 1(2):33–44

    Article  Google Scholar 

  16. Initiative EL (2008) 7 things you should know about multi-touch interfaces. http://net.educause.edu/ir/library/pdf/ELI7037.pdf

  17. Kristensson PO, Arnell O, Björk A, Dahlbäck N, Pennerup J, Prytz E, Wikman J, Åström N (2008) Infotouch: an explorative multi-touch visualization interface for tagged photo collections. In: NordiCHI ’08: proceedings of the 5th Nordic conference on human-computer interaction. ACM, New York, pp 491–494

    Chapter  Google Scholar 

  18. Jung Y, Keil J et al. (2008) Adapting X3D for Multi-touch Environments. In: Proceedings of WEB3D’ 08. ACM, Los Angeles, pp 27–30, 122

    Chapter  Google Scholar 

  19. Lee S, Buxton W, Smith KC (1985) A multi-touch three dimensional touch-sensitive tablet. SIGCHI Bull 16(4):21–25

    Article  Google Scholar 

  20. Micire M, Drury JL, Keyes B, Yanco HA (2008) Multi-touch interaction for robot control. In: IUI ’09: proceedings of the 13th international conference on intelligent user interfaces. ACM, New York, pp 425–428

    Chapter  Google Scholar 

  21. Microsoft (2007) Microsoft surface. http//www.microsoft.com/surface/

  22. Moscovich T (2006) Multi-touch interaction. In: CHI ’06: proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, pp 1775–1778

    Chapter  Google Scholar 

  23. Nestler S, Echtler F, Dollinger A, Klinker G (2008) Collaborative problem solving on mobile hand-held devices and stationary multi-touch interfaces. In: PPD’08. workshop on designing multi-touch interaction techniques for coupled public and private displays

  24. NextWindow (2008) Nextwindow multitouch. http//www.nextwindow.com/

  25. Pavlović VI, Sharma R, Huang TS (1996) Invited speech: gestural interface to a visual computing environment for molecular biologists. In: FG ’96: proceedings of the 2nd international conference on automatic face and gesture recognition. IEEE Computer Society, Los Alamitos, pp 52–73

    Google Scholar 

  26. Pavlović VI, Sharma R, Huang TS (1997) Visual interpretation of hand gestures for human-computer interaction: a review. IEEE Trans Pattern Anal Mach Intell 19:677–695

    Article  Google Scholar 

  27. Rekimoto J (2002) Smartskin: an infrastructure for freehand manipulation on interactive surfaces. In: CHI ’02: proceedings of the SIGCHI conference on human factors in computing systems, extended abstract. ACM, New York, pp 113–120

    Chapter  Google Scholar 

  28. de la Rivière J-B, Kervégant C, Orvain E, Dittlo N (2008) CubTile: a multi-touch cubic interface. In: VRST’08: proceedings of the 15th ACM symposium on virtual reality software and technology. ACM, New York, pp 69–72

    Google Scholar 

  29. Selker T (2008) Touching the future. Commun ACM 51:14–16

    Article  Google Scholar 

  30. Shen EL, Tsai SS, Chu HH, Hsu J, Chen CW (2009) Double-side multi-touch input for mobile devices. In: CHI ’09: proceedings of the SIGCHI conference on human factors in computing systems, extended abstract. ACM, New York

    Google Scholar 

  31. Shizuki B, Naito M, Tanaka J (2008) Browsing 3d media using cylindrical multi-touch interface. In: International symposium on multimedia, pp 489–490

  32. Westerman W, Elias J, Hedge A (2001) Multi-touch: a new tactile 2-d gesture interface for human-computer interaction. In: Proceedings of the human factors and ergonomics society 45th annual meeting, pp 632–636

  33. Wigdor D, Leigh D, Forlines C, Shipman S, Barnwell J, Balakrishnan R, Shen C (2006) Under the table interaction. In: UIST ’06: proceedings of the 19th annual ACM symposium on user interface software and technology. ACM, New York, pp 259–268

    Chapter  Google Scholar 

  34. Wilson AD, Izadi S, Hilliges O, Garcia-Mendoza A, Kirk D (2008) Bringing physics to the surface. In: UIST ’08: proceedings of the 21st annual ACM symposium on user interface software and technology. ACM, New York, pp 67–76

    Chapter  Google Scholar 

  35. Wright A (2009) Making sense of sensors. Commun ACM 52:14–15

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CSP s.c. a r.l., Via Livorno 60, 10144, Torino, Italy

    Donato Fiorella

  2. Dipartimento di Automatica e Informatica, Politecnico di Torino, C.so Duca degli Abruzzi 24, 10129, Torino, Italy

    Andrea Sanna & Fabrizio Lamberti

Authors
  1. Donato Fiorella
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrea Sanna
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fabrizio Lamberti
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Sanna.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Fiorella, D., Sanna, A. & Lamberti, F. Multi-touch user interface evaluation for 3D object manipulation on mobile devices. J Multimodal User Interfaces 4, 3–10 (2010). https://doi.org/10.1007/s12193-009-0034-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12193-009-0034-4

Search

Navigation