Skip to main content
SpringerLink
Log in

Designing Mid-Air Gesture Interaction with Mobile Devices for Older Adults

  • Chapter
  • First Online:
Book cover Perspectives on Human-Computer Interaction Research with Older People

Part of the book series: Human–Computer Interaction Series ((HCIS))

Abstract

This chapter presents a user-centered perspective on the design of effective mid-air gesture interaction with mobile technology for seniors. Starting from the basic characteristics of mid-air gesture interaction, we introduce the main design challenges of this interaction and report on a case study in which we implemented a user-centered design process focused on the engagement of older adults in each design stage. We present a series of studies in which we aimed at involving older users as active creators of the interaction, taking into account their feedback and values in the design process. Finally, we propose a set of recommendations for the design of mid-air gesture interaction for older adults. These recommendations are elaborated combining research on HCI, ageing and ergonomic principles, and the results from the user studies we conducted in the process.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.eldy.org/.

  2. 2.

    http://www.nanocritical.com/wave-o-rama/.

  3. 3.

    https://www.breezie.com/.

  4. 4.

    https://www.myo.com/.

  5. 5.

    https://play.google.com/store/apps/details?id=in.tank.corp.proximity&hl=en.

  6. 6.

    https://play.google.com/store/apps/details?id=com.ewtech.launcher&hl=it.

  7. 7.

    https://play.google.com/store/apps/details?id=name.kunes.android.launcher.activity&hl=en

  8. 8.

    http://www.samsung.com/it/consumer/mobile-devices/wearables/gear/SM-R3810ZKAITV/.

References

  • Bobeth J, Schmehl S, Kruijff E et al (2012) Evaluating performance and acceptance of older adults using freehand gestures for TV menu control. In: Proceedings of the 10th European conference on interactive TV and video. ACM, pp 35–44

    Google Scholar 

  • Bødker S (2006) When second wave HCI meets third wave challenges. In: Proceedings of the 4th Nordic conference on human-computer interaction: changing roles. ACM, pp 1–8

    Google Scholar 

  • Borg G (1998) Borg’s perceived exertion and pain scales. Human Kinetics, Champaign

    Google Scholar 

  • Boring S, Jurmu M, Butz A (2009) Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In: Proceedings of the 21st annual conference of the Australian computer-human interaction special interest group: design: open 24/7. ACM, pp 161–168

    Google Scholar 

  • Cabreira AT, Hwang F (2016) How do novice older users evaluate and perform mid-air gesture interaction for the first time? Paper presented at the proceedings of the 9th Nordic conference on human-computer interaction, Gothenburg, Sweden

    Google Scholar 

  • Camunas-Mesa L, Zamarreno-Ramos C, Linares-Barranco A et al (2012) An event-driven multi-kernel convolution processor module for event-driven vision sensors. IEEE J Solid-State Circuits 47:504–517

    Article  Google Scholar 

  • Carbini S, Delphin-Poulat L, Perron L et al (2006) From a Wizard of Oz experiment to a real time speech and gesture multimodal interface. Sig Process 86:3559–3577

    Article  MATH  Google Scholar 

  • Carreira M, Ting KLH, Csobanka P et al (2016) Evaluation of in-air hand gestures interaction for older people. Univers Access Inf Soc 16:1–20

    Article  Google Scholar 

  • Chen J, Proctor RW (2013) Response–Effect compatibility defines the natural scrolling direction. Hum Factors 55:1112–1129. https://doi.org/10.1177/0018720813482329

    Article  Google Scholar 

  • Cockburn A, Quinn P, Gutwin C et al (2011) Air pointing: design and evaluation of spatial target acquisition with and without visual feedback. Int J Hum Comput Stud 69:401–414

    Article  Google Scholar 

  • Cronin D (2014) Usability of Micro- vs. Macro-gestures in camera-based gesture interaction. Diplomarbeit, California Polytechnic State University, San Luis Obispo. (Zitiert auf Seite 21)

    Google Scholar 

  • Delamare W, Janssoone T, Coutrix C et al (2016) Designing 3D gesture guidance: visual feedback and feedforward design options. In: Proceedings of the international working conference on advanced visual interfaces. ACM, pp 152–159

    Google Scholar 

  • Eaton C (1997) Electronic textbook on hand surgery. http://www.eatonhand.com

  • England D (2011) Whole body interaction: an introduction. In: Whole body interaction. Springer, London, pp 1–5

    Chapter  Google Scholar 

  • Ferron M, Mana N, Mich O (2015) Mobile for older adults: towards designing multimodal interaction. In: Proceedings of the 14th international conference on mobile and ubiquitous multimedia. ACM, pp 373–378

    Google Scholar 

  • Ferron M, Mana N, Mich O et al (2018) Design of multimodal interaction with mobile devices. Challenges for visually impaired and elderly users. In: 3rd international conference on human computer interaction theory and applications (HUCAPP). Funchal, Madeira. 140–146

    Google Scholar 

  • Gerling K, Dergousoff K, Mandryk R (2013) Is movement better? Ccomparing sedentary and motion-based game controls for older adults. In: Proceedings of graphics interface 2013. Canadian Information Processing Society, pp 133–140

    Google Scholar 

  • Gerling K, Livingston I, Nacke L et al (2012) Full-body motion-based game interaction for older adults. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 1873–1882

    Google Scholar 

  • Green P, Wei-Haas L (1985) The rapid development of user interfaces: experience with the wizard of Oz method. In: Proceedings of the human factors society annual meeting. Sage, Los Angeles, CA, pp 470–474

    Article  Google Scholar 

  • Gutman J (1982) A means-end chain model based on consumer categorization processes. J Mark 46:60–72

    Article  Google Scholar 

  • Harrison S, Sengers P, Tatar D (2011) Making epistemological trouble: third-paradigm HCI as successor science. Interact Comput 23:385–392

    Article  Google Scholar 

  • Hassani AZ, Van Dijk B, Ludden G et al (2011) Touch versus in-air hand gestures: evaluating the acceptance by seniors of human-robot interaction. In: International joint conference on ambient intelligence. Springer, pp 309–313

    Google Scholar 

  • HincapiĂ©-Ramos JD, Guo X, Moghadasian P et al (2014) Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In: Proceedings of the 32nd annual ACM conference on human factors in computing systems. ACM, pp 1063–1072

    Google Scholar 

  • Hurtienne J, Blessing L (2007) Design for intuitive use-testing image schema theory for user interface design. In: 16th international conference on engineering design. Citeseer, Paris, France. 829–830

    Google Scholar 

  • Hurtienne J, Stößel C, Sturm C et al (2010) Physical gestures for abstract concepts: Inclusive design with primary metaphors. Interact Comput 22:475–484. https://doi.org/10.1016/j.intcom.2010.08.009

    Article  Google Scholar 

  • Jayroe TJ, Wolfram D (2012) Internet searching, tablet technology and older adults. Proc Am Soc Inf Sci Technol 49:1–3

    Article  Google Scholar 

  • Keir PJ, Bach JM, Rempel DM (1998) Effects of finger posture on carpal tunnel pressure during wrist motion. J Hand Surg 23:1004–1009

    Article  Google Scholar 

  • Kortum P (2008) HCI beyond the GUI: design for haptic, speech, olfactory, and other nontraditional interfaces. Morgan Kaufmann, Burlington

    Google Scholar 

  • Kurtz KH, Hovland CI (1953) The effect of verbalization during observation of stimulus objects upon accuracy of recognition and recall. J Exp Psychol 45:157

    Article  Google Scholar 

  • Maguire M (2001) Methods to support human-centred design. Int J Hum Comput Stud 55:587–634

    Article  MATH  Google Scholar 

  • Mana N, Mich O, Ferron M (2017) How to increase older adults’ accessibility to mobile technology? The new ECOMODE camera. Paper presented at ForItAAL-Forum Italiano Ambient Assisted Living. Genoa, Italy.

    Google Scholar 

  • Markussen A, Jakobsen MR, Hornb K (2014) Vulture: a mid-air word-gesture keyboard. Paper presented at the proceedings of the 32nd annual ACM conference on human factors in computing systems, Toronto, ON, Canada

    Google Scholar 

  • Nacenta MA, Kamber Y, Qiang Y et al (2013) Memorability of pre-designed and user-defined gesture sets. Paper presented at the proceedings of the SIGCHI conference on human factors in computing systems, Paris, France

    Google Scholar 

  • Ni T, Bowman DA, North C et al (2011) Design and evaluation of freehand menu selection interfaces using tilt and pinch gestures. Int J Hum Comput Stud 69:551–562

    Article  Google Scholar 

  • Nielsen M, Störring M, Moeslund TB et al (2004) A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Camurri A, Volpe G (eds) Gesture-based communication in human-computer interaction. Springer, Heidelberg, pp 409–420

    Chapter  Google Scholar 

  • Pernice K, Nielsen J (2012) Web usability for senior citizens: design guidelines based on usability studies with people age 65 and older. Nielsen Norman Group

    Google Scholar 

  • Reynolds TJ, Gutman J (1988) Laddering theory, method, analysis, and interpretation. J Advert Res 28:11–31

    Google Scholar 

  • Rico J, Brewster S (2010) Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 887–896

    Google Scholar 

  • Rogers Y, Marsden G (2013) Does he take sugar? Moving beyond the rhetoric of compassion. Interactions 20:48–57

    Article  Google Scholar 

  • Ruiz J, Li Y, Lank E (2011) User-defined motion gestures for mobile interaction. Paper presented at the proceedings of the SIGCHI conference on human factors in computing systems, Vancouver, BC, Canada

    Google Scholar 

  • Ryan EB, Szechtman B, Bodkin J (1992) Attitudes toward younger and older adults learning to use computers. J Gerontol 47:P96–P101

    Article  Google Scholar 

  • Schiavo G, Mich O, Ferron M, Mana N (2017) Mobile multimodal interaction for older and younger users: exploring differences and similarities. In: Proceedings of the 16th international conference on mobile and ubiquitous multimedia. ACM, pp 407–414

    Google Scholar 

  • Schiavo G, Ferron M, Mich O et al (2016) Wizard of Oz studies with older adults: a methodological note. Int Rep Socio-Inform 13:93–100

    Google Scholar 

  • Vaidyanathan V, Rosenberg D (2014) “Will use it, because I want to look cool” a comparative study of simple computer interactions using touchscreen and in-air hand gestures. In: International conference on human-computer interaction. Springer, pp 170–181

    Google Scholar 

  • Vanden Abeele V, Zaman B (2009) Laddering the user experience! In: User experience evaluation methods in product development (UXEM 2009)-workshop

    Google Scholar 

  • Venkatesh V, Bala H (2008) Technology acceptance model 3 and a research agenda on interventions. Decis Sci 39:273–315

    Article  Google Scholar 

  • Vermeulen J, Luyten K, van den Hoven E, Coninx K (2013) Crossing the bridge over Norman’s gulf of execution: revealing feedforward’s true identity. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, pp 1931–1940

    Google Scholar 

  • Wigdor D, Wixon D (2011) Brave NUI world: designing natural user interfaces for touch and gesture. Elsevier, Amsterdam

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Fondazione Bruno Kessler, Trento, Italy

    Michela Ferron, Nadia Mana & Ornella Mich

Authors
  1. Michela Ferron
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nadia Mana
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ornella Mich
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michela Ferron .

Editor information

Editors and Affiliations

  1. Departament de MatemĂ tiques i InformĂ tica, Universitat de Barcelona, Barcelona, Spain

    Sergio Sayago

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Ferron, M., Mana, N., Mich, O. (2019). Designing Mid-Air Gesture Interaction with Mobile Devices for Older Adults. In: Sayago, S. (eds) Perspectives on Human-Computer Interaction Research with Older People. Human–Computer Interaction Series. Springer, Cham. https://doi.org/10.1007/978-3-030-06076-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-06076-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-06075-6

  • Online ISBN: 978-3-030-06076-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation