Advertisement

Dynamic UI Adaptations for One-Handed Use of Large Mobile Touchscreen Devices

  • Daniel Buschek
  • Maximilian Hackenschmied
  • Florian Alt
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10515)

Abstract

We present and evaluate dynamic adaptations for mobile touch GUIs. They mitigate reachability problems that users face when operating large smartphones or “phablets” with a single hand. In particular, we enhance common touch GUI elements with three simple animated location and orientation changes (Roll, Bend, Move). Users can trigger them to move GUI elements within comfortable reach. A lab study (\(N=35\)) with two devices (4.95 in, 5.9 in) shows that these adaptations improve reachability on the larger device. They also reduce device movements required to reach the targets. Participants perceived adapted UIs as faster, less exhausting and more comfortable to use than the baselines. Feedback and video analyses also indicate that participants retained a safer grip on the device through our adaptations. We conclude with design implications for (adaptive) touch GUIs on large devices.

Keywords

UI adaptation Reachability One-handed use Thumb Touch Mobile device 

References

  1. 1.
    Bergstrom-Lehtovirta, J., Oulasvirta, A.: Modeling the functional area of the thumb on mobile touchscreen surfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014, pp. 1991–2000. ACM, New York (2014). http://doi.acm.org/10.1145/2556288.2557354
  2. 2.
    Buschek, D., Alt, F.: TouchML: a machine learning toolkit for modelling spatial touch targeting behaviour. In: Proceedings of the 20th International Conference on Intelligent User Interfaces, IUI 2015, pp. 110–114. ACM, New York (2015). http://doi.acm.org/10.1145/2678025.2701381
  3. 3.
    Buschek, D., Alt, F.: ProbUI: generalising touch target representations to enable declarative gesture definition for probabilistic GUIs. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, CHI 2017, pp. 4640–4653. ACM, New York (2017). http://doi.acm.org/10.1145/3025453.3025502
  4. 4.
    Buschek, D., Schoenleben, O., Oulasvirta, A.: Improving accuracy in back-of-device multitouch typing: a clustering-based approach to keyboard updating. In: Proceedings of the 19th International Conference on Intelligent User Interfaces, IUI 2014, pp. 57–66. ACM, New York (2014). http://doi.acm.org/10.1145/2557500.2557501
  5. 5.
    Chang, Y., L’Yi, S., Koh, K., Seo, J.: Understanding users’ touch behavior on large mobile touch-screens and assisted targeting by tilting gesture. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, pp. 1499–1508. ACM, New York (2015). http://doi.acm.org/10.1145/2702123.2702425
  6. 6.
    Cheng, L.P., Liang, H.S., Wu, C.Y., Chen, M.Y.: iGrasp: grasp-based adaptive keyboard for mobile devices. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2013, pp. 2791–2792. ACM, New York (2013). http://doi.acm.org/10.1145/2468356.2479514
  7. 7.
    Fitts, P.M.: The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47(6), 381–391 (1954)CrossRefGoogle Scholar
  8. 8.
    Girouard, A., Lo, J., Riyadh, M., Daliri, F., Eady, A.K., Pasquero, J.: One-handed bend interactions with deformable smartphones. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, pp. 1509–1518. ACM, New York (2015). http://doi.acm.org/10.1145/2702123.2702513
  9. 9.
    Goel, M., Jansen, A., Mandel, T., Patel, S.N., Wobbrock, J.O.: Contexttype: using hand posture information to improve mobile touch screen text entry. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, pp. 2795–2798. ACM, New York (2013). http://doi.acm.org/10.1145/2470654.2481386
  10. 10.
    Goel, M., Wobbrock, J., Patel, S.: Gripsense: using built-in sensors to detect hand posture and pressure on commodity mobile phones. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST 2012, pp. 545–554. ACM, New York (2012) http://doi.acm.org/10.1145/2380116.2380184
  11. 11.
    Gunawardana, A., Paek, T., Meek, C.: Usability guided key-target resizing for soft keyboards. In: Proceedings of the 15th International Conference on Intelligent User Interfaces, IUI 2010, pp. 111–118. ACM, New York (2010) http://doi.acm.org/10.1145/1719970.1719986
  12. 12.
    Hong, J., Lee, G.: Touchshield: a virtual control for stable grip of a smartphone using the thumb. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2013, pp. 1305–1310. ACM, New York (2013) http://doi.acm.org/10.1145/2468356.2468589
  13. 13.
    Huot, S., Lecolinet, E.: Spiralist: a compact visualization technique for one-handed interaction with large lists on mobile devices. In: Proceedings of the 4th Nordic Conference on Human-computer Interaction: Changing Roles, NordiCHI 2006, pp. 445–448. ACM, New York (2006). http://doi.acm.org/10.1145/1182475.1182533
  14. 14.
    Hürst, W., Merkle, P.: One-handed mobile video browsing. In: Proceedings of the 1st International Conference on Designing Interactive User Experiences for TV and Video, UXTV 2008, pp. 169–178. ACM, New York (2008). http://doi.acm.org/10.1145/1453805.1453839
  15. 15.
    Karlson, A.K., Bederson, B.B.: Studies in one-handed mobile design: habit, desire and agility. In: Proceedings of the 4th ERCIM Workshop on User Interfaces for All, UI4ALL 1998. Technical report (2006)Google Scholar
  16. 16.
    Karlson, A.K., Bederson, B.B.: One-handed touchscreen input for legacy applications. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2008, pp. 1399–1408. ACM, New York (2008). http://doi.acm.org/10.1145/1357054.1357274
  17. 17.
    Karlson, A.K., Bederson, B.B., Contreras-Vidal, J.L.: Understanding single-handed mobile device interaction. In: Handbook of Research on User Interface Design and Evaluation for Mobile Technology, pp. 86–101 (2007)Google Scholar
  18. 18.
    Karlson, A.K., Bederson, B.B., SanGiovanni, J.: Applens and launchtile: two designs for one-handed thumb use on small devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2005, pp. 201–210. ACM, New York (2005). http://doi.acm.org/10.1145/1054972.1055001
  19. 19.
    Karlson, A.K., Bederson, B.B.: ThumbSpace: generalized one-handed input for touchscreen-based mobile devices. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds.) INTERACT 2007. LNCS, vol. 4662, pp. 324–338. Springer, Heidelberg (2007). doi: 10.1007/978-3-540-74796-3_30 CrossRefGoogle Scholar
  20. 20.
    Kim, S., Yu, J., Lee, G.: Interaction techniques for unreachable objects on the touchscreen. In: Proceedings of the 24th Australian Computer-Human Interaction Conference, OzCHI 2012, pp. 295–298. ACM, New York (2012). http://doi.acm.org/10.1145/2414536.2414585
  21. 21.
    Mohd Noor, M.F., Ramsay, A., Hughes, S., Rogers, S., Williamson, J., Murray-Smith, R.: 28 frames later: predicting screen touches from back-of-device grip changes. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014, pp. 2005–2008. ACM, New York (2014) http://doi.acm.org/10.1145/2556288.2557148
  22. 22.
    Negulescu, M., McGrenere, J.: Grip change as an information side channel for mobile touch interaction. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, pp. 1519–1522. ACM, New York (2015). http://doi.acm.org/10.1145/2702123.2702185
  23. 23.
    Ng, A., Brewster, S.A., Williamson, J.H.: Investigating the effects of encumbrance on one- and two- handed interactions with mobile devices. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2014, pp. 1981–1990. ACM, New York (2014). http://doi.acm.org/10.1145/2556288.2557312
  24. 24.
    Oulasvirta, A., Bergstrom-Lehtovirta, J.: Ease of juggling: studying the effects of manual multitasking. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 3103–3112. ACM, New York (2011). http://doi.acm.org/10.1145/1978942.1979402
  25. 25.
    Roudaut, A., Huot, S., Lecolinet, E.: Taptap and magstick: improving one-handed target acquisition on small touch-screens. In: Proceedings of the Working Conference on Advanced Visual Interfaces, AVI 2008, pp. 146–153. New York (2008). http://doi.acm.org/10.1145/1385569.1385594
  26. 26.
    Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., Shen, C.: Lucid touch: a see-through mobile device. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, UIST 2007, pp. 269–278. ACM, New York (2007). http://doi.acm.org/10.1145/1294211.1294259
  27. 27.
    Wolf, K., McGee-Lennon, M., Brewster, S.: A study of on-device gestures. In: Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services Companion, MobileHCI 2012, pp. 11–16. ACM, New York (2012). http://doi.acm.org/10.1145/2371664.2371669
  28. 28.
    Yang, X.D., Mak, E., Irani, P., Bischof, W.F.: Dual-surface input: augmenting one-handed interaction with coordinated front and behind-the-screen input. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2009, pp. 5:1–5:10. ACM, New York (2009). http://doi.acm.org/10.1145/1613858.1613865
  29. 29.
    Yin, Y., Ouyang, T.Y., Partridge, K., Zhai, S.: Making touchscreen keyboards adaptive to keys, hand postures, and individuals: a hierarchical spatial backoff model approach. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, pp. 2775–2784. ACM, New York (2013). http://doi.acm.org/10.1145/2470654.2481384

Copyright information

© IFIP International Federation for Information Processing 2017

Authors and Affiliations

  • Daniel Buschek
    • 1
  • Maximilian Hackenschmied
    • 1
  • Florian Alt
    • 1
  1. 1.LMU MunichMunichGermany

Personalised recommendations