Skip to main content

Touchless Interaction on Mobile Devices Using Embedded Ambient Light Sensor

  • 506 Accesses

Part of the Lecture Notes in Computer Science book series (LNISA,volume 12782)

Abstract

In this paper, we introduce and evaluate a mobile application service that allows contact-free interaction with a mobile device by utilizing only an ambient light sensor. The proposed solution enables single-handed UI navigation without touching the smartphone screen. The advantage of implemented service is the use of an embedded light sensor, which the majority of manufactures presently integrate into mobile devices. Hence, the use of any additional accessories or external sensing hardware is not required. The service itself is designed as a floating widget that can be attached to the target mobile application, thus augmenting it with Around Device Interaction (ADI) support. Two different navigation patterns (manual and automatic) can be utilized to control the widget position on the screen and activate target UI elements. A controlled experiment involving 20 participants was conducted in order to evaluate and comparatively assess the performances of the implemented solution. We present and discuss the findings of this empirical research.

Keywords

  • Touchless interaction
  • Ambient light sensor
  • Around device interaction
  • Mobile devices

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-77015-0_11
  • Chapter length: 11 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   79.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-77015-0
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   99.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.

References

  1. Siek, K., Rogers, Y., Connelly, K.: Fat finger worries: how older and younger users physically interact with PDAs. In: Proceedings of the 2005 IFIP TC13 International Conference on Human-Computer Interaction (INTERACT 2005), pp. 267–280. ACM Press, New York (2005)

    Google Scholar 

  2. Widgor, D., Forlines, C., Baudisch, P., Barnwell J., Shen C.: LucidTouch: a see-through mobile device. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST 2007), pp. 269–278. ACM Press, New York (2007)

    Google Scholar 

  3. Huber, P.: Inaccurate input on touch devices relating to the fingertip. In: Media Informatics Proseminar (2015)

    Google Scholar 

  4. Butler, A., Izadi, S., Hodges, S.: SideSight: Multi-“touch” interaction around small devices. In: Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST 2008), pp. 201–204. ACM Press, New York (2008)

    Google Scholar 

  5. Kratz, S., Rohs, M.: Hoverflow: exploring around-device interaction with IR distance sensors. In: Proceedings of the 11th Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI 2009), pp. 42:1–42:4. ACM Press, New York (2009)

    Google Scholar 

  6. Zhao, C., Chen, K-Y., Aumi, M.T.I., Patel, S., Reynolds, M.S.: SideSwipe: detecting in-air gestures around mobile devices using actual GSM signal. In: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST 2014), pp. 527–534. ACM Press, New York (2014)

    Google Scholar 

  7. Harrison, C., Hudson, S.E.: Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST 2009), pp. 121–124. ACM Press, New York (2009)

    Google Scholar 

  8. Ketabdar, H., Ali Yüksel, K., Roshandel, M.: MagiTact: interaction with mobile devices based on compass (magnetic) sensor. In: Proceedings of the 2010 International Conference on Intelligent User Interfaces (IUI 2010), pp. 413–414. ACM Press, New York (2010)

    Google Scholar 

  9. Hwang, S., Ahn, M., Wohn, K.: MagGetz: customizable passive tangible controllers on and around conventional mobile devices. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST 2013), pp. 411–416. ACM Press, New York (2013)

    Google Scholar 

  10. Ketabdar, H., Haji-Abolhassani, A., Roshandel, M.: MagiThings: gestural interaction with mobile devices based on using embedded compass magnetic field sensor. Int. J. Mob. Hum. Comput. Interact. 5(3), 23–41 (2013)

    CrossRef  Google Scholar 

  11. Lv, Z., Halawani, A., Khan, M.S.L., Rehman, S.U.: Finger in air: touch-less interaction on smartphone. In: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia (MUM 2013), pp. 16:1–16:4. ACM Press, New York (2013)

    Google Scholar 

  12. Grubert, J., Ofer, E., Pahud, M., Kranz, M., Schmalstieg, D.: GlassHands: interaction around unmodified mobile devices using sunglasses. In: Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS 2016), pp. 215–224. ACM Press, New York (2016)

    Google Scholar 

  13. Dell, N., Dsilva, K., Borriello, G.: Mobile touch-free interaction for global health. In: Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications (HotMobile 2015), pp. 15–20. ACM Press, New York (2015)

    Google Scholar 

  14. Zhang, C., Tabor, J., Zhang, J., Zhang, X.: Extending mobile interaction through near-field visible light sensing. In: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (MobiCom 2015), pp. 345–357. ACM Press, New York (2015)

    Google Scholar 

  15. Wen, E., Seah, W., Ng, B., Liu, X., Cao, J.: UbiTouch: ubiquitous smartphone touchpads using built-in proximity and ambient light sensors. In: Proceedings of 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp 2016), pp. 286–297. ACM Press, New York (2016)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sandi Ljubic .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Salkanovic, A., Ljubic, S. (2021). Touchless Interaction on Mobile Devices Using Embedded Ambient Light Sensor. In: Streitz, N., Konomi, S. (eds) Distributed, Ambient and Pervasive Interactions. HCII 2021. Lecture Notes in Computer Science(), vol 12782. Springer, Cham. https://doi.org/10.1007/978-3-030-77015-0_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77015-0_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77014-3

  • Online ISBN: 978-3-030-77015-0

  • eBook Packages: Computer ScienceComputer Science (R0)