Skip to main content

Camera Mouse: Sound-Based Activation as a New Approach to Click Generation

  • Conference paper
  • First Online:
HCI International 2022 – Late Breaking Papers: HCI for Health, Well-being, Universal Access and Healthy Aging (HCII 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13521))

Included in the following conference series:

  • 846 Accesses

Abstract

In the rapid development of HCI technology, mouse-replacement interfaces have innovated the user interaction experience with graphical user interfaces, specifically for those with neuromuscular diseases. By employing click actuation modalities that do not require a mouse for performing the tasks of pointing and clicking, the individuals are provided with a solution for effective interaction with computers. We present an alternative click actuation modality called “sound-click recognition” for the users of Camera Mouse, a mouse-replacement interface that tracks user motion. Using the sound-click recognition feature, users can generate a left click of the mouse based on the volume of the sound they generate. Furthermore, we present the findings of the evaluation of Camera Mouse while employing two input methods including sound-click recognition and dwell-time selection to analyze the user performance with each approach through side-by-side comparison. The metrics used to measure performance are generated by the GoFitts evaluation tool and are movement time(ms), throughput(bits/s), error rate (%), and target re-entries.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Camera Mouse, January 2018. http://www.cameramouse.org

  2. Jacob, R.J.K.: What you look at is what you get: eye movement-based interaction techniques. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 1990), pp. 11–18. ACM (1990)

    Google Scholar 

  3. MacKenzie, I.S.: Human-Computer Interaction: An Empirical Research Perspective. Elsevier, New Delhi (2013). 291 pages

    Google Scholar 

  4. Magee, J., Felzer, T., MacKenzie, I.S.: Camera mouse + ClickerAID: dwell vs. single-muscle click actuation in mouse-replacement interfaces. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9175, pp. 74–84. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-20678-3_8

    Chapter  Google Scholar 

  5. Missimer, E., Betke, M.: Blink and wink detection for mouse pointer control. In: The 3rd ACM International Conference on Pervasive Technologies Related to Assistive Environments (PETRA 2010), Pythagorion, Samos, Greece, pp. 1–8 (2010)

    Google Scholar 

  6. Zuniga, R., Magee, J.: Camera mouse: dwell vs. computer vision-based intentional click activation. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2017. LNCS, vol. 10278, pp. 455–464. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-58703-5_34

    Chapter  Google Scholar 

  7. GoFitts. http://www.yorku.ca/mack/FittsLawSoftware/doc/index.html?GoFitts.html. Accessed 4 March 2022

Download references

Acknowledgements

The undergraduate authors would like to acknowledge and appreciate Clark University’s Department of Computer Science for providing guidance and necessary resources for this research project. NSF support for this project is also acknowledged and greatly appreciated (#IIS-1551590).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Phoenix Pagan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Pagan, P., Choi, H., Magee, J. (2022). Camera Mouse: Sound-Based Activation as a New Approach to Click Generation. In: Duffy, V.G., Gao, Q., Zhou, J., Antona, M., Stephanidis, C. (eds) HCI International 2022 – Late Breaking Papers: HCI for Health, Well-being, Universal Access and Healthy Aging. HCII 2022. Lecture Notes in Computer Science, vol 13521. Springer, Cham. https://doi.org/10.1007/978-3-031-17902-0_35

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-17902-0_35

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-17901-3

  • Online ISBN: 978-3-031-17902-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics