Skip to main content

Multi-modal User Interface Design for a Face and Voice Recognition Biometric Authentication System

  • Conference paper
  • First Online:
Book cover Wireless Mobile Communication and Healthcare (MobiHealth 2017)

Abstract

Biometrics refer to unique measurable characteristics and information regarding individual’s health, physical or mental condition and can be used to uniquely authenticate or verify a person’s identity. They can be sorted in physiological such as fingerprints, palm print, face recognition, iris recognition, retina and DNA and behavioral such as typing rhythm (i.e. signature) and voice and can be described based on the uniqueness, potential change with time (i.e. facial changes), the feasibility to be collected (i.e. fingerprints) and the purposes of usage. In this work we study the use of a biometric technology for eHealth. We present the SpeechXRays project initiative that aims to provide a solution combining the convenience and cost-effectiveness of face and voice biometrics, achieving better accuracies by combining it with video, and bringing superior anti-spoofing capabilities. We explain how a novel user interface biometric platform is designed and adapted, for an eHealth use case, to enable secure access for medical specialists, nurses and patients to a collaborative eHealth platform that provides access to clinical and health related data within and possible outside a hospital. This is the first study, in the field, that gathered all necessary requirements (for a voice/face biometric system) and provides a formative evaluation and implementation of the SpeechXrays system user interface, for both end users and administrators, following a user-centered design approach, based on the holistic consideration of the user experience and the technical implication and functional requirements of the platform.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Trewin, S., Swart, C., Koved, L., Martino, J., Singh, K., Ben-David, S.: Biometric authentication on a mobile device: a study of user effort, error and task disruption. In: Proceedings of the 28th Annual Computer Security Applications Conference, pp. 159–168. ACM, December 2012

    Google Scholar 

  2. Nandakumar, K., Jain, A.K.: Biometric template protection: bridging the performance gap between theory and practice. IEEE Sig. Process. Mag. 32(5), 88–100 (2015)

    Article  Google Scholar 

  3. Chingovska, I., Dos Anjos, A.R., Marcel, S.: Biometrics evaluation under spoofing attacks. IEEE Trans. Inf. Forensics Secur. 9(12), 2264–2276 (2014)

    Article  Google Scholar 

  4. Toledano, D.T., Pozo, R.F., Trapote, Á.H., Gómez, L.H.: Usability evaluation of multi-modal biometric verification systems. Interact. Comput. 18(5), 1101–1122 (2006)

    Article  Google Scholar 

  5. Bhagavatula, C., Ur, B., Iacovino, K., Kywe, S.M., Cranor, L.F., Savvides, M.: Biometric authentication on iphone and android: usability, perceptions, and influences on adoption. In: Proceedings of USEC, pp. 1–2 (2015)

    Google Scholar 

  6. Miltgen, C.L., Popovič, A., Oliveira, T.: Determinants of end-user acceptance of biometrics: integrating the “Big 3” of technology acceptance with privacy context. Decis. Support Syst. 56, 103–114 (2013)

    Article  Google Scholar 

  7. De Luca, A., Hang, A., Von Zezschwitz, E., Hussmann, H.: I feel like I’m taking selfies all day! Towards understanding biometric authentication on smartphones. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, pp. 1411–1414. ACM, April 2015

    Google Scholar 

  8. Patrick, A.S.: Usability and acceptability of biometric security systems. In: Financial Cryptography, p. 105, January 2004

    Google Scholar 

  9. De Luca, A., Hang, A., Brudy, F., Lindner, C., Hussmann, H.: Touch me once and I know it’s you! Implicit authentication based on touch screen patterns. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 987–996. ACM, May 2012

    Google Scholar 

  10. Blanco-Gonzalo, R., Diaz-Fernandez, L., Miguel-Hurtado, O., Sanchez-Reillo, R.: Usability evaluation of biometrics in mobile environments. In: 2013 6th International Conference on Human System Interaction (HSI), pp. 123–128. IEEE, June 2013

    Google Scholar 

  11. Jain, A.K., Nandakumar, K., Ross, A.: 50 years of biometric research: accomplishments, challenges, and opportunities. Pattern Recogn. Lett. 79, 80–105 (2016)

    Article  Google Scholar 

  12. Quiñones, D., Rusu, C.: How to develop usability heuristics: a systematic literature review. Comput. Stand. Interfaces 53, 89–122 (2017)

    Article  Google Scholar 

  13. Jain, A., Ross, A.A., Nandakumar, K.: Introduction to Biometrics. Springer Science & Business Media, Berlin (2011)

    Book  Google Scholar 

  14. Nielsen, J.: Usability inspection methods. In: Conference Companion on Human Factors in Computing Systems, pp. 413–414. ACM, April 1994

    Google Scholar 

  15. Molich, R., Nielsen, J.: Improving a human-computer dialogue. Commun. ACM 33(3), 338–348 (1990)

    Article  Google Scholar 

  16. Yáñez Gómez, R., Cascado Caballero, D., Sevillano, J.L.: Heuristic evaluation on mobile interfaces: a new checklist. Sci. World J. 2014 (2014)

    Google Scholar 

  17. Joyce, G., Lilley, M.: Towards the development of usability heuristics for native smartphone mobile applications. In: Marcus, A. (ed.) DUXU 2014. LNCS, vol. 8517, pp. 465–474. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07668-3_45

    Chapter  Google Scholar 

  18. Vilar Neto, E., Campos, F.F.: Evaluating the usability on multimodal interfaces: a case study on tablets applications. In: Marcus, A. (ed.) DUXU 2014. LNCS, vol. 8517, pp. 484–495. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-07668-3_47

    Chapter  Google Scholar 

  19. Unar, J.A., Seng, W.C., Abbasi, A.: A review of biometric technology along with trends and prospects. Pattern Recogn. 47(8), 2673–2688 (2014)

    Article  Google Scholar 

  20. Apple Developer: UI design do’s and don’ts (2017). https://developer.apple.com/design/tips/

  21. Google Developers: Up and running with material design (2017). https://developer.android.com/design/index.html

  22. Spanakis, E.G., Spanakis, M., Karantanas, A., Marias, K.: Secure access to patient’s health records using SpeechXRays a multi-channel biometrics platform for user authentication. In: 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Orlando, FL, USA, 16–20 August 2016 (2016)

    Google Scholar 

  23. Chronaki, C., et al.: An eHealth platform for instant interaction among health professionals. In: Computers in Cardiology 2003, Thessaloniki Chalkidiki, 21–24 September 2003, vol. 30, pp. 101–104 (2003). (02766574)

    Google Scholar 

  24. Spat, S., et al.: A mobile android-based application for in-hospital glucose management in compliance with the medical device directive for software. In: 2nd International ICST Conference on Wireless Mobile Communication and Healthcare (MobiHealth 2011), Kos Island, Greece, 5–7 October 2011 (2011)

    Google Scholar 

  25. Spanakis, E.G., et al.: Technology-based innovations to foster personalized healthy lifestyles and well-being: a targeted review. J. Med. Internet Res. 18(6), e128 (2016). https://doi.org/10.2196/jmir.4863

Download references

Acknowledgement

This work is supported by the research project “SpeechXRays” which receives funding from the European Commission (EC) through Horizon 2020 Grant agreement No. 653586.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Emmanouil G. Spanakis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Adami, I., Antona, M., Spanakis, E.G. (2018). Multi-modal User Interface Design for a Face and Voice Recognition Biometric Authentication System. In: Perego, P., Rahmani, A., TaheriNejad, N. (eds) Wireless Mobile Communication and Healthcare. MobiHealth 2017. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 247. Springer, Cham. https://doi.org/10.1007/978-3-319-98551-0_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-98551-0_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-98550-3

  • Online ISBN: 978-3-319-98551-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics