Abstract
In previous works, the authors evidenced the lack of specific metrics for UX improvement in the ATM domain, and the importance of the Usability and Security of ATM interfaces, principally because it is a channel where people interact with cash. According to this, covering the lack of specific metrics for the ATM domain is very important. For that, we proposed developing and validating a set of Usability and Security Metrics for the ATM domain. To do this, first, the Security and Usability metrics that were used by other banking domains were taken as input. Second, we reviewed the metrics that the ISO 25000 standard provided. With this input, we adapted the metrics to the specific characteristics of the domain. The result was a proposal of metrics for ATMs; divided metrics focused on quantifying aspects of Usability and metrics focused on measuring aspects of security in the interfaces. It was subjected to expert judgment to establish whether the proposed metrics had what was necessary to be validated later. We consulted experts in ATM interface design and domain experts from various banks in Peru. We adapted the proposed metrics to a survey format and asked each of the experts to place a score on four aspects. Finally, we prepared and conducted User Tests containing tasks related to the withdrawal operation for the validation scenario, and we prototyped the ATM interfaces of the four most iconic banks in Peru. A SUS questionnaire followed the User Tests. The results finally obtained were compared with the results obtained from SUS in order to validate if they both gave the same trend as output. We could conclude that the Metrics proposed were validated by expert judgment and by the validation scenario previously described.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Perú, I.: Bancarización del peruano. Ipsos Perú (2018). https://www.ipsos.com/es-pe/bancarizacion-del-peruano. Accessed 14 Sept 2019
Falconi, F., Zapata, C., Moquillaza, A., Paz, F.: A systematic literature review about quantitative metrics to evaluate usability and security of ATM interfaces. In: Marcus, A., Rosenzweig, E. (eds.) HCII 2020. LNCS, vol. 12202, pp. 100–113. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49757-6_7
Falconi, F., Zapata, C., Moquillaza, A., Paz, F.: Security guidelines for the design of ATM interfaces. In: Ahram, T., Falcão, C. (eds.) AHFE 2020. AISC, vol. 1217, pp. 265–271. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-51828-8_35
Kainda, R., Fléchais, I., Roscoe, A.: Security and usability: analysis and evaluation. In: 2010 International Conference on Availability, Reliability and Security (2010). https://doi.org/10.1109/ares.2010.77
Aguirre, J., Moquillaza, A., Paz, F.: Methodologies for the design of ATM interfaces: a systematic review. In: Ahram, T., Karwowski, W., Taiar, R. (eds.) IHSED 2018. AISC, vol. 876, pp. 256–262. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-02053-8_39
Sauro, J.: Measuring Usability with the System Usability Scale (SUS), https://measuringu.com/sus/. Accessed 24 Nov 2019
International Standard. ISO 25000:2014. Systems and software engineering — Systems and software Quality Requirements and Evaluation (SQuaRE) Last reviewed and confirmed in 2020. International Organization for Standardization (2014). https://www.iso.org/standard/64764.html
Chanco, C., Moquillaza, A., Paz, F.: Development and validation of usability heuristics for evaluation of interfaces in ATMs. In: Marcus, A., Wang, W. (eds.) HCII 2019. LNCS, vol. 11586, pp. 3–18. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23535-2_1
Subsorn, P., Limwiriyakul, S.: A comparative analysis of internet banking security in Thailand: a customer perspective. Procedia Eng. 32, 260–272 (2012). https://doi.org/10.1016/j.proeng.2012.01.1266
International Standard. ISO 9126:2000. Software engineering — Product quality — Part 1: Quality model. International Organization for Standardization (2001). https://www.iso.org/standard/22749.html
Trochim, W.M.K.: Likert Scaling. Research Methods Knowledge Base. https://conjointly.com/kb/likert-scaling/. Accessed 05 Aug 2020
Cueva, J.M.: Métricas de usabilidad en la Web, 2–24. (2014). http://di002.edv.uniovi.es/~cueva/asignaturas/masters/2005/MetricasUsabilidad.pdf
Moran, K.: Usability Testing 101. Nielsen Norman Group (2019). https://www.nngroup.com/articles/usability-testing-101/
Marcés, E.: Los cuatro bancos más grandes crecieron en utilidades y créditos en el 2018. Semana Económica (2019). https://semanaeconomica.com/economia-finanzas/banca/329588-los-cuatro-bancos-mas-grandes-crecieron-en-utilidades-y-creditos-en-el-2018
Hebert, K., Yoo, F.: Enterprise. InVision (2021). https://www.invisionapp.com/enterprise
TW. Measuring and Interpreting System Usability Scale (SUS). UIUX Trend. (2020) https://uiuxtrend.com/measuring-system-usability-scale-sus/
Acknowledgment
We want to thank the ATM lab in BBVA Perú for its support along with the research. In addition, we thank the “HCI, Design, User Experience, Accessibility & Innovation Technologies (HCI DUXAIT)”. HCI DUXAIT is a research group from the Pontificia Universidad Católica del Perú (PUCP).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Falconi, F., Moquillaza, A., Aguirre, J., Paz, F. (2021). Developing and Validating a Set of Usability and Security Metrics for ATM Interfaces. In: Soares, M.M., Rosenzweig, E., Marcus, A. (eds) Design, User Experience, and Usability: UX Research and Design. HCII 2021. Lecture Notes in Computer Science(), vol 12779. Springer, Cham. https://doi.org/10.1007/978-3-030-78221-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-78221-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-78220-7
Online ISBN: 978-3-030-78221-4
eBook Packages: Computer ScienceComputer Science (R0)