Abstract
This paper presents a proposal for an integral user experience evaluation process, as well as the methodology followed to carry it out, and the validation achieved. In previous works, two processes were proposed: the first one, was to perform Heuristic Evaluations, and the second one, was to perform Tree Testing Evaluations. Both processes are aligned with User Experience improvement. Heuristic Evaluation is a method that allows UX and HCI specialists to evaluate a software product through a set of heuristics to find usability problems. Tree Testing or Reverse Card Sorting is a method based on the evaluation by end users of the information architecture of a software product so that the hypotheses that led to the proposed design can be validated early and improvements in the design can be made. This paper presents how, through a collaborative and continuous improvement approach, an integrated process was developed to perform the aforementioned methods, both in face-to-face and remote schemes, with an integral approach. In addition, this proposal lays the groundwork for adding other UX evaluation methods and techniques in the future. To carry out this, an AS IS was considered, a remote collaborative workshop was held with the stakeholders involved, and with the identified improvement points, the integral process was elaborated, which was captured in BPMN diagrams. Finally, it was verified that the proposal covered all the improvement points identified in the workshop, and the proposal was validated through expert judgment. The collaborative experience and the feedback obtained by both workshop participants and experts led us to conclude the importance of involving users throughout the improvement experience, with a user-centered focus. This proposal is important because this process can be implemented in any organization that performs UX evaluations. Likewise, a software platform can be implemented, so that the automation and standardization of this type of process can be achieved.
This work was funded by the Dirección de Fomento a la Investigación at the PUCP through grant 2021-C-0023.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Y. Li, C. Liu, User experience research and analysis based on usability testing method, in Advances in Graphic Communication, Printing and Packaging Technology and Materials, Lecture Notes in Electrical Engineering, ed. by P. Zhao, Z. Ye, M. Xu, L. Yang, L. Zhang, R. Zhu, vol. 754, (Springer, Singapore, 2021). https://doi.org/10.1007/978-981-16-0503-1_39
A. Holzinger, Usability engineering methods for software developers. Commun. ACM 48, 71–74 (2005). https://doi.org/10.1145/1039539.1039541
B. Kitchenham, S. Charters, Guidelines for performing Systematic Literature Reviews in Software Engineering (Keele University and Durham University Joint Report, 2007) https://www.elsevier.com/__data/promis_misc/525444systematicreviewsguide.pdf
M. Goetz, Modeling Workflow Patterns Through a Control-Flow Perspective Using BPMN and the BPM Modeler BizAgi (BPMN, 2009) http://wiki.recife.pe.gov.br/files/Workflow%20Patterns%20using%20BizAgi%20Process%20 Modeler.pdf
R. Molich, J. Nielsen, Improving a human-computer dialogue. Commun. ACM 33(3), 338–348 (1990). https://doi.org/10.1145/77481.77486
J. Nielsen, Enhancing the explanatory power of usability heuristics, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Celebrating Interdependence – CHI ‘94, (1994). https://doi.org/10.1145/191666.191729
B. Hanington, B. Martin, Universal Methods of Design, Expanded and Revised (Rockport Universal) (Rockport Publishers, 2019), p. 232. ISBN: 9781631597480
K. Whitenton, Tree Testing: Fast, Iterative Evaluation of Menu Labels and Categories (Nielsen Norman Group, 2017) https://www.nngroup.com/articles/tree-testing/
O. Levina, Assessing information loss in EPC to BPMN business process model transformation, in 2012 IEEE 16th International Enterprise Distributed Object Computing Conference Workshops, (2012). https://doi.org/10.1109/edocw.2012.38
OMG, About the Business Process Model and Notation Specification Version 2.0. Standards Development Organization (OMG, 2011) https://www.omg.org/spec/BPMN/2.0/PDFD
A. Lecaros, F. Paz, A. Moquillaza, Challenges and Opportunities on the Application of Heuristic Evaluations: A Systematic Literature Review (Springer International Publishing, 2021). https://doi.org/10.1007/978-3-030-78221-4_17
A. Lecaros, A. Moquillaza, F. Falconi, J. Aguirre, A. Tapia, F. Paz, Selection and Modeling of a Formal Heuristic Evaluation Process Through Comparative Analysis (Springer International Publishing, Cham, 2022). https://doi.org/10.1007/978-3-031-05897-4_3
F.A. Paz Espinoza, Método para la evaluación de usabilidad de sitios web transaccionales basado en el proceso de inspección heurística. Pontif. Univ. Católica del Perú. 275 (2018) https://tesis.pucp.edu.pe/repositorio/handle/20.500.12404/9903
A. Tapia, A. Moquillaza, J. Aguirre, F. Falconi, A. Lecaros, F. Paz, A Process to Support the Remote Tree Testing Technique for Evaluating the Information Architecture of User Interfaces in Software Projects, Lecture Notes in Computer Science, vol 13321 (Springer, Cham, 2022). https://doi.org/10.1007/978-3-031-05897-4_6
S.S. Pillalamarri, L.M. Huyett, A. Abdel-Malek, Novel bluetooth-enabled tubeless insulin pump: A user experience design approach for a connected digital diabetes management platform. J. Diabetes Sci. Technol. 12(6), 1132–1142 (2018). https://doi.org/10.1177/1932296818804802
C. Mullins, Responsive, mobile app, mobile first: Untangling the UX design web in practical experience, in Proceedings of the 33rd Annual International Conference on the Design of Communication – SIGDOC’15, (2015), pp. 1–6, https://doi.org/10.1145/2775441.2775478
T. Le, S. Chaudhuri, J. Chung, H.J. Thompson, G. Demiris, Tree testing of hierarchical menu structures for health applications. J. Biomed. Inform. 49, 198–205 (2014). https://doi.org/10.1016/j.jbi.2014.02.011
W.E. Nurcahyanti, Suhardi, Information architecture assessment of BPS headquarters official website, in 2014 International Conference on Information Technology Systems and Innovation (ICITSI), (2014), pp. 177–182. https://doi.org/10.1109/ICITSI.2014.7048260
B.J. White, W.A. Kapakos, User experience (UX) in the CIS classroom: Better information architecture with interactive prototypes and UX testing. Issues Inf. Syst. 18(2), 59–70 (2017). https://doi.org/10.48009/2_iis_2017_59-70
H. Arslan, A.G. Yüksek, M.L. Elyakan, Ö. Canay, Usability and quality test in software products to oriented user experience. Online J. Qual. High. Educ. 5(3), (2018). https://www.tojned.net/journals/tojqih/articles/v05i03/v05i03-11.pdf
L. Borisova, How Startups Should Evaluate Their Websites’ UX? Comparison of UX evaluation methods through evaluation of UX of the prototype of a matching platform for the rental housing market in Finland – Sopia, Master’s Thesis, Aalto University School of Business. International Design Business Management, 2019. https://aaltodoc.aalto.fi/handle/123456789/42377?locale-attribute=en
A. Mehic, TreeTest: Online Tree Testing for Information Hierarchies, Master’s Thesis. Graz University of Technology, 2019. https://ftp.isds.tugraz.at/pub/theses/amehic-2019-msc.pdf
T. Granollers, Validación experimental de un conjunto heurístico para evaluaciones de UX de sitios web de comercio-e, in 2016 IEEE 11th Colombian Computing Conference (CCC), pp. 1–8, (2016) https://doi.org/10.1109/ColumbianCC.2016.7750783
Acknowledgments
This work is part of the research project “Virtualización del proceso de evaluación de experiencia de usuario de productos de software para escenarios de no presencialidad” (virtualization of the user experience evaluation process of software products for non-presential scenarios), developed by HCI-DUXAIT research group. HCI-DUXAIT is a research group that belongs to the PUCP (Pontificia Universidad Católica del Perú).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Paz, F., Lecaros, A., Falconi, F., Tapia, A., Aguirre, J., Moquillaza, A. (2023). A Process to Support Heuristic Evaluation and Tree Testing from a UX Integrated Perspective. In: Latifi, S. (eds) ITNG 2023 20th International Conference on Information Technology-New Generations. ITNG 2023. Advances in Intelligent Systems and Computing, vol 1445. Springer, Cham. https://doi.org/10.1007/978-3-031-28332-1_42
Download citation
DOI: https://doi.org/10.1007/978-3-031-28332-1_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-28331-4
Online ISBN: 978-3-031-28332-1
eBook Packages: EngineeringEngineering (R0)