Abstract
Nowadays, due to technological advancement, people are bound to use multiple digital tools and interact with them through a User Interface. For this reason, User Experience (UX) is one of the most important keys to success. UX includes the design and evaluation of an adequate Information Architecture. To design Information Architecture, the best-known technique is Card Sorting. For evaluation, there is the Tree Testing or Reverse Card Sorting technique. This technique can be applied in remote or non-remote ways. We identified three main issues: 1. The remote processes to apply Tree Testing are not standardized; 2. the tools were modeled and built after a process defined by the supplier of those tools, most of which are now discontinued. 3. In many development projects these techniques are left aside, the Information Architecture is assessed using other methods and techniques (i.e. User Testing) in later phases of the project. These result in Information Architecture errors and defects found late or not found at all. Hence, this study is focused on developing and validating a standardized remote Tree Testing process with an emphasis on automation. To meet the objectives, we conducted interviews and literature reviews to find out how Tree Testing is currently carried out and what tools are used to support the technique (AS-IS workflow). Subsequently, we proposed a process that can support the technique, considering the pain points found on the current processes, resulting in a TO-BE workflow. As a result, a proposal of this standardized process was modeled using the notation BPMN, and validated by the expert judgment of specialists in Human-Computer Interaction (HCI). Finally, it is important to mention that Tree Testing is useful, practical in its remote application, and should be applied in the early stages of software projects; a tool to support the whole process should be implemented.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Arslan, H., Yüksek, A.G., Elyakan, M.L., Canay, Ö.: Usability and quality test in software products to oriented user experience. Online J. Qual. High. Educ. 5(3) (2018). http://www.tojdel.net/journals/tojqih/articles/v05i03/v05i03-11.pdf
Niranjanamurthy, M., Archikam, N., Himaja, G., Shetty, P.K.: Research study on importance of usability testing/User Experience (UX) Testing. Int. J. Comput. Sci. Mob. Comput. 78–85 (2014). https://www.semanticscholar.org/paper/Research-Study-on-Importance-of-Usability-Testing-%2F-Niranjanamurthy-Nagaraj/60dc55511afb1af8d78518ebdff5d1f746c41ee8
Mehic, A.: TreeTest: Online tree testing for information hierarchies. Master’s thesis. Graz University of Technology (2019). https://ftp.isds.tugraz.at/pub/theses/amehic-2019-msc.pdf
Spencer, D.: Card-based classification evaluation. boxes and arrows (2003). https://boxesandarrows.com/card-based-classification-evaluation/
Türkyilmaz, A., Kantar, S., Bulak, M.E., Uysal, O.: User experience design: Aesthetics or functionality? Management, knowledge and learning. In: Joint International Conference 2015. Italy. ISBN: 978-961-6914-13-0. 27–29 May 2015 (2015). http://www.toknowpress.net/ISBN/978-961-6914-13-0/papers/ML15-111.pdf
Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering. Evidence based software engineering technical report. Keele University and Durham University Joint Report. Elsevier (2007). https://www.elsevier.com/__data/promis_misc/525444systematicreviewsguide.pdf
Petticrew, M., Roberts, H.: Systematic Reviews in the Social Sciences: A Practical Guide. Blackwell Publishing, Hoboken (2006).https://doi.org/10.1002/9780470754887
Association Computer Machinery: About the ACM Organization. ACM (2020). https://www.acm.org/about-acm/about-the-acm-organization
IEEE: IEEE - About IEEE. IEEE (2020). https://www.ieee.org/about/index.html
Elsevier: About Scopus - Abstract and citation database. Elsevier (2020). https://www.elsevier.com/solutions/scopus?dgcid=RN_AGCM_Sourced_300005030
Ding, W., Lin, X., Zarro, M.: Information Architecture: The Design and Integration of Information Spaces (Synthesis Lectures on Information Concepts, Retrieval, and Services). Morgan & Claypool Publishers, San Rafael (2017).https://doi.org/10.2200/S00755ED2V01Y201701ICR056
Zhang, Q., Neitzel, A.J.: Methodological review: A systematic narrative review of screening tools for conducting systematic reviews in educational research. OSF preprints (2021).https://doi.org/10.31219/osf.io/efs2n
OMG: Business Process Model and Notation (BPMN), Version 2.0. 538. OMG (2010). https://www.omg.org/spec/BPMN/2.0/About-BPMN/
Hunt, V.D.: Process Mapping: How to Reengineer Your Business Processes. Wiley, New York. ISBN: 978-0-471-13281-3. February 1996 (1996)
ISO. ISO 9241-210:2019(en): Ergonomics of human-system interaction—Part 210: Human-centered design for interactive systems (2019). https://inacal.isolutions.iso.org/obp/ui#iso:std:iso:9241:-210:ed-2:v1:en
Morville, P.: User Experience Design. Semantic Studios (2004). http://semanticstudios.com/publications/semantics/000029.php
Cardello, J.: Low: Findability and Discoverability: Four Testing Methods to Identify the Causes. Nielsen Norman Group (2014). https://www.nngroup.com/articles/navigation-ia-tests/
Nielsen, N. Usability 101: Introduction to Usability. Nielsen Norman Group, 2012. https://www.nngroup.com/articles/usability-101-introduction-to-usability/
Wilson, D.: A is for Accessibility—12 top tips for designing an inclusive user experience. Medium (2019). https://uxdesign.cc/the-a-to-z-of-ux-a-is-for-accessibility-12-top-tips-for-designing-an-inclusive-user-experience-667eedaf5bca
Harley, A.: Trustworthiness in Web Design: 4 Credibility Factors. Nielsen Norman Group (2016). https://www.nngroup.com/articles/trustworthy-design/
Pillalamarri, S.S., Huyett, L.M., Abdel-Malek, A.: Novel bluetooth-enabled tubeless insulin pump: A user experience design approach for a connected digital diabetes management platform. J. Diabetes Sci. Technol. 12(6), 1132–1142 (2018). https://doi.org/10.1177/1932296818804802
Mullins, C.: Responsive, mobile app, mobile first: Untangling the UX design web in practical experience. In: Proceedings of the 33rd Annual International Conference on the Design of Communication - SIGDOC 2015, pp. 1–6 (2015). https://doi.org/10.1145/2775441.2775478
Le, T., Chaudhuri, S., Chung, J., Thompson, H.J., Demiris, G.: Tree testing of hierarchical menu structures for health applications. J. Biomed. Inf. 49, 198–205. Scopus (2014). https://doi.org/10.1016/j.jbi.2014.02.011
Nurcahyanti, W.E., Suhardi: Information architecture assessment of BPS headquarters official website. In: 2014 International Conference on Information Technology Systems and Innovation (ICITSI), pp. 177–182 (2014). https://doi.org/10.1109/ICITSI.2014.7048260
White, B.J., Kapakos, W.A.: User Experience (UX) in the CIS Classroom: Better information architecture with interactive prototypes and UX testing. Issues in Information Systems, 2017, Vol. 18, Issue 2, pp. 59–70 (2017). https://doi.org/10.48009/2_iis_2017_59-70
Borisova, L.: How startups should evaluate their websites’ UX? Comparison of UX evaluation methods through evaluation of UX of the prototype of a matching platform for the rental housing market in Finland – Sopia. Master’s thesis, Aalto University School of Business. International Design Business Management (2019). https://aaltodoc.aalto.fi/handle/123456789/42377?locale-attribute=en
Naview: Naview - Plans and Signup. Naview (2021). https://www.naviewapp.com/naview/plans-and-signup
Raemy, J.: The International Image Interoperability Framework (IIIF): Raising awareness of the user benefits for scholarly editions. Thesis for Bachelor of Science in Information Science. University of Basel (2017). https://doi.org/10.13140/RG.2.2.34211.89125
Garrett Jesse James: The elements of user experience: user-centered design for the Web and beyond. Second edition. Berkeley, CA: New Riders. Voices that matter (2011). ISBN 978-0-321-68368-7
Acknowledgment
This work is part of the research project “Virtualización del proceso de evaluación de experiencia de usuario de productos de software para escenarios de no presencialidad” (virtualization of the user experience evaluation process of software products for non-presential scenarios), developed by HCI-DUXAIT research group. HCI-DUXAIT is a research group that belongs to the PUCP (Pontificia Universidad Católica del Perú).
This work was funded by the Dirección de Fomento a la Investigación at the PUCP through grant 2021-C-0023.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Tapia, A., Moquillaza, A., Aguirre, J., Falconi, F., Lecaros, A., Paz, F. (2022). A Process to Support the Remote Tree Testing Technique for Evaluating the Information Architecture of User Interfaces in Software Projects. In: Soares, M.M., Rosenzweig, E., Marcus, A. (eds) Design, User Experience, and Usability: UX Research, Design, and Assessment. HCII 2022. Lecture Notes in Computer Science, vol 13321. Springer, Cham. https://doi.org/10.1007/978-3-031-05897-4_6
Download citation
DOI: https://doi.org/10.1007/978-3-031-05897-4_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05896-7
Online ISBN: 978-3-031-05897-4
eBook Packages: Computer ScienceComputer Science (R0)