Study of the Usability of the WYRED Ecosystem Using Heuristic Evaluation

  • Francisco J. García-Peñalvo
  • Andrea Vázquez-Ingelmo
  • Alicia García-HolgadoEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11590)


The WYRED ecosystem is a composition of Open Source tools and the people involved in the project, i.e., partners, stakeholders and young people between the ages of 7 and 30 years. The main component of this ecosystem is the WYRED Platform. The WYRED Platform relies on communities, which are a set of interaction spaces where conversations and research projects are developed. Every community has a person or persons in charge of its management, which are the so-called facilitators, and also a set of members, mainly young people, interacting through discussion threads. The high levels of interaction required to accomplish the WYRED Platform’s goals lead to the necessity of ensuring that the system is accepted by its final users. Given this need, a preliminary study was performed to analyze the usability of the Platform from the point of view of young people. However, it is also crucial that the ecosystem meets usability criteria for the facilitators, due to their role of encouraging young people to participate and serving as a guide in the conversations taking place within communities, as well as in the research projects developed by the young people about different topics related to the digital society. Therefore, a usability study targeting facilitators was carried out to reach insights about how these users value the system’s usability. This usability study was performed through a combination of two techniques, a heuristic analysis by experts and the Computer System Usability Questionnaire to collect the experience of the real users.


Digital society Heuristic evaluation Usability European project Technological ecosystem Software ecosystem Youth 



This research was supported by the Spanish Ministry of Education, Culture and Sport under a FPU fellowship (FPU17/03276).

With the support of the EU Horizon 2020 Programme in its “Europe in a changing world – inclusive, innovative and reflective Societies (HORIZON 2020: REV-INEQUAL-10-2016: Multi-stakeholder Platform for enhancing youth digital opportunities)” Call. Project WYRED (netWorked Youth Research for Empowerment in the Digital society) (Grant agreement No. 727066). The sole responsibility for the content of this webpage lies with the authors. It does not necessarily reflect the opinion of the European Union. The European Commission is not responsible for any use that may be made of the information contained therein.


  1. 1.
    Burch, S.: Information society and knowledge society. In: Ambrosi, A., Peugeot, V., Pimienta, D. (eds.) Word Matters: multicultural perspectives on information societies. C&F Éditions, Caen (2005)Google Scholar
  2. 2.
    UNESCO: Towards Knowledge Societies. An Interview with Abdul Waheed Khan (2003)Google Scholar
  3. 3.
    Buckingham, D.: Youth, Identity, and Digital Media. The MIT Press, Cambridge (2007)Google Scholar
  4. 4.
    García-Peñalvo, F.J., Kearney, N.A.: Networked youth research for empowerment in digital society: the WYRED project. In: García-Peñalvo, F.J. (ed.) Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM 2016), Salamanca, Spain, November 2–4, 2016, pp. 3–9. ACM, New York (2016)Google Scholar
  5. 5.
    García-Peñalvo, Francisco J., Durán-Escudero, J.: Interaction design principles in WYRED platform. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2017. LNCS, vol. 10296, pp. 371–381. Springer, Cham (2017). Scholar
  6. 6.
    García-Peñalvo, F.J.: WYRED project. Educ. Knowl. Soc. 18, 7–14 (2017)Google Scholar
  7. 7.
    García-Peñalvo, F.J., García-Holgado, A.: WYRED, a platform to give young people the voice on the influence of technology in today’s society. A citizen science approach. In: Villalba-Condori, K.O., García-Peñalvo, F.J., Lavonen, J., Zapata-Ros, M. (eds.) Proceedings of the II Congreso Internacional de Tendencias e Innovación Educativa – CITIE 2018, Arequipa, Perú, November 26–30, 2018, pp. 128–141., Aachen (2019)Google Scholar
  8. 8.
    García-Peñalvo, Francisco J., García-Holgado, A., Vázquez-Ingelmo, A., Seoane-Pardo, Antonio M.: Usability test of WYRED platform. In: Zaphiris, P., Ioannou, A. (eds.) LCT 2018. LNCS, vol. 10924, pp. 73–84. Springer, Cham (2018). Scholar
  9. 9.
    García-Peñalvo, F.J., García-Holgado, A., Vázquez-Ingelmo, A., Seoane Pardo, A.M.: Analyzing the usability of the WYRED Platform with undergraduate students to improve its features. Universal Access in the information society in press (2019)Google Scholar
  10. 10.
    Brooke, J.: SUS-A quick and dirty usability scale. Usability Eval. Ind. 189, 4–7 (1996)Google Scholar
  11. 11.
    Nielsen, J.: Heuristic evaluation. In: Nielsen, J., Mack, R.L. (eds.) Usability Inspection Methods, vol. 17, pp. 25–62. Wiley, Hoboken (1994)Google Scholar
  12. 12.
    Sauro, J., Lewis, J.R. Morgan Kaufmann, Boston (2012)Google Scholar
  13. 13.
    Lewis, J.R.: IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Interact. 7, 57–78 (1995)CrossRefGoogle Scholar
  14. 14.
    Lewis, J.R.: Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int. J. Hum.-Comput. Interact. 14, 463–488 (2002)CrossRefGoogle Scholar
  15. 15.
    Hedlefs Aguilar, M.I., de la Garza González, A., Sánchez Miranda, M.P., Garza Villegas, A.A.: Spanish adaptation of computer system usability questionnaire CSUQ. Revista Iberoamericana de las Ciencias Computacionales e Informática, vol. 4 (2015)Google Scholar
  16. 16.
    Sauro, J., Lewis, J.R.: Quantifying the User Experience: Practical Statistics for User Research. Morgan Kaufmann, Amsterdam (2016)Google Scholar
  17. 17.
    Vázquez-Ingelmo, A.: Code repository that supports the analysis of the usability test (through the CSUQ questionnaire) applied to the WYRED Platform (2019)Google Scholar
  18. 18.
    Khajouei, R., Ameri, A., Jahani, Y.: Evaluating the agreement of users with usability problems identified by heuristic evaluation. Int. J. Med. Informatics 117, 13–18 (2018)CrossRefGoogle Scholar
  19. 19.
    Brooke, J.: SUS: a retrospective. J. Usability Stud. 8, 29–40 (2013)Google Scholar
  20. 20.
    Schriesheim, C.A., Hill, K.D.: Controlling acquiescence response bias by item reversals: the effect on questionnaire validity. Educ. Psychol. Meas. 41, 1101–1114 (1981)CrossRefGoogle Scholar
  21. 21.
    Salvendy, G.: Handbook of human factors and ergonomics. Wiley, Hoboken (2012)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.GRIAL Research Group, Research Institute for Educational SciencesUniversity of SalamancaSalamancaSpain

Personalised recommendations