Skip to main content

Usability Evaluation of the Aging Scenario Wiki as a Learning Tool

  • Conference paper
  • First Online:
HCI International 2023 – Late Breaking Papers (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14055))

Included in the following conference series:

  • 412 Accesses

Abstract

The Chinese government has developed a unique “Smart Eldercare” model that utilizes digital technologies to address the growing needs of its rapidly aging population. To implement this model, the government has initiated policies to accelerate talent cultivation, highlighting the importance of Smart Eldercare education at different levels in universities and vocational schools. This paper presents the design and development of an aging scenario Wiki and conducts a usability evaluation of this Wiki as a collaborative learning tool for nascent Smart Eldercare education. First, during the development phase, we conducted lab-based usability testing using 18 tasks of 3 types with 12 student participants who followed the think-aloud protocol. Our analysis identified seven usability issues, and we subsequently addressed them in the optimization phase. Second, we evaluated the usability of the aging scenario Wiki as a learning tool in actual work teaching activities involving 54 students who collaborated on creating aging scenarios. The evaluation yields a System Usability Scale score of 67.45 and a C usability rating, indicating the areas for further improvement. Overall, the aging scenario Wiki demonstrated the potential to be a practical and effective learning tool for nascent Smart Eldercare education. Our study highlights the importance of user-centered design and usability testing in developing educational resources for emerging fields such as Smart Eldercare.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. An, N.: Toward learning societies for digital aging. arXiv preprint arXiv:2305.01137 (2023)

  2. An, N., Xu, Y., Gao, Q., Zhu, W., Wu, A., Chen, H.: Automatically labeling aging scenarios with a machine learning approach. In: Duffy, V.G., Gao, Q., Zhou, J., Antona, M., Stephanidis, C. (eds.) HCII 2022. LNCS, vol. 13521, pp. 242–260. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-17902-0_18

    Chapter  Google Scholar 

  3. Archambault, P.M., et al.: Wikis and collaborative writing applications in health care: a scoping review. J. Med. Internet Res. 15(10), e2787 (2013)

    Article  Google Scholar 

  4. Bangor, A., Kortum, P., Miller, J.: Determining what individual SUS scores mean: adding an adjective rating scale. J. Usability Stud. 4(3), 114–123 (2009)

    Google Scholar 

  5. Barros, B., Verdejo, M.: Entornos para la realización de actividades de aprendizaje colaborativo a distancia. Inteligencia Artificial. Revista Iberoamericana de Inteligencia Artificial 5(12), 39–49 (2001)

    Google Scholar 

  6. Battleson, B., Booth, A., Weintrop, J.: Usability testing of an academic library web site: a case study. J. Acad. Librariansh. 27(3), 188–198 (2001)

    Article  Google Scholar 

  7. Becker, D.A., Yannotta, L.: Modeling a library web site redesign process: developing a user-centered web site through usability testing. Inf. Technol. Libr. 32(1), 6–22 (2013)

    Google Scholar 

  8. Brooke, J., et al.: SUS-a quick and dirty usability scale. Usability Eval. Ind. 189(194), 4–7 (1996)

    Google Scholar 

  9. Chen, H., Hagedorn, A., An, N.: The development of smart eldercare in China. The Lancet Regional Health-Western Pacific (2022)

    Google Scholar 

  10. Chin, J.P., Diehl, V.A., Norman, K.L.: Development of an instrument measuring user satisfaction of the human-computer interface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 213–218 (1988)

    Google Scholar 

  11. Duffy, P., Bruns, A.: The use of blogs, wikis and RSS in education: a conversation of possibilities. In: Learning on the Move: Proceedings of the Online Learning and Teaching Conference 2006, pp. 31–38. Queensland University of Technology (2006)

    Google Scholar 

  12. Dumas, J.S., Dumas, J.S., Redish, J.: A practical guide to usability testing. Intellect books (1999)

    Google Scholar 

  13. Johnson, D.W., Johnson, R.T., Smith, K.A.: Cooperative learning returns to college what evidence is there that it works? Change Mag. High. Learn. 30(4), 26–35 (1998)

    Google Scholar 

  14. Kirakowski, J.: The software usability measurement inventory: background and usage. In: Usability Evaluation in Industry, pp. 169–178 (1996)

    Google Scholar 

  15. Lee, J.K., Tomasa, L., Evans, P., Pho, V.B., Bear, M., Vo, A.: Impact of geriatrics elective courses at three colleges of pharmacy: attitudes toward aging and eldercare. Curr. Pharm. Teach. Learn. 11(12), 1239–1247 (2019)

    Article  Google Scholar 

  16. Lewis, J.R.: Psychometric evaluation of the post-study system usability questionnaire: the PSSUQ. In: Proceedings of the Human Factors Society Annual Meeting, vol. 36, pp. 1259–1260. Sage Publications, Los Angeles (1992)

    Google Scholar 

  17. Lin, C.-Y., Okamoto, M.: The method of user’s requirement analysis by participation of the user: constructing an information system for travelers. In: Kurosu, M. (ed.) HCD 2009. LNCS, vol. 5619, pp. 862–868. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-02806-9_99

    Chapter  Google Scholar 

  18. Majchrzak, A., Wagner, C., Yates, D.: The impact of shaping on knowledge reuse for organizational improvement with wikis. MIS Q. 455–469 (2013)

    Google Scholar 

  19. Marshall, C., Mcmanus, B., Prail, A.: Usability of product X-lessons from a real product. Behav. Inf. Technol. 9(3), 243–253 (1990)

    Article  Google Scholar 

  20. Meyrowitz, J.: The impact of electronic media on social behavior (1985)

    Google Scholar 

  21. Nash, S.: Learning objects, learning object repositories, and learning theory: preliminary best practices for online courses. Interdisc. J. E-Learn. Learn. Objects 1(1), 217–228 (2005)

    Google Scholar 

  22. Nielsen, J., Landauer, T.K.: A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT’93 and CHI’93 Conference on Human Factors in Computing Systems, pp. 206–213 (1993)

    Google Scholar 

  23. Ohnishi, J., Go, K.: Requirement engineering. Kyoritsu Shuppan (2002)

    Google Scholar 

  24. Rubin, J., Chisnell, D.: Handbook of Usability Testing: How to Plan, Design and Conduct Effective Tests. Wiley, Hoboken (2008)

    Google Scholar 

  25. Salinas Ibáñez, J.M., et al.: Enseñanza flexible, aprendizaje abierto: las redes como herramientas para la formación. Revista electronica de tecnologia educativa, Edutec (1999)

    Google Scholar 

  26. Sauro, J.: Measuring usability with the system usability scale (SUS) (2011)

    Google Scholar 

  27. Seibert, K., et al.: Application scenarios for artificial intelligence in nursing care: rapid review. J. Med. Internet Res. 23(11), e26522 (2021)

    Article  Google Scholar 

  28. Simon, K.E.H.: Protocol Analysis: Verbal Reports as Data. MIT Press, Cambridge (1984)

    Google Scholar 

  29. Smith, B.L., MacGregor, J.T.: What is collaborative learning (1992)

    Google Scholar 

  30. Tullis, T., Fleischman, S., McNulty, M., Cianchette, C., Bergel, M.: An empirical comparison of lab and remote usability testing of web sites. In: Usability Professionals Association Conference (2002)

    Google Scholar 

  31. Willis, J.L., et al.: Impact of interprofessional geriatric teamwork on students’ perceptions of older persons and collaborative practice. Gerontol. Geriatr. Educ. 44(1), 118–130 (2023)

    Article  Google Scholar 

  32. Zhu, C.: Student satisfaction, performance, and knowledge construction in online collaborative learning. J. Educ. Technol. Soc. 15(1), 127–136 (2012)

    Google Scholar 

  33. Zolezzi, M., Sadowski, C.A., Al-Hasan, N., Alla, O.G.: Geriatric education in schools of pharmacy: students’ and educators’ perspectives in Qatar and Canada. Curr. Pharm. Teach. Learn. 10(9), 1184–1196 (2018)

    Article  Google Scholar 

Download references

Acknowledgements

This work was partially supported by Anhui Province Higher Education Institution Quality Project “Smart Eldercare” (2019kfkc010) and Hefei University of Technology Teaching Reform Demonstration Course Project “Smart Eldercare” (KCSZ2020038).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yaru Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lu, Z. et al. (2023). Usability Evaluation of the Aging Scenario Wiki as a Learning Tool. In: Gao, Q., Zhou, J., Duffy, V.G., Antona, M., Stephanidis, C. (eds) HCI International 2023 – Late Breaking Papers. HCII 2023. Lecture Notes in Computer Science, vol 14055. Springer, Cham. https://doi.org/10.1007/978-3-031-48041-6_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-48041-6_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-48040-9

  • Online ISBN: 978-3-031-48041-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics