Skip to main content

Qualitative Evaluation of the Usability of a Web-Based Survey Tool to Assess Reading Comprehension and Metacognitive Strategies of University Students

  • Conference paper
  • First Online:
Social Computing and Social Media. Design, Ethics, User Behavior, and Social Network Analysis (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12194))

Included in the following conference series:

Abstract

Survey tools are the main support for the development of reading comprehension evaluation instruments. The functionalities provided in the questionnaires design are the fundamental pillar to elaborate studies to evaluate in depth the reading comprehension and metacognitive strategies used. Survey tools are the main support for the development of reading comprehension evaluation instruments. Questionnaires design in available survey tools are based primarily on open, closed, multiple choice, or mixed questions. The functionalities provided in the questionnaires design are the fundamental pillar to elaborate studies to evaluate in depth the reading comprehension and metacognitive strategies used. However, current survey tools do not provide the required functionalities (i.e., types of questions) to design studies/questionnaires that allow the development of reading tasks that examine the students’ strategic potential.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Carvalho, A.: Usability testing of educational software: methods, techniques and evaluators. Actas 3o Simpósio Int. Informática Educ., pp. 139–148 (2001)

    Google Scholar 

  2. Nielsen, J.: Usability Engineering. Morgan Kaufmann (1994)

    Google Scholar 

  3. Kumar, B.A., Mohite, P.: Usability of mobile learning applications: a systematic literature review. J. Comput. Educ. 5(1), 1–17 (2018)

    Article  Google Scholar 

  4. Anderson, K., Burford, O., Emmerton, L.: Mobile health apps to facilitate self-care: a qualitative study of user experiences. PLoS ONE 11(50), e0156164 (2016)

    Article  Google Scholar 

  5. Hertzum, M.: A usability test is not an interview. Interactions 23(2), 82–84 (2016)

    Article  Google Scholar 

  6. Taylor, C.: Interviewing in Qualitative Research in Healthcare, Maidenhead Berks. Open (2005)

    Google Scholar 

  7. DiCicco-Bloom, B., Crabtree, B.F.: The qualitative research interview. Med. Educ. 40(4), 314–321 (2006)

    Article  Google Scholar 

  8. Blandford, A.E.: Semi-structured qualitative studies. Interaction Design Foundation (2013)

    Google Scholar 

  9. Pirnay-Dummer, P., Ifenthaler, D., Spector, J.M.: Highly integrated model assessment technology and tools. Educ. Technol. Res. Dev. 58(1), 3–18 (2010)

    Article  Google Scholar 

  10. Parshall, C.G., Harmes, J.C.: Improving the quality of innovative item types: four tasks for design and development. J. Appl. Test. Technol. 10(1), 1–20 (2009)

    Google Scholar 

  11. Lund, A.M.: Measuring usability with the use questionnaire12. Usability Interface 8(2), 3–6 (2001)

    Google Scholar 

  12. Davis, F.D.: Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 13, 319–340 (1989)

    Article  Google Scholar 

  13. Lin, H.X., Choong, Y.-Y., Salvendy, G.: A proposed index of usability: a method for comparing the relative usability of different software systems. Behav. Inf. Technol. 16(4–5), 267–277 (1997)

    Article  Google Scholar 

  14. OECD: Students, Computers and Learning (2015)

    Google Scholar 

  15. Martínez, T., Vidal-Abarca, E., Sellés, P., Gilabert, R.: Evaluación de las estrategias y procesos de comprensión: el Test de Procesos de Comprensión. Infancia Aprendiz 31(3), 319–332 (2008)

    Article  Google Scholar 

  16. Vieiro, P., Gómez, I.: Psicología de la lectura. Esp. Editor. Pearson (2004)

    Google Scholar 

  17. Arribas, D., Cuetos, F., Rodríguez, B., Ruano, E.: PROLEC-R Batería de evaluación de los procesos lectores, revisada. TEA Ediciones, Madrid (2010)

    Google Scholar 

  18. Rodríguez, V.J., Ferreras, A.P., Izquierdo, J.M.A., Durante, L.A.: Medición de estrategias metacognitivas mediante la Escala de Conciencia Lectora: ESCOLA. Electron. J. Res. Educ. Psychol. 7(2), 779–804 (2009)

    Google Scholar 

  19. Ávila Clemente, V., Gil Pelluch, L., Gilabert Pérez, R., Maña Lloria, A., Llorens Tatay, A.C., Vidal-Abarca Gamez, E.: Método de evaluación dinámica automatizado’de competencias lectoras para educación secundaria (EdiLEC). Univ. Psychol. 15(1), 219–232 (2016)

    Article  Google Scholar 

  20. Dialect: [En línea] (2013). http://www.diamas.cl/#brief1. Accedido 28 ene 2020

  21. Optimus: [En línea] (2019). http://nilvem.com/optimus3/

  22. Cain, K., Oakhill, J.: Assessment matters: issues in the measurement of reading comprehension. Br. J. Educ. Psychol. 76(4), 697–708 (2006)

    Article  Google Scholar 

  23. McKay, T.: More on the validity and reliability of C-test scores: a meta-analysis of C-test studies. Georgetown University (2019)

    Google Scholar 

  24. Liu, J.: The assessment agent system: design, development, and evaluation. Educ. Technol. Res. Dev. 61(2), 197–215 (2013)

    Article  Google Scholar 

  25. Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006)

    Article  Google Scholar 

  26. Morville, P.: Experience design unplugged. In: ACM SIGGRAPH 2005 Web Program, pp. 10 (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maria Elena Truyol .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rojas P., L.A., Truyol, M.E., Calderon Maureira, J.F., Orellana Quiñones, M., Puente, A. (2020). Qualitative Evaluation of the Usability of a Web-Based Survey Tool to Assess Reading Comprehension and Metacognitive Strategies of University Students. In: Meiselwitz, G. (eds) Social Computing and Social Media. Design, Ethics, User Behavior, and Social Network Analysis. HCII 2020. Lecture Notes in Computer Science(), vol 12194. Springer, Cham. https://doi.org/10.1007/978-3-030-49570-1_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49570-1_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49569-5

  • Online ISBN: 978-3-030-49570-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics