Skip to main content

Peer Validation and Generation Tool for Question Banks in Learning Management Systems

  • Conference paper
  • First Online:
Applied Informatics (ICAI 2020)

Abstract

One of the biggest challenges in ICT-mediated learning models, such as e-learning and b-learning, is the process of skills assessment. Specifically during the elaboration of random questionnaires based on question banks in Learning Management Systems (LMS), where difficulties such as misspellings or conceptual errors arise. This can make questions difficult for students to understand, and therefore, the possibility of answering wrong by accident. In addition, sometimes questions are not organized by topics or levels of difficulty, which can lead to exams on topics not yet seen in class, or questionnaires with the wrong difficulty level among students in the same course. To reduce this problem, we developed a peer review tool for evaluating and adjusting questions and then exporting them to an LMS as a question bank, organized by topic and difficulty level. This work shows the structure of such a tool, and first validation results for impact and quality using double-blind testing in questionnaire design for a course taught at a higher education institution in Colombia.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Barberà, E.: Aportaciones de la tecnología a la e-Evaluación Technological contributions to e-Assessment Introducción. RED. Revista de Investigación a Distancia, pp. 1–13 (2005)

    Google Scholar 

  2. Bécue Bertaut, M.: Análisis estadístico de datos de encuestas. Tratamiento conexo de respuestas a preguntas abiertas y cerradas. Papers. Revista de Sociologia 37, 113 (1991). https://doi.org/10.5565/rev/papers/v37n0.1599

  3. Belloch, C.: Entornos Virtuales de Aprendizaje. Unidad de Tecnología Educativa (UTE). Universidad de Valencia, pp. 1–9 (2009)

    Google Scholar 

  4. Blosser, P.E.: How to ... Ask the Right Questions. National Science Teachers Association, Nov ember 2015. https://doi.org/10.2505/9780873551021

  5. Rafael, C.J.: Evaluación del aprendizaje en espacios virtuales -TIC. Ediciones Uninorte (2011)

    Google Scholar 

  6. Carnoy, M.: Las TIC en la enseñanza: posibilidades y retos. Lección inaugural del curso académico 10(1), 20 (2004)

    Google Scholar 

  7. Cuervo-Arango, M.A.: Metodología de cuestionarios: Principios y aplicaciones. Boletín de la Anabad 43(3), 263–272 (1993)

    Google Scholar 

  8. Fernández, F.: La evaluación y su importancia en la educación. Distancia por tiempos (2018). https://educacion.nexos.com.mx/?p=1016

  9. Fernández Núñez, L.: ¿Cómo se elabora un cuestionario? Bulletí LaRecerca 1(2002), 1–9 (2007). ISSN 1886–1964

    Google Scholar 

  10. García-Martínez, R., Lage, F., Pessaq, R., Cataldi, Z.: Metodología extendida para la creación de software educativo desde una visión integradora. RELATEC: Revista Latinoamericana de Tecnología Educativa 2(1), 1–32 (2003)

    Google Scholar 

  11. García-Peñalvo, F.J., García-Holgado, A.: Open source solutions for knowledge management and technological ecosystems. IGI Global, October 2016. https://doi.org/10.4018/978-1-5225-0905-9

  12. García-Peñalvo, F.J., Seoane Pardo, A.M.: Una revisión actualizada del concepto de eLearning. Décimo Aniversario. Education in the Knowledge Society (EKS) 16(1), 119 (2015). https://doi.org/10.14201/eks2015161119144

  13. Hamari, J., Sjöklint, M., Ukkonen, A.: The sharing economy: Why people participate in collaborative consumption. J. Assoc. Inf. Sci. Technol. 67(9), 2047–2059 (2016). https://doi.org/10.1002/asi.23552

  14. Informatik, A., Manente, D., Schaefer, S., Koch, P.F.: Moodle Plugin StudentQuiz Bachelorarbeit. HSR Hochschule für Technik Rapperswil, Bachelorarbeit (2017)

    Google Scholar 

  15. Jefferson, R., Arnold, L.: Effects of virtual education on academic culture: perceived advantages and disadvantages. Online Submission 6(3), 61–66 (2009)

    Google Scholar 

  16. Koufetta-Menicou, C., Scaife, J.: Teachers’ questions - types and significance in science education. Sch. Sci. Rev. 81(296), 79–84 (2000)

    Google Scholar 

  17. Lezcano, L., Vilanova, G.: Instrumentos de evaluación de aprendizaje en entornos virtuales. Perspectiva de estudiantes y aportes de docentes. Informes Científicos Técnicos - UNPA 9(1), 1–36 (2017). https://doi.org/10.22305/ict-unpa.v9i1.235

  18. Luxton-Reilly, A., Lewis, A., Plimmer, B.: Comparing sequential and parallel code review techniques for formative feedback. In: ACM International Conference Proceeding Series, pp. 45–52. Association for Computing Machinery, New York, New York, USA, January 2018. https://doi.org/10.1145/3160489.3160498

  19. Marmolejo, E.K., Wilder, D.A., Bradley, L.: A preliminary analysis of the effects of response cards on student performance and participation in an upper division university course. J. Appl. Behav. Anal. 37(3), 405–410 (2004). https://doi.org/10.1901/jaba.2004.37-405

    Article  Google Scholar 

  20. Medved, J.: LMS Industry User Research Report (2017). http://www.capterra.com/learning-management-system-software/user-research

  21. Mirzakhani, M., Ashrafzadeh, H., Ashrafzadeh, A.: The virtual university: advantages and disadvantages. In: ICDLE 2010–2010 4th International Conference on Distance Learning and Education, Proceedings, pp. 32–36 (2010). https://doi.org/10.1109/ICDLE.2010.5606048

  22. Moodle: Moodle - Open-source learning platform \(|\) Moodle.org (2018). https://moodle.org/

  23. O’Donoghue, J., Singh, G., Dorward, L.: Virtual education in universities: a technological imperative. Br. J. Educ. Technol. 32(5), 511–523 (2001). https://doi.org/10.1111/1467-8535.00221

    Article  Google Scholar 

  24. Roldán López, N.: Ambientes virtuales de aprendizaje (AVAS): ¿Cómo quieren aprender los estudiantes? Revista Virtual Universidad Católica del Norte 1(19) (2011)

    Google Scholar 

  25. Salinas Quiroz, J.: Diseño y moderación de entornos virtuales de aprendizaje (EVA). Editorial UOC (Universitat Oberta de Catalunya), S.L, Barcelona (2011)

    Google Scholar 

  26. Slavin, R.E.: Student teams and comparison among equals: effects on academic performance and student attitudes. J. Educ. Psychol. 70(4), 532–538 (1978). https://doi.org/10.1037/0022-0663.70.4.532

    Article  Google Scholar 

  27. Stowell, J.R., Nelson, J.M.: Benefits of electronic audience response systems on student participation, learning, and emotion. Teach. Psychol. 34(4), 253–258 (2007). https://doi.org/10.1080/00986280701700391

    Article  Google Scholar 

  28. UNESCO: El Coronavirus COVID-19 y la educación superior: impacto y recomendaciones - UNESCO-IESALC (2020). https://www.iesalc.unesco.org/2020/04/02/el-coronavirus-covid-19-y-la-educacion-superior-impacto-y-recomendaciones/

  29. Vera, J.: Valor Pedagógico De La Evaluación Mediada Por Las Tic. Technical report, Universidad Nacional de Colombia, Medellín, Colombia (2013)

    Google Scholar 

  30. Wilson, G., Randall, M.: The implementation and evaluation of a new learning space: a pilot study. Res. Learn. Technol. 20(2) (2012). https://doi.org/10.3402/rlt.v20i0/14431

  31. Zhang, D., Zhao, J.L., Zhou, L., Nunamaker, J.F.: Can e-learning replace classroom learning? (may 2004). https://doi.org/10.1145/986213.986216

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andres Sanchez-Martin .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sanchez-Martin, A. et al. (2020). Peer Validation and Generation Tool for Question Banks in Learning Management Systems. In: Florez, H., Misra, S. (eds) Applied Informatics. ICAI 2020. Communications in Computer and Information Science, vol 1277. Springer, Cham. https://doi.org/10.1007/978-3-030-61702-8_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-61702-8_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-61701-1

  • Online ISBN: 978-3-030-61702-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics