Skip to main content
Log in

Designing e-assessment activities appropriate to learner's competency levels: Hybrid pedagogical framework and authoring tool

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

E-Assessment, which is a key element in the instructional design process, plays a major role in supporting and enhancing learning. However, the current e-assessment design does not achieve the desired pedagogical objectives in the e-learning environments. In this paper, we propose a hybrid pedagogical framework for e-learning environments, that includes a set of principles for competencies assessment design based on the Competency-based Approach (CBA) and Objective-based Approach (OBA). In addition, we present an authoring tool that illustrates the assessment design based on this proposed framework. This tool aims to support and assist teachers to create assessment activities suited to competency levels in a guided, controlled, and easy way. One of the main messages of this paper is that explicit use of pedagogical approaches allows the successful guidance of the teachers and effective e-assessment design.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Alruwais, N., Wills, G., & Wald, M. (2018). Advantages and challenges of using e-assessment. International Journal of Information and Education Technology, 8(1), 34–37.

    Article  Google Scholar 

  • Baldiņš, A. (2016). Insights into e-pedagogy concept development. Procedia-Social and Behavioral Sciences, 231, 251–255.

    Article  Google Scholar 

  • Bozkurt, A. (2019). From distance education to open and distance learning: A holistic evaluation of history, definitions, and theories. In Handbook of Research on Learning in the Age of Transhumanism (pp. 252–273). IGI Global.

  • Brooke, J. (2013). SUS: a retrospective. Journal of Usability Studies, 8(2), 29–40.

    Google Scholar 

  • Brusilovsky, P., Sosnovsky, S., & Shcherbinina, O. (2005). User modeling in a distributed e-learning architecture. In International conference on user modeling (pp. 387–391). Springer

  • Coowar, J. M. (2011). Parcours pédagogiques sur Claroline (Doctoral dissertation, Haute école pédagogique du canton de Vaud).

  • Dancik, G., & Kumar, A. (2003). A tutor for counter-controlled loop concepts and its evaluation. In Frontiers in education conference (Vol. 1, pp. T3C-7). STIPES

  • DeLuca, C., Chapman-Chin, A. E., LaPointe-McEwan, D., & Klinger, D. A. (2018). Student perspectives on assessment for learning. The Curriculum Journal, 29(1), 77–94.

    Article  Google Scholar 

  • Deneen, C., Fulmer, G. W., Brown, G. T., Tan, K., Leong, W. S., & Tay, H. Y. (2019). Value, practice and proficiency: Teachers’ complex relationship with assessment for learning. Teacher and Teacher Education, 80, 39–47.

    Article  Google Scholar 

  • Durand, G. (2006). La scénarisation de l'évaluation des activités pédagogiques utilisant les Environnements Informatiques d'Apprentissage Humain (Doctoral dissertation).

  • El Asame, M., & Wakrim, M. (2018). Towards a competency model: A review of the literature and the competency standards. Education and Information Technologies, 23(1), 225–236.

    Article  Google Scholar 

  • Gros, B., & García-Peñalvo, F. J. (2016). Future trends in the design strategies and technological affordances of e-learning. In M. Spector, B. B. Lockee, & M. D. Childress (Eds.), Learning, Design, and Technology. An International Compendium of Theory, Research, Practice, and Policy (pp. 1–23). Switzerland: Springer International Publishing

  • QTI (2006). "IMS Question and Test Interoperability Specification." From http://www.imsglobal.org/question/index.html.

  • Jammoul, Z. (2012). L’apprentissage par les compétences. Le rôle de l’évaluation au cours de l’apprentissage par compétence. 24e colloque de l’ADMEE-Europe. L’évaluation des compétences en milieu scolaire et en milieu professionnel. Présenté à Luxembourg. Luxembourg.

  • Lefevre, M., Guin, N., & Jean-Daubias, S. (2012). A Generic Approach for Assisting Teachers During Personalization of Learners’ Activities. In proceedings of the 2nd Workshop on Personalization Approaches for Learning Environments (PALE 2012).

  • Lefevre, M., Guin, N., Cablé, B., & Buffa, B. (2015, June). ASKER: un outil auteur pour la création d'exercices d'auto-évaluation. In Atelier EAEI (Évaluation des Apprentissages et Environnements Informatiques)-Conférence EIAH 2015.

  • Mandal, P., & Hsiao, I. H. (2018). Using differential mining to explore bite-size problem solving practices. In Educational Data Mining in Computer Science Education (CSEDM) Workshop

  • Maryam, E. A., Mohamed, W., Amal, B. (2018) An Improved Competency Meta-model for Adaptive Learning Systems. In: Ben Ahmed M., Boudhir A. (eds) Innovations in Smart Cities and Applications. SCAMS 2017. Lecture Notes in Networks and Systems, vol 37. Springer, Cham. https://doi.org/10.1007/978-3-319-74500-8_38

  • Moscinska, K., & Rutkowski, J. (2018, April). Effective computer-assisted assessment: Challenges and solutions. In 2018 IEEE Global Engineering Education Conference (EDUCON) (pp. 969–978). IEEE.

  • " Netquiz Pro 4 Home Page". Retrieved from https://www.ccdmd.qc.ca/catalogue/netquiz-pro-4 on 23 March 2019.

  • Nguyen, D. Q., & Blais, J. G. (2007). Approche par objectifs ou approche par compétences? Repères conceptuels et implications pour les activités d’enseignement, d’apprentissage et d’évaluation au cours de la formation clinique. Pédagogie Médicale, 8(4), 232–251.

    Article  Google Scholar 

  • " Onyx Home Page". Retrieved from https://www.onyx-editor.org/ on 23 March 2019.

  • Paquette, G. (2007). An ontology and a software framework for competency modeling and management. Educational Technology & Society, 10(3), 1–21.

    Google Scholar 

  • Patel, A. A. (2016). A secure paperless assessment software questionmark perception. In The Fifth International Conference on E-Learning and E-Technologies in Education (ICEEE2016) (p. 86)

  • Psyché, V. (2007). Rôle des ontologies en ingénierie des EIAH: cas d'un système d'assistance au design pédagogique (Doctoral dissertation, Université du Québec à Montréal).

  • " QuizPACK Home Page". Retrieved from http://www.pitt.edu/~taler/QuizPACK.html on 23 March 2019.

  • " Questionmark Perception Home Page". Retrieved from https://www.questionmark.com/fr/content/questionmark-perception on 23 March 2019.

  • " Respondus Home Page". Retrieved from https://www.respondus.com/ on 23 March 2019.

  • Martin, F., Ritzhaupt, A., Kumar, S., & Budhrani, K. (2019). Award-winning faculty online teaching practices: Course design, assessment and evaluation, and facilitation. The Internet and Higher Education, 42, 34–43.

    Article  Google Scholar 

  • Seery, N., Buckley, J., Delahunty, T., & Canty, D. (2019). Integrating learners into the assessment process using adaptive comparative judgement with an ipsative approach to identifying competence based gains relative to student ability levels. International Journal of Technology and Design Education, 29(4), 701–715.

    Article  Google Scholar 

  • Sison, R., Espulgar, C., Madrigal, L., Obedoza, J., Romblon, N., Sace, J., & Si, M. (2018). Toward an outcome-based methodology for developing game-based learning environments. In Proceedings of the 26th International Conference on Computers in Education.

  • Surahman, E., Wedi, A., Soepriyanto, Y., & Setyosari, P. (2018, December). Design of Peer Collaborative Authentic Assessment Model Based on Group Project Based Learning to Train Higher Order Thinking Skills of Students. In International Conference on Education and Technology (ICET 2018). Atlantis Press.

  • Santamaría Lancho, M., Hernández, M., Sánchez-Elvira Paniagua, Á., Luzón Encabo, J. M., & de Jorge-Botana, G. (2018). Using Semantic Technologies for Formative Assessment and Scoring in Large Courses and MOOCs. Journal of Interactive Media in Education, 2018(1).

  • Tanana, M. (2009). Evaluation formative du savoir-faire des apprenants à l'aide d'algorithmes de classification: application à l'électronique numérique (Doctoral dissertation).

  • van Groen, M. M., & Eggen, T. J. (2019). Educational Test Approaches: The Suitability of Computer-Based Test Types for Assessment and Evaluation in Formative and Summative Contexts. Journal of Applied Testing Technology, 21(1), 12–24.

    Google Scholar 

  • Susiati, S., Iye, R., & Suherman, L. O. A. (2019). Hot Potatoes Multimedia Applications in Evaluation of Indonesian Learning In SMP Students in Buru District. ELS Journal on Interdisciplinary Studies in Humanities, 2(4), 556–570.

    Article  Google Scholar 

  • Zniber, N. (2009). Modèle orienté service pour la conception de parcours pédagogiques personnalisés (Doctoral dissertation).

Download references

Funding

No funds, grants, or other support was received.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maryam El Asame.

Ethics declarations

Conflict of interest

The authors have no relevant financial or non-financial interests to disclose.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 462 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

El Asame, M., Wakrim, M. & battou, A. Designing e-assessment activities appropriate to learner's competency levels: Hybrid pedagogical framework and authoring tool. Educ Inf Technol 27, 2543–2567 (2022). https://doi.org/10.1007/s10639-021-10607-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-021-10607-y

Keywords

Navigation