The Dilemmas of Formulating Theory-Informed Design Guidelines for a Video Enhanced Rubric
Learners aiming to master a complex skill may benefit from the combination of abstract information found in a text-based analytical rubric and concrete information provided by a video modeling example. In this paper, we address the design dilemmas of combining video modeling examples and rubrics into a Video Enhanced Rubric. We propose a model to address these design dilemma’s and develop our first prototype based on this model. We review the first prototype through a two-stage international expert validation session. In the first stage, 20 experts are asked to design a user interface for the Video Enhanced Rubric. In the second stage, 20 experts are asked to perform an expert appraisal of our first prototype. The preliminary results of the expert validation session are subsequently analyzed using Sauli, Cattaneo and van der Meij’s Framework for Developing Instructional Hypervideo to detect common design suggestions. Following the results of the expert validation, we developed a second prototype of the Video Enhanced Rubric. With the design guidelines of a Video Enhanced Rubric, we aim to improve the formative assessment and mastery of complex skills by fostering learner’s mental model development and the quality (consistency, concreteness) of both given as well as received feedback. On a more general note, we expect the design dilemmas addressed in this paper to inform researchers who aim to apply theoretical multimedia design guidelines to formative assessment practices with rubrics.
KeywordsVideo Rubrics (Formative) assessment Complex skills Mental models
We would like to gratefully acknowledge the contribution of the Viewbrics project, that is funded by the practice-oriented research program of the Netherlands Initiative for Education Research (NRO), part of The Netherlands Organisation for Scientific Research (NWO).
- 2.Rusman, E., Martínez-Monés, A., Boon, J., et al.: Gauging teachers’ needs with regard to technology-enhanced formative assessment (TEFA) of 21st century skills in the classroom. In: Kalz, M., Ras, E. (eds.) CAA 2014. CCIS, vol. 439, pp. 1–14. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-08657-6_1CrossRefGoogle Scholar
- 3.Thijs, A., Fisser, P., van der Hoeven, M.: 21E Eeuwse Vaardigheden in Het Curriculum Van Het Funderend Onderwijs. Slo 128 (2014)Google Scholar
- 4.Ackermans, K., Rusman, E., Brand-Gruwel, S., Specht, M.: A first step towards synthesizing rubrics and video for the formative assessment of complex skills. In: Joosten-ten Brinke, D., Laanpere, M. (eds.) TEA 2016. CCIS, vol. 653, pp. 1–10. Springer International Publishing, Cham (2017). https://doi.org/10.1007/978-3-319-57744-9_1CrossRefGoogle Scholar
- 5.Westera, W.: Reframing contextual learning: anticipating the virtual extensions of context 14, 201–212 (2011)Google Scholar
- 9.Park, B., Plass, J.L., Brünken, R.: Cognitive and affective processes in multimedia learning. Learn. Instr. 29, 125–127 (2014). https://doi.org/10.1016/j.learninstruc.2013.05.005CrossRefGoogle Scholar
- 14.Leutner, D.: Motivation and emotion as mediators in multimedia learning. Learn. Instr. 29, 174–175 (2014). https://doi.org/10.1016/j.learninstruc.2013.05.004CrossRefGoogle Scholar
- 16.Mayer, R.E.: Incorporating motivation into multimedia learning. Learn. Instr. 29, 171–173 (2014). https://doi.org/10.1016/j.learninstruc.2013.04.003CrossRefGoogle Scholar
- 21.Mayer, R.E.: Multimedia Learning, 2nd edn. Cambridge University Press, Cambridge (2009). https://doi.org/10.1007/s13398-014-0173-7.2
- 22.Janssen-Noordman, A.M., Van Merriënboer, J.J.G.: Innovatief Onderwijs Ontwerpen. Wolters-Noordhoff, Groningen (2002)Google Scholar
- 24.Mertler, C.: Designing scoring rubrics for your classroom. Pract. Assess. Res. Eval. 7, 1–10 (2001)Google Scholar
- 28.Hoogerheide, V., Loyens, S.M.M., van Gog, T.: Effects of creating video-based modeling examples on learning and transfer. Learn. Instr. 33, 108–119 (2014). https://doi.org/10.1016/j.learninstruc.2014.04.005CrossRefGoogle Scholar
- 30.Cattaneo, A., Van Der Meij, H., Aprea, C., et al.: A model for designing hypervideo-based instructional scenarios. Paper submitted for publicationGoogle Scholar