Using the Students’ Levels of Preparation and Confidence as Feedback Information in Quiz-Based Learning Activities
This paper examines ways to enrich the feedback information students receive in closed-type quiz activities that include a revision phase (i.e., students are allowed to change their initial answers after they receive information from their peers, teacher, or system). Typically, in such activities, the information students receive is based on the percentage of students under each possible question choice. The conducted study analyzes the potential of two additional variables, namely the students’ level of preparation and confidence. Both variables are self-reported and, therefore, subjective. During the Fall semester 2016, 91 sophomore students enrolled in an Information Systems course participated in the study for five weeks. The activity was taking place during the first 20 min of each class. Students had to go through three phases and (a) answer a multiple-choice quiz with 8 questions and 4 options for each question, (b) receive feedback based on the whole classroom population, and (c) see the correct answer and discuss them with the teacher in the lecture that follows. The students were randomly grouped into four conditions, based on the feedback they received. The control group only received information on the percentage of students that selected each choice, the Confidence group received feedback on the percentage and the average level of confidence of students that selected each choice, the Preparation group received feedback on the percentage and the average level of preparation of students that selected each choice, and finally the Both group received feedback on the percentage and both the average level of confidence and preparation of students that selected each choice. Result analysis showed that in the most challenging questions (i.e., the ones where students’ answers were diverging) the students in the Confidence, Preparation, and Both groups significantly outperformed the students in the Control group. In addition, both confidence and preparation variables were significantly correlated to students’ performance during the initial phase, suggesting that students were accurate and sincere in describing their preparation and confidence levels. This paper is an extended version of , presented at the 9th International Conference on Computer Supported Education.
KeywordsFeedback Group awareness Formative assessment Quiz Confidence Preparation
This work has been partially funded by a Starting Grant from AUFF (Aarhus Universitets Forskningsfond), titled “Innovative and Emerging Technologies in Education”.
- 1.Papadopoulos, P.M., Natsis, A., Obwegeser, A.: Improving the quiz: student preparation and confidence as feedback metrics. In: The Proceedings of the 9th International Conference on Computer Supported Education – CSEDU 2017, Porto, Portugal (2017, in press)Google Scholar
- 4.Bransford, J.D., Brown, A., Cocking, R.: How People Learn: Mind, Brain, Experience and School. National Academy Press, Washington (2000)Google Scholar
- 7.Denny, P.: The effect of virtual achievements on student engagement. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013), pp. 763–772. ACM, New York (2013)Google Scholar
- 10.Lin, J.-W., Mai, L.-J., Lai, Y.-C.: Peer interaction and social network analysis of online communities with the support of awareness of different contexts. Int. J. Comput. Supp. Collab. Learn. 10(2), 139–159 (2015)Google Scholar
- 12.Erkens, M., Schlottbom, P., Bodemer, D.: Qualitative and quantitative information in cognitive group awareness tools: impact on collaborative learning. In: Looi, C.-K., Polman, J., Cress, U., Reimann, P. (eds.) Transforming Learning, Empowering Learners: 12th International Conference of the Learning Sciences, pp. 458–465. International Society of the Learning Sciences, Singapore (2016)Google Scholar
- 13.Schnaubert, L., Bodemer, D.: Subjective validity ratings to support shared knowledge construction in CSCL. In: Lindwall, O., Häkkinen, P., Koschmann, T., Tchounikine, P., Ludvigsen, S. (eds.) Exploring the Material Conditions of Learning: The Computer Supported Collaborative Learning (CSCL) Conference 2015, vol. 2, pp. 933–934. International Society of the Learning Sciences, Gothenburg (2015)Google Scholar
- 14.Méndez-Coca, D., Slisko, J.: Software Socrative and smartphones as tools for implementation of basic processes of active physics learning in classroom: an initial feasibility study with prospective teachers. Eur. J. Phys. Educ. 4(2), 17–24 (2013)Google Scholar
- 17.Deterding, S., Dixon, D., Khaled, R., Nacke, L.: From game design elements to gamefulness: defining “gamification”. In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, pp. 9–15. ACM, New York (2011)Google Scholar
- 19.Baker, R., Walonoski, J., Heffernan, N., Roll, I., Corbett, A., Koedinger, K.: Why students engage in “gaming the system” behavior in interactive learning environments. J. Interact. Learn. Res. 19(2), 185–224 (2008)Google Scholar
- 20.Papadopoulos, P.M., Lagkas, T., Demetriadis, S.N.: How revealing rankings affects student attitude and performance in a peer review learning environment. In: Zvacek, S., Restivo, M.T., Uhomoibhi, J., Helfert, M. (eds.) CSEDU 2015. CCIS, vol. 583, pp. 225–240. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29585-5_13CrossRefGoogle Scholar
- 22.Buunk, A.P., Gibbons, F.X.: Social comparison orientation: a new perspective on those who do and those who don’t compare with others. In: Guimond, S. (ed.) Social Comparison and Social Psychology: Understanding Cognition, Intergroup Relations and Culture, pp. 15–33. Cambridge University Press, Cambridge (2006)Google Scholar