Developing Game-Based Models of Cooperation, Persistence and Problem Solving from Collaborative Gameplay
Collaborative-problem solving (CPS) is an important 21st century skill and it continues to be a complex skill to model and assess. We approached this challenge by first looking at the individual level primary cognitive and social aspects of CPS. This paper demonstrates ongoing work of designing and developing game-based models of three CPS components: cooperation, problem-solving, and persistence. A study was conducted collecting data from the game-play of 11 groups (three middle school students in each group) tasked with solving challenges in Physics Playground. We employed evidence-centered design principles to develop behavioral indicators of cooperation, problem-solving and persistence. These were used to code each student’s behavior during three hours of video-recorded gameplay. For each CPS component, we applied hierarchical clustering on this video-coded data and qualitatively evaluated two generated clusters of students across groups. For cooperation, there was more communication with other students in working towards a solution for one group. For problem-solving, one group had more instances of talking about possible solutions. For persistence, one group had more attempts in a challenge and was more on-task. Implications of results, limitations and future work were discussed.
KeywordsCooperation Persistence Problem-solving Evidence-centered design Collaborative problem solving Video coding Hierarchical clustering
We are grateful to Prof. Valerie Shute and Dr. Lubin Wang from Florida State University for their support in this study.
- 2.Organization for Economic Co-operation and Development (OECD): PISA 2015 collaborative problem solving frameworks (2013). http://www.oecd.org/pisa/pisaproducts/pisa2015draftframeworks.htm
- 3.Hesse, F., Care, E., Buder, J., Sassenberg, K., Griffin, P.: A framework for teachable collaborative problem solving skills. In: Griffin, P., Care, E. (eds.) Assessment and Teaching of 21st Century Skills. EAIA, pp. 37–56. Springer, Dordrecht (2015). https://doi.org/10.1007/978-94-017-9395-7_2CrossRefGoogle Scholar
- 4.Liu, L., Hao, J., von Davier, A.A., Kyllonen, P., Zapata-Rivera, J.D.: A tough nut to crack: measuring collaborative problem solving. In: Handbook of Research on Technology Tools for Real-World Skill Development, pp. 344–359. IGI Global (2016)Google Scholar
- 6.Mislevy, R.J., Riconscente, M.M.: Evidence-centered assessment design: layers, concepts, and terminology. In: Downing, S., Haladyna, T. (eds.) Handbook of Test Development, pp. 61–90. Erlbaum, Mahwah (2006)Google Scholar
- 9.Saldaña, J.: The Coding Manual for Qualitative Researchers. Sage, London (2015)Google Scholar
- 11.Camara, W., O’Connor, R., Mattern, K., Hanson, M.A.: Beyond Academics: A Holistic Framework for Enhancing Education and Workplace Success. ACT Research Report Series 2015 (4). ACT, Inc. (2015)Google Scholar