Abstract
In this chapter we discuss student dispositions toward an emerging domain called “collaborative problem solving” (CPS), recently assessed by the Programme for International Student Assessment (PISA) in the field trial and in the main study. Here, “dispositions” refers to the attitudes to and experiences of collaboration seen emerging in the international PISA survey data in 15-year-olds. For the field trial’s noncognitive measures, nine CPS-related constructs were developed for the student and teacher questionnaires. Information was collected on the types of collaborative activities and the support that was available, in and out of the classroom, as well as on student experiences of and attitudes to collaboration. We provide a description of the constructs and demonstrate how their development was related to present and past PISA cognitive measures in problem solving and collaborative problem solving.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Adejumo, G., Duimering, R. P., & Zhong, Z. (2008). A balance theory approach to group problem solving. Social Networks, 30(1), 83–99.
Avouris, N., Dimitracopoulou, A., & Komis, V. (2003). On evaluation of collaborative problem solving: Methodological issues of interaction analysis. Journal of Computers in Human Behaviour, 19, 147–167.
Baker, M. J., & Lund, K. (1997). Promoting reflective interactions in a CSCL environment. Journal of Computer Assisted Learning, 13, 175–193.
Bell, S. T. (2007). Deep-level composition variables as predictors of team performance: A meta-analysis. Journal of Applied Psychology, 92(3), 595–615.
Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., & Rumble, M. (2010). Assessment and teaching of 21st century skills: Defining 21st century skills. Learning and Technology World Forum 2010. White Paper released at the Learning and Technology World Forum 2010, London.
Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012). Defining twenty-first century skills. In P. Griffin, B. McGaw, & E. Care (Eds.), Assessment and teaching of 21st century skills (Vol. 1). Dordrecht: Springer.
Cakır, M. P., Zemel, A., & Stahl, G. (2009). The joint organization of interaction within a multimodal CSCL medium. International Journal of Computer-Supported Collaborative Learning, 4(2), 115–149.
Cooke, N. J., Kiekel, P. A., Salas, E., Stout, R., Bowers, C., & Cannon- Bowers, J. (2003). Measuring team knowledge: A window to the cognitive underpinnings of team performance. Group Dynamics: Theory, Research and Practice, 7, 179–219.
Dillenbourg, P. (1999). What do you mean by collaborative learning? In P. Dillenbourg (Ed.), Collaborative-learning: Cognitive and computational approaches (pp. 1–19). Oxford: Elsevier.
Dillenbourg, P., Baker, M., Blaye, A., & O’Malley, C. (1996). The evolution of research on collaborative learning. In E. Spada & P. Reiman (Eds.), Learning in humans and machine: Towards an interdisciplinary learning science (pp. 189–211). Oxford: Elsevier.
Fisher, R., & Katz, J. E. (2000). Social-desirability bias and the validity of self-reported values. Psychology & Marketing, 17, 105–120.
Foltz, P. W., & Martin, M. J. (2008). Automated communication analysis of teams. In E. Salas, G. F. Goodwin, & S. Burke (Eds.), Team effectiveness in complex organisations and systems: Cross-disciplinary perspectives and approaches. New York: Routledge.
Furnham, A. (1986). Response bias, social desirability and dissimulation. Personality and Individual Differences, 7(3), 385–400.
Graesser, A. C., Jeon, M., & Dufty, D. (2008). Agent technologies designed to facilitate interactive knowledge construction. Discourse Processes, 45, 298–322.
Griffin, P., McGaw, B., & Care, E. (Eds.). (2012). Assessment and teaching of 21st century skills. Dordrecht: Springer.
Harris, T. C., & Barnes-Farrell, J. L. (1997). Components of teamwork: Impact on evaluations of contributions to work team effectiveness. Journal of Applied Social Psychology, 27(9), 1694–1715.
He, Jia, & Vijver, Fons van de (2016). Correcting for Scale Usage Differences among Latin American Countries, Portugal, and Spain in PISA (Corrigiendo las diferencias de uso de escala entre países de América Latina, Portugal y España en PISA). Revista ELectrónica de Investigación y EValuación Educativa, 22(1).
Jordan, P. J., & Troth, A. C. (2004). Managing emotions during team problem solving: Emotional intelligence and conflict resolution. Human Performance, 17(2), 195–208.
Jude, N. (2016). The assessment of learning contexts in PISA. In S. Kuger, E. Klieme, N. Jude, & D. Kaplan (Eds.), Assessing contexts of learning: An international perspective. Dordrecht: Springer.
King, M. F., & Bruner, G. C. (2000). Social desirability bias: A neglected aspect of validity testing. Psychology and Marketing, 17(2), 79–103.
Klein, C., DeRouin, R. E., & Salas, E. (2006). Uncovering workplace interpersonal skills: A review, framework, and research agenda. In G. P. Hodgkinson & J. K. Ford (Eds.), International review of industrial and organizational psychology (Vol. 21, pp. 80–126). New York: WIley & Sons, Ltd.
Kuger, S., Jude, N., Klieme, E., & Kaplan, D. (2016). An introduction to the PISA 2015 field trial: Study design and analyses procedures. In S. Kuger, E. Klieme, N. Jude, & D. Kaplan (Eds.), Assessing contexts of learning: An international perspective. Dordrecht: Springer.
LePine, J. A., & Van Dyne, L. (2001). Voice and cooperative behavior as contrasting forms of contextual performance: Evidence of differential relationships with big five personality characteristics and cognitive ability. Journal of Applied Psychology, 86, 326–336.
Liberman, R. P., King, L. W., DeRisi, W. J., & McCann, M. (1975). Personal effectiveness: Guiding people to assert themselves and improve their social skills. Champaign: Research Press.
Loughry, M., Moore, D., & Ohland, M. (2007). Development of a theory-based assessment of team member effectiveness. Educational and Psychological Measurement, 67(3), 505–524.
McDaniel, M. A., Morgeson, F. P., Finnegan, E. B., Campion, M. A., & Braverman, E. P. (2001). Use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86, 730–740.
McGivney, S., Smeaton, A. F., & Lee, H. (2008). The effect of personality on collaborative task performance and interaction. In E. Bertino & J. B. D. Joshe (Eds.), Collaborative computing: Networking, applications and worksharing. New York: Springer.
O’Neill, T. A., & Kline, T. J. B. (2008). Personality as a predictor of teamwork: A business simulator study. North American Journal of Psychology, 10, 65–78.
O’Neil, H. F., Chung, G., & Brown, R. (1997). Use of networked simulations as a context to measure team competencies. In H. F. O’Neil (Ed.), Workforce readiness: Competencies and assessment (pp. 411–452). Mahwah: Lawrence Erlbaum Associates.
OECD. (2013). PISA 2015: Draft collaborative problem solving framework. http://www.oecd.org/pisa/pisaproducts/Draft PISA 2015 Collaborative Problem Solving Framework.pdf.
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903.
Rummel, N., & Spada, H. (2005). Learning to collaborate: An instructional approach to promoting collaborative problem solving in computer-mediated settings. Journal of the Learning Sciences, 14(2), 201–241. doi:10.1207/s15327809jls1402_2.
Stevens, M. J., & Campion, M. A. (1994). The knowledge, skills and ability requirements for teamwork: Implications for human resources management. Journal of Management, 20(2), 502–528.
Valentine, M. A., Nebhard, I. M., & Edmonson, A. C. (2015). Measuring teamwork in health care settings: A review of survey instruments. Medical Care, 53(4), 16–30.
Vogel, F., Wecker, C., Kollar, I., & Fischer, F. (2016). Socio-cognitive scaffolding with computer-supported collaboration scripts: A meta-analysis. Educational Psychology Review. doi:10.1007/s10648-016-9361-7.
Wang, L., MacCann, C., Zhuang, X., Lydia Liu, O., & Roberts, D. R. (2009). Assessing teamwork and collaboration in high school students: A multimethod approach. Canadian Journal of School Psychology, 24(2), 108–124.
Wilson, M., & Scalise, K. (2012a). Measuring collaborative digital literacy. Paper presented at the Invitational Research Symposium on Technology Enhanced Assessments, Session on Measuring Problem Solving, Creativity, Communication, and Other Cross-Curricular 21st Century Skills within the Common Core State Standards, Washington, DC.
Wilson, M., & Scalise, K. (2012b). Measuring collaborative digital literacy. Paper presented at the Invitational Research Symposium on Technology Enhanced Assessments, Washington, DC. http://www.k12center.org/events/research_meetings/tea.html.
Wilson, M., Scalise, K., & Gochyyev, P. (2015). Rethinking ICT literacy: From computer skills to social network settings. Thinking Skills and Creativity, 18, 65–80.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Scalise, K., Mustafic, M., Greiff, S. (2016). Dispositions for Collaborative Problem Solving. In: Kuger, S., Klieme, E., Jude, N., Kaplan, D. (eds) Assessing Contexts of Learning. Methodology of Educational Measurement and Assessment. Springer, Cham. https://doi.org/10.1007/978-3-319-45357-6_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-45357-6_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-45356-9
Online ISBN: 978-3-319-45357-6
eBook Packages: EducationEducation (R0)