Skip to main content

A Systemic Framework for Evaluating Computer-Supported Collaborative Learning—Mathematical Problem-solving (CSCL-MPS) Initiatives: Insights from a Colombian Case

Systemic Practice and Action Research volume 27, pages 265–285 (2014)Cite this article

Abstract

In general terms, computer-supported collaborative learning (CSCL) is a new educational paradigm that includes the use of technology to support learning activities. These CSCL environments can be used in a number of subjects (e.g. science, mathematics, language). As CSCL not only involves the implementation of technology or the design of online educational content, researchers have proposed inclusive models which highlight different dimensions of CSCL as a process. These models can then guide CSCL educators and designers improve the design, the experience, the management, and the evaluation of CSCL. However, the use of these models still needs to enable different CSCL stakeholders reflect on the values, purposes and impacts of their efforts. This paper presents a systemic framework that facilitates exploration of the inter-connections between the different aspects of CSCL, and enables a preliminary evaluation of its impacts in a particular context of application. The framework is then used to evaluate a Colombian CSCL project in the area of mathematical problem-solving (MPS). We report on the achievements of this project and in future possibilities to improve CSCL efforts in Colombia and elsewhere. These suggestions can help educators and other CSCL stakeholders to be sensitive and to respond to particular contextual conditions which can contribute to the success of CSCL initiatives.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Notes

  1. Five schools of a low socio-economic level and 2 of a high socio-economic level: In Colombia the population is traditionally described to socio-economic levels where level 1 is the lowest and level 6 is the highest.

  2. This topic was chosen basically for two reasons: A. At the beginning of the project the idea was to consider different topics to apply MPS however, this idea change after the third problem (November 2006) because of the low level of participation and low level of mathematics discussions regarding MPS skills students’ level. Hence, there was a need to limit the scope of the problems in one topic. B. This topic is included in the mathematics curriculum for students of 6th scholar year so, students of 10th and 11th years can find it familiar and easy to follow. This change was made according to discussions in one of the monthly meetings.

References

  • Ackoff R (1978) The art of problem solving: accompanied by Ackoff’s fables. Wiley, New York

    Google Scholar 

  • Ackoff R (1981) Creating the corporate future: plan or to be planned for. Wiley, New York

    Google Scholar 

  • Alexander PM (2006) Virtual teamwork in very large undergraduate classes. Comput Educ 47(2):127–147

    Article  Google Scholar 

  • Arbaugh JB, Godfrey MR, Johnson M, Pollack BL, Niendorf B, Wresch W (2009) Research in online and blended learning in the business disciplines: key findings and possible future directions. Internet High Educ 12:71–87

    Article  Google Scholar 

  • Artzt F, Armour-Thomas E, Curcio FR (2008) Becoming a reflective mathematics teacher: a guide for observations and self-assessment. Lawrence Erlbaum Associates, New York

    Google Scholar 

  • Banathy B (1992) A systems view of education: concepts and principles for effective practice. Educational Technology, Englewood Cliffs

    Google Scholar 

  • Barros R, Pinzón L, Zarama R (2008). Using collaborative work in virtual networks to improve mathematical problem solving skills: an exploratory Study. XXVIII international sunbelt social network conference, 22–27 Jan 2008, St. Petersburg, FL

  • Beer S (1985) Diagnosing the system for organizations. Wiley, Chichester

    Google Scholar 

  • Bielaczyc K (2001) Designing social infrastructure: the challenge of building computer-supported learning communities. In: Dillenbourg P, Eurelings A, Hakkarainen K (eds) European perspectives on computer-supported collaborative learning. The proceedings of the first European conference on computer-supported collaborative learning. University of Maastricht, Germany, pp 106–114

    Google Scholar 

  • Chang C-K, Chen G-D, Wang C-Y (2011) Statistical model for predicting roles and effects in learning community. Behav Inf Technol 30(1):101–111

    Article  Google Scholar 

  • Charles R, Lester F, O’Daffer P (1987) How to evaluate progress in problem solving. National Council of Teachers of Mathematics, Reston

    Google Scholar 

  • Checkland P (1981) Systems thinking, systems practice. Wiley, New York

    Google Scholar 

  • Cho H, Gay G, Davidson B, Ingraffea A (2007) Social networks, communication styles, and learning performance in a CSCL community. Comput Educ 49:309–329

    Article  Google Scholar 

  • Churchman CW (1971) The design of inquiring systems. Basic concepts of systems and organizations, basic books, New York

    Google Scholar 

  • Daradoumis T, Martínez-Monés A, Xhafa F (2006) A layered framework for evaluating on-line collaborative learning interactions. Int J Hum-Comput Stud 64:622–635

    Article  Google Scholar 

  • De Laat M, Lally V (2005) Investigating group structure in CSCL: some new approaches. Inf Syst Front 7(1):13–25

    Article  Google Scholar 

  • Dillenbourg P (1999) What do you mean by collaborative learning? In: Dillenbourg P (ed) Collaborative-learning: cognitive and computational approaches. Elsevier, Oxford, pp 1–19

    Google Scholar 

  • Dillenbourg P, Järvelä S, Fischer F (2009) The evolution of research on computer-supported collaborative learning: from design to orchestration. In: Balacheff N, Ludvigsen S, De Jong T, Lazonder A, Barnes S (eds) Technology-enhanced learning. Springer, Berlin, pp 3–19

    Chapter  Google Scholar 

  • Dossey JA, McCrone SA, O’Sullivan C (2006) Problem solving in the PISA and TIMSS 2003 assessments (NCES 2007-049). US Department of Education. National Center for Education Statistics, Washington, DC. http://nces.ed.gov/pubsearch. Accessed 12 Jan 2011

  • Hara N, Bonk C, Angeli C (2000) Content analysis of online discussion in an applied educational psychology course. Instr Sci 28:115–152

    Article  Google Scholar 

  • Helme S, Clarke D (2001) Cognitive engagement in the mathematics classroom. In: Clarke D (ed) Perspectives on practice and meaning in mathematics and science classrooms. Kluwer Academic, Dordrecht

    Google Scholar 

  • Hurme T, Järvelä S (2005) Student’s activity in computer-supported collaborative problem solving in mathematics. Int J Comput Math Learn 10:49–73

    Article  Google Scholar 

  • ICFES (2009) Resultados de Colombia en TIMSS 2007. Resumen Ejecutivo. Ministerio de Educación Nacional, Colombia

    Google Scholar 

  • Illeris K (2003) Towards a contemporary and comprehensive theory of learning. Int J Lifelong Educ 22:396–406

    Article  Google Scholar 

  • Jackson MC (2003) Creative holism: systems thinking for managers. Wiley, Chichester

    Google Scholar 

  • Jarvela S, Jarvenoja H, Veermans M (2008) Understanding the dynamics of motivation in socially shared learning. Int J Educ Res 47(1):122–135

    Article  Google Scholar 

  • Kreijns K, Kirschner P, Jochems W, Van Buuren H (2004) Determining sociability, social space, and social presence in (a)synchronous collaborative groups. Cyberpsychol Behav 7(2):155–172

    Article  Google Scholar 

  • Laurillard D (2009) The pedagogical challenges to collaborative technologies. Comput-Support Collab Learn 4:5–20

    Google Scholar 

  • Lehtinen E (2003) Computer-supported collaborative learning: an approach to powerful learning environments. In: De Corte E, Verschaffel L, Entwistle N, Van Merriëboer J (eds) Unravelling basic components and dimensions of powerful learning environments. Elsevier, Oxford

    Google Scholar 

  • Levy P (2004) A methodological framework for practice-based research in networked learning. In: Goodyear P, Banks S, Hodgson W, McConnell D (eds) Advances in research in networked learning. computer-supported collaborative learning series (4). Kluwer, London, pp 43–65

    Google Scholar 

  • Lipponen L (2002) Exploring foundations for computer-supported collaborative learning. In: Proceedings of the conference on computer support for collaborative learning, foundations for a CSCL community, Boulder, 7–11 Jan 2002

  • Lund K (2011) Analytical frameworks for group interactions in CSCL systems. In: Puntambekar S, Erkens G, Hmelo-Silver CE (eds) Analyzing interactions in CSCL: methods, approaches and issues. Springer, New York

    Google Scholar 

  • Markauskaite, L. (2006). Towards an integrated analytical framework of information and communications technology literacy: from intended to implemented and achieved dimensions. Inf Res 11(3):paper 252. http://InformationR.net/ir/11-3/paper252.html. Accessed 10 Jan 2010

  • Maturana H, Varela FJ (1990) El árbol del conocimiento: las bases biológicas del conocimiento humano. Editorial Debate, Madrid

    Google Scholar 

  • Midgley G (2000) Systemic intervention: philosophy, methodology and practice. Kluwer Academic/Plenum, New York

    Book  Google Scholar 

  • Ministerio de Educación Nacional—MEN (2010) Revolución Educativa: Acciones y Lecciones 2002–2010. Ministerio de Educación Nacional, República de Colombia

    Google Scholar 

  • Ministry of Education (2009) The Singapore model method for learning mathematics. Curriculum planning and development division. EPB Pan Pacific, Singapore

    Google Scholar 

  • Newman BM, Newman PR (2007) Theories of human development. Lawrence Erlbaum Associates, New Jersey

    Google Scholar 

  • OECD. (2010). PISA 2009 Results: what students know and can do—student performance in reading, mathematics and science (volume I). http://dx.doi.org/10.1787/9789264091450-en. Accessed 11 Jan 2011

  • Salkind NJ (2004) An introduction to theories of human development. Sage, Thousand Oaks

    Book  Google Scholar 

  • Sarmiento J, Shumar W (2010) Boundaries and roles: positioning and social location in the virtual math teams (VMT) online community. Comput Hum Behav 26:524–532

    Article  Google Scholar 

  • Schoenfeld AH (1992) Learning to think mathematically: problem solving, metacognition, and sense-making in mathematics. In: Grouws D (ed) Handbook of research on mathematics teaching and learning. MacMillan, New York, pp 334–370

    Google Scholar 

  • Sfard A (2003) Balancing the unbalanceable: the NCTM standards in light of theories of learning mathematics. In: Kilpatrick J, Martin WG, Schifter D (eds) A research companion to principles and standards for school mathematics. National Council of Teachers of Mathematics, Reston

    Google Scholar 

  • Sharda R, Romano N, Lucca J, Weiser M, Scheets G, Chung J-M, Sleezer C (2004) Foundation for the study of computer-supported collaborative learning requiring immersive presence. J Manag Inf Syst 20(4):31–63

    Google Scholar 

  • Sheremetov L, Guzmán A (2002) EVA: an interactive Web-based collaborative learning environment. Comput Educ 39:161–182

    Article  Google Scholar 

  • Stahl G (2010) Guiding group cognition in CSCL. Comput-Support Collab Learn 5:255–258

    Google Scholar 

  • Stahl G, Koschmann T, Suthers D (2006) Computer-supported collaborative learning: an historical perspective. In: Sawyer RK (ed) Cambridge handbook of the learning sciences. Cambridge University Press, Cambridge, pp 409–426

    Google Scholar 

  • Strijbos JW (2011) Assessment of (computer-supported) collaborative learning. IEEE Trans Learn Technol 4(1):59–73

    Article  Google Scholar 

  • Strijbos J, De Laat M (2010) Developing the role concept for computer-supported collaborative learning: an explorative synthesis. Comput Hum Behav 26:495–505

    Article  Google Scholar 

  • Strijbos J, Fischer F (2007) Methodological challenges for collaborative learning research. Learn Instr 17:389–393

    Article  Google Scholar 

  • Strijbos JW, Kirschner PA, Martens RL (2004a) What we know about CSCL… and what we do not (but we need to) know about CSCL. In: Strijbos JW, Kirschner PA, Martens RL (eds) What we know about CSCL. Kluwer Academic, The US

    Chapter  Google Scholar 

  • Strijbos JW, Martens R, Jochems W (2004b) Designing for interaction: six steps to designing computer-supported group-based learning. Comput Educ 42:403–424

    Article  Google Scholar 

  • Strijbos JW, Martens R, Prins F, Jochems W (2006) Content analysis: what are they talking about? Comput Educ 46:29–48

    Article  Google Scholar 

  • Suthers DD (2006) Technology affordances for inter-subjective meaning making: a research agenda for CSCL. Int J Compu-Support Collab Learn 1(3):315–337

    Article  Google Scholar 

  • Swan M (2006) Collaborative learning in mathematics: a challenge to our beliefs and practices. National Research and Development Centre for Adult Literacy and Numeracy (NRDC), London

    Google Scholar 

  • Ulrich W (1983) Critical heuristics of social planning: a new approach to practical philosophy. Haupt, Berne

    Google Scholar 

  • von Bertalanffy L (1968) General system theory: foundations, development, applications. George Braziller, New York

    Google Scholar 

  • Wasserman S, Faust K (1994) Social network analysis: methods and applications. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Yuan Y, Gay G (2006) Homophily of network ties and bonding and bridging social capital in computer-mediated distributed teams. J Comput-Mediat Commun 11(4):1062–1084

    Article  Google Scholar 

Download references

Acknowledgments

We would like to thank both Universidad de los Andes and Royal Holloway, University of London for the support offered in undertaking the work reported in this paper. We also would like to thank all the colleagues whom have been working with us in this research project and all the teachers and students involved in it.

Author information

Authors and Affiliations

  1. Industrial Engineering Department, Universidad de los Andes, Carrera 1 Este #19A-40, Bogotá, Colombia

    Ricardo Abad Barros-Castro & Luis Arturo Pinzón-Salcedo

  2. School of Management, Royal Holloway University of London, Egham, Surrey, TW20 0EX, UK

    José Rodrigo Córdoba-Pachón

Authors
  1. Ricardo Abad Barros-Castro
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. José Rodrigo Córdoba-Pachón
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luis Arturo Pinzón-Salcedo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ricardo Abad Barros-Castro.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Barros-Castro, R.A., Córdoba-Pachón, J.R. & Pinzón-Salcedo, L.A. A Systemic Framework for Evaluating Computer-Supported Collaborative Learning—Mathematical Problem-solving (CSCL-MPS) Initiatives: Insights from a Colombian Case. Syst Pract Action Res 27, 265–285 (2014). https://doi.org/10.1007/s11213-013-9279-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11213-013-9279-7

Keywords

  • CSCL
  • Systems-thinking
  • Evaluation
  • Mathematical problem-solving
  • Inter-connection
  • Reflection
  • Colombia