Advertisement

An Integrated Approach for Analysing and Assessing the Performance of Virtual Learning Groups

  • Thanasis Daradoumis
  • Alejandra Martínez-Monés
  • Fatos Xhafa
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3198)

Abstract

Collaborative distance learning involves a variety of elements and factors that have to be considered and measured in order to analyse and assess group and individual performance more effectively and objectively. This paper presents an approach that integrates qualitative, social network analysis (SNA) and quantitative techniques for evaluating online collaborative learning interactions. Integration of various different data sources, tools and techniques provides a more complete and robust framework for group modelling and guarantees a more efficient evaluation of group effectiveness and individual competence. Our research relies on the analysis of a real, long-term, complex collaborative experience, which is initially evaluated in terms of principled criteria and a basic qualitative process. At the end of the experience, the coded student interactions are further analysed through the SNA technique to assess participatory aspects, identify the most effective groups and the most prominent actors. Finally, the approach is contrasted and completed through a statistical technique which sheds more light on the results obtained that far. The proposal draws a well-founded line toward the development of a principled framework for the monitoring and analysis of group interaction and group scaffolding which can be considered a major issue towards the actual application of the CSCL proposals to real classrooms.

Keywords

Collaborative Learning Social Network Analysis Interaction Behaviour Processing Skill Task Realisation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Barros, M., Verdejo, M.: Analysing student interaction processes in order to improve collaboration. The DEGREE approach. Int. J. of Art. Int. in Education. 11, 221–241 (2000)Google Scholar
  2. 2.
    Bentley, Appelt, R., Busbach, W., Hinrichs, U., Kerr, E., Sikkel, D., Trevor, S., Woetzel, G.J.: Basic Support for Cooperative Work on the World Wide Web. Int. J. of Human- Computer Studies 46(6), 827–846 (1997)CrossRefGoogle Scholar
  3. 3.
    Cho, H., Stefanone, M., Gay, G.: Social information sharing in a CSCL community. In: Stahl, G. (ed.) Computer Support for Collaborative Learning: Foundations for a CSCL community, Erlbaum, NJ, pp. 43–50 (2002)Google Scholar
  4. 4.
    Collazos, C., Guerrero, L., Pino, J., Ochoa, S.: Evaluating Collaborative Learning Processes. In: Haake, J.M., Pino, J.A. (eds.) Proc. of the 8th Int. Workshop on Groupware (CRIWG 2003), pp. 203–221. Springer, Berlin (2002)Google Scholar
  5. 5.
    Daradoumis, T., Guitert, M., Giménez, F., Marquès, J.M., Lloret, T.: Supporting the Composition of Effective Virtual Groups for Collaborative Learning. In: Proc. of the Int. Conf. on Computers in Education (ICCE 2002), pp. 332–336. IEEE Comp. Soc. Press, Los Alamitos (2002)CrossRefGoogle Scholar
  6. 6.
    Daradoumis, T., Xhafa, F., Marquès, J.M.: Evaluating Collaborative Learning Practices in a Virtual Groupware Environment. In: Proc. of the Int. Conf. on Computers and Advanced Technology in Education (CATE 2003), pp. 438–443. ACTA Press (2003)Google Scholar
  7. 7.
    Daradoumis, T., Xhafa, F., Marquès, J.M.: Exploring Interaction Behaviour and Performance of Online Collaborative Learning Teams. In: Proc. of the 9th Int. Workshop on Groupware (CRIWG 2003), pp. 203–221. Springer, Berlin (2003)Google Scholar
  8. 8.
    Dillenbourg, P. (ed.): Collaborative Learning. Cognitive and Computational Approaches, pp. 1–19. Elsevier Science Ltd, Amsterdam (1999)Google Scholar
  9. 9.
    Frechtling, J., Sharp, L. (eds.): User-Friendly Handbook for Mixed Evaluations. Directorate for Education and Human Resources Division of Research, Evaluation and Communication, NSF (1997)Google Scholar
  10. 10.
    MacDonald, J.: Assessing online collaborative learning: process and product. Int. J. of Computers & Education 40, 377–391 (2003)CrossRefGoogle Scholar
  11. 11.
    McGrath, J.E.: Time, Interaction and Performance (TIP). A Theory of Groups. Small Group Research 22, 147–174 (1991)CrossRefGoogle Scholar
  12. 12.
    Martínez, A., Dimitriadis, Y., Rubia, B., Gómez, E., de la Fuente, P.: Combining qualitative and social network analysis for the study of social aspects of collaborative learning. Computers and Education 41(4), 353–368 (2003)CrossRefGoogle Scholar
  13. 13.
    Mühlenbrock, M.: Action-based collaboration analysis for group learning. IOS Press, Amsterdam (2001)MATHGoogle Scholar
  14. 14.
    Sfard, A.: On two metaphors for learning and the dangers of choosing just one. Educational Researcher 27(2), 4–13 (1998)Google Scholar
  15. 15.
    Soller, A.: Supporting Social Interaction in an Intelligent Collaborative Learning System. Int. J. of Artificial Intelligence in Education 12, 40–62 (2001)Google Scholar
  16. 16.
    Wasserman, S., Faust, K.: Social Network Analysis: Methods and Applications. Cambridge Univ. Press, Cambridge (1994)Google Scholar
  17. 17.
    Webb, N.: Testing a theoretical model of student interaction and learning in small groups. In: Hertz-Lazarowitz, R., Miller, N. (eds.) Interaction in Cooperative Groups: The Theoretical Anatomy of Group Learning, pp. 102–119. Cambridge Univ. Press, NY (1992)Google Scholar
  18. 18.
    Wortham, D.W.: Nodal and Matrix Analyses of Communication Patterns in Small Groups. In: Proceedings of the Computer Support for Collaborative Learning (CSCL) 1999 Conference, Palo Alto, CA, pp. 681–686 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Thanasis Daradoumis
    • 1
  • Alejandra Martínez-Monés
    • 2
  • Fatos Xhafa
    • 1
  1. 1.Department of Information SciencesOpen University of CataloniaBarcelonaSpain
  2. 2.Department of Computer Science, ETIT, Campus Miguel DelibesUniversity of ValladolidValladolidSpain

Personalised recommendations