Abstract
The wider acceptance and usage of instant messaging (chat) represents one of the consequences of undertaking Computer-Supported Collaborative Learning (CSCL) practices in formal education settings. However, the difficulty of analyzing these textual artifacts of learners in order to offer them feedback represents a serious problem in further extending the usage of chat conversations. PolyCAFe is a system that was designed to support the tutors and to provide automatic feedback for the learners engaged in collaborative chat conversations and discussion forums. The architecture of the system is presented by focusing on two key components: the assessment of the utterances and of the collaborative discourse. PolyCAFe’s effectiveness has been proved in a validation experiment with students and tutors from a University course. The main findings from this trial, together with the conclusions of domain experts verifying the accuracy of the assessment provided by PolyCAFe, are also analyzed and commented in detail.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Stahl, G.: Group cognition: Computer support for building collaborative knowledge. Cambridge. MIT Press, Cambridge (2006)
Adams, P.H., Martell, C.H.: Topic detection and extraction in chat. In: Proceedings of the 2008 IEEE International Conference on Semantic Computing, pp. 581–588 (2008)
Dong, A.: Concept formation as knowledge accumulation: A computational linguistics study. Artif. Intell. Eng. Des. Anal. Manuf. 20(1), 35–53 (2006)
Joshi, M., Rosé, C.P.: Using transactivity in conversation summarization in educational dialog. In: Proceedings of the SLaTE Workshop on Speech and Language Technology in Education (2007)
Rose, C.P., Wang, Y.C., Cui, Y., Arguello, J., Stegmann, K., Weinberger, A., Fischer, F.: Analyzing Collaborative Learning Processes Automatically: Exploiting the Advances of Computational Linguistics in Computer-Supported Collaborative Learning. International Journal of Computer Supported Collaborative Learning (2007)
Dascalu, M., Trausan-Matu, S., Dessus, P.: Utterances Assessment in Chat Conversations. Research in Computing Science, Special Issue on Natural Language Processing and its Applications 46, 323–334 (2010)
Rebedea, T., Dascalu, M., Trausan-Matu, S., Banica, D., Gartner, A., Chiru, C., Mihaila, D.: Overview and preliminary results of using polyCAFe for collaboration analysis and feedback generation. In: Wolpers, M., Kirschner, P.A., Scheffel, M., Lindstaedt, S., Dimitrova, V. (eds.) EC-TEL 2010. LNCS, vol. 6383, pp. 420–425. Springer, Heidelberg (2010)
Trausan-Matu, S., Stahl, G., Sarmiento, J.: Supporting Polyphonic Collaborative Learning. E-service Journal 6(1), 58–74 (2007)
Trausan-Matu, S., Rebedea, T.: A Polyphonic Model and System for Inter-animation Analysis in Chat Conversations with Multiple Participants. In: Gelbukh, A. (ed.) CICLing 2010. LNCS, vol. 6008, pp. 354–363. Springer, Heidelberg (2010)
Bakhtin, M.: Problems of Dostoevsky’s poetics (C. Emerson, Trans.). University of Minnesota Press, Minneapolis (1984)
Kumar, R., Ai, H., Beuth, J.L., Rosé, C.P.: Socially Capable Conversational Tutors Can Be Effective in Collaborative Learning Situations. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6094, pp. 156–164. Springer, Heidelberg (2010)
Jurafsky, D., Martin, J.H.: Speech and Language Processing, 2nd edn. An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition. Pearson Prentice Hall, London (2009)
Hobbs, J.: On the coherence and structure of discourse. Technical Report CSLI-85-37, Center for the Study of Language and Information, Stanford University (1985)
Grosz, B.J., Joshi, A.K., Weinstein, S.: Centering: A framework for modeling the local coherence of discourse. Computational Linguistics 21(2), 203–225 (1995)
Mann, W.C., Thompson, S.A.: Rhetorical structure theory: A theory of text organization. Tech. rep. RS-87-190, Information Sciences Institute (1987)
Trausan-Matu, S., Rebedea, T.: Polyphonic Inter-Animation of Voices in VMT. In: Stahl, G. (ed.) Studying Virtual Math Teams, pp. 451–473. Springer US, Boston (2009)
Schmidt, A.P., Stone, T.K.M.: Detection of topic change in IRC chat logs, http://www.trevorstone.org/school/ircsegmentation.pdf
Kontostathis, A., Edwards, L., Bayzick, J., McGhee, I., Leatherman, A., Moore, K.: Comparison of Rule-based to Human Analysis of Chat Logs. In: 1st International Workshop on Mining Social Media Programme, Conferencia de la Asociación Española para la Inteligencia Artificial (2009)
Dascalu, M., Rebedea, T., Trausan-Matu, S.: A Deep Insight in Chat Analysis: Collaboration, Evolution and Evaluation, Summarization and Search. In: Dicheva, D., Dochev, D. (eds.) AIMSA 2010. LNCS (LNAI), vol. 6304, pp. 191–200. Springer, Heidelberg (2010)
Wresch, W.: The Imminence of Grading Essays by Computer–25 Years Later. Computers and Composition 10(2), 45–58 (1993), http://computersandcomposition.osu.edu/archives/v10/10_2_html/10_2_5_Wresch.html
Brin, S., Page, L.: The Anatomy of a Large-Scale Hypertextual Web Search Engine. In: Seventh International World-Wide Web Conference, Brisbane, April 14-18 (1998)
Scardamalia, M.: Collective cognitive responsibility for the advancement of knowledge. In: Smith, B. (ed.) Liberal Education in Knowledge Society, pp. 67–98. Open Court, Chicago (2002)
Dascalu, M., Rebedea, T., Trausan-Matu, S., Armitt, G.: PolyCAFe: Collaboration and Utterance Assessment for Online CSCL Conversations. Accepted at the 9th International Conference on CSCL, CSCL 2011 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rebedea, T., Dascalu, M., Trausan-Matu, S., Armitt, G., Chiru, C. (2011). Automatic Assessment of Collaborative Chat Conversations with PolyCAFe. In: Kloos, C.D., Gillet, D., Crespo García, R.M., Wild, F., Wolpers, M. (eds) Towards Ubiquitous Learning. EC-TEL 2011. Lecture Notes in Computer Science, vol 6964. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23985-4_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-23985-4_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23984-7
Online ISBN: 978-3-642-23985-4
eBook Packages: Computer ScienceComputer Science (R0)