Abstract
Affective Computing is one of the most active research topics in education. Increased interest in emotion recognition through text channels makes sentiment analysis (i.e., the Natural Language Processing task of determining the valence in texts) a state-of-the-practice tool. Considering the domain-dependent nature of sentiment analysis as well as the heterogeneity of the educational domain, development of robust sentiment classifiers requires an in-depth understanding of the effect of the teaching-learning context on model performance. This work investigates machine learning-based sentiment classification on datasets comprised of student posts in forums, pertaining to two different academic courses. Different dataset configurations were tested, aiming to compare performance: i) between single-course and multi-course classifiers, ii) between in-course and cross-course classification. A sentiment classifier was built for each course, exhibiting a fair performance. However, classification performance dramatically decreased, when the two models were transferred between courses. Additionally, classifiers trained on a mixture of courses underperformed single-course classifiers. Findings suggested that sentiment analysis is a course-dependent task and, as a rule of thumb, less but course-specific information results in more effective models than more but non-specialized information.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Picard, R.W.: Affective computing. MIT media laboratory perceptual computing section technical report No. 321. Cambridge, MA 2139 (1995)
Pekrun, R., Goetz, T., Titz, W., Perry, R.P.: Academic emotions in students’ self-regulated learning and achievement: a program of qualitative and quantitative research. Educ. Psychol. 37(2), 91–105 (2002)
Blanchette, I., Richards, A.: The influence of affect on higher level cognition: a review of research on interpretation, judgement, decision making and reasoning. Cogn. Emot. 24(4), 561–595 (2010). https://doi.org/10.1080/02699930903132496
Lepper, M.R., Chabay, R.W.: Socializing the intelligent tutor: bringing empathy to computer tutors. In: Learning Issues for Intelligent Tutoring Systems, pp. 242–257. Springer, New York, NY (1988)
Yadegaridehkordi, E., Noor, N.F.B.M., Ayub, M.N.B., Affal, H.B., Hussin, N.B.: Affective computing in education: a systematic review and future research. Comput. Educ. 142, 103649 (2019)
Luneski, A., Konstantinidis, E., Bamidis, P.D.: Affective medicine. A review of affective computing efforts in medical informatics. Methods Inf. Med. 49(3), 207–218 (2010)
Bamidis, P.D., Papadelis, C., Kourtidou-Papadeli, C., Pappas, C., Vivas, B.A.: Affective computing in the era of contemporary neurophysiology and health informatics. Interact. Comput. 16(4), 715–721 (2004)
Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012). https://doi.org/10.2200/S00416ED1V01Y201204HLT016
Mohammad, S.M.: Sentiment analysis: detecting valence, emotions, and other affectual states from text. In: Meiselman, H.L. (ed.) Emotion Measurement, pp. 201–237. Woodhead Publishing-Elsevier, Sawston, Cambridge (2016)
Read, J.: Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In: Proceedings of the ACL Student Research Workshop, pp. 43–48 (2005)
Wen, M., Yang, D., Rose, C.: Sentiment analysis in MOOC discussion forums: what does it tell us?. In: Stamper, J., Pardos, Z., Mavrikis, M., McLaren, B.M. (eds.) Proceedings of 7th International Conference on Educational Data Mining, pp. 130–137, London (2014)
Dolianiti, F.S., Iakovakis, D., Dias, S.B., Hadjileontiadou, S., Diniz, J.A., Hadjileontiadis, L.: Sentiment analysis techniques and applications in education: a survey. In: Tsitouridou, M., Diniz, J.A., Mikropoulos, T.A. (eds.) TECH-EDU 2018. CCIS, vol. 993, pp. 412–427. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-20954-4_31
Bakharia, A.: Towards cross-domain MOOC forum post classification. In: Proceedings of the Third ACM Conference Learning @ Scale - L@S 2016, pp. 253–256 (2016)
Wei, X., Lin, H., Yang, L., Yu, Y.: A convolution-LSTM-based deep neural network for cross-domain MOOC forum post classification. Information 8(3), 92 (2017)
Dolianiti, F.S., Iakovakis, D., Dias, S.B., Hadjileontiadou, S.J., Diniz, J.A., Natsiou, G., Tsitouridou, M., Bamidis, P.D., Hadjileontiadis, L.J.: Sentiment analysis on educational datasets: a comparative evaluation of commercial tools. Educ. J. Univ. Patras UNESCO Chair 6(1), 262–273 (2019)
Balahur, A., Turchi, M., Steinberger, R., Ortega, J.M.P., Jacquet, G., Küçük, D., Zavarela, V., El Ghali, A.: Resource creation and evaluation for multilingual sentiment analysis in social media texts. In: Proceedings of Ninth International Conference on Language Resources and Evaluation, pp. 4265–4269. ELRA, Reykjavik, Iceland (2014)
Hayes, A.F., Krippendorff, F.: Answering the call for a standard reliability measure for coding data. Commun. Methods Measures 1(1), 77–89 (2007)
Chawla, N., Bowyer, K.W., Hall, L.O., Kegelmeyer, W.P.: SMOTE: synthetic minority oversampling technique. J. Artif. Intell. Res. 16, 321–357 (2002)
Saleh, M.R., MartÃn-Valdivia, M.T., Montejo-Ráez, A., Ureña-López, L.A.: Experiments with SVM to classify opinions in different domains. Expert Syst. Appl. 38(12), 14799–14804 (2011)
Rifkin, R., Klautau, A.: In defense of one-vs-all classification. J. Mach. Learn. Res. 5(Jan), 101–141 (2004)
Aue, A., Gamon, M.: Customizing sentiment classifiers to new domains: a case study. In: Proceedings of Recent Advances in Natural Language Processing, vol. 1, no. 3.1, pp. 2–1 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Dolianiti, F. et al. (2020). Cross-Course and Multi-course Sentiment Classification of Student Posts. In: Frasson, C., Bamidis, P., Vlamos, P. (eds) Brain Function Assessment in Learning. BFAL 2020. Lecture Notes in Computer Science(), vol 12462. Springer, Cham. https://doi.org/10.1007/978-3-030-60735-7_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-60735-7_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60734-0
Online ISBN: 978-3-030-60735-7
eBook Packages: Computer ScienceComputer Science (R0)