Advertisement

Detecting Emotions in Students’ Generated Content: An Evaluation of EmoTect System

  • Emmanuel Awuni Kolog
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 843)

Abstract

In this paper, an intelligent e-counselling system for automatic detection of emotion in text is evaluated. A support vector machine classifier was used for the development of the e-counselling system, hence we compared the performance of the e-counselling system’s classifier with WEKA’s Multinomial Naïve-Bayes and J48 decision tree classifiers. While this paper is geared towards ascertaining the efficacy of the various classifiers for classifying emotions in learners’ generated text content, this paper also aims to ascertain the performance of the e-counselling system for complementing decision making concerning students in counselling delivery. In building the system, an annotated students’ life story corpus was developed and used for the experiment. Therefore, 85% of the total instances of the life stories was used as training data while the remaining 15% was used as test data with sample instances of real-time data from students’ textual submission through the e-counselling system. The results of the experiment show that the SVM, implemented in our proposed e-counselling system, is superior over the MNB and J48 classifiers.

Keywords

Emotion detection Text classification Counselling Decision making machine learning Students 

References

  1. Balabantaray, R.C., Mohammad, M., Sharma, N.: Multi-class twitter emotion classification: a new approach. Int. J. Appl. Inf. Syst. 4(1), 48–53 (2012)Google Scholar
  2. Crowston, K., Liu, X., Allen, E.E.: Machine learning and rule-based automated coding of qualitative data. Proc. Am. Soc. Inf. Sci. Technol. 47, 1–2 (2010)Google Scholar
  3. Gandomi, A., Haider, M.: Beyond the hype: big data concepts, methods, and analytics. Int. J. Inf. Manag. 35(2), 137–144 (2015)CrossRefGoogle Scholar
  4. Glasheen, K., Campbell, M., Shochet, I.: Opportunities and challenges: school guidance counsellors’ perceptions of counselling students online. Aust. J. Guid. Couns. 23, 222–235 (2013)CrossRefGoogle Scholar
  5. Hashem, E., Mabrouk, M.: A study of support vector machine algorithm for liver disease diagnosis. Am. J. Intell. Syst. 4(1), 9–14 (2014)Google Scholar
  6. Hrastinski, S.: Introducing an informal synchronous medium in a distance learning course: how is participation affected? Internet High. Educ. 9(2), 117–131 (2006)CrossRefGoogle Scholar
  7. Igbokwe, J.C., Obidike, N.A., Ezeji, E.C.: Influence of electronic media on reading ability of school children (2012)Google Scholar
  8. Inman, A., Ngoubene-Atioky, A., Ladany, N., Mack, T.: School counselors in international school: critical issues and challenges. Int. J. Adv. Couns. 31, 80–99 (2009)CrossRefGoogle Scholar
  9. Jain, M.C., Kulkarni, V.Y.: TexEmo: conveying emotion from text-the study. Int. J. Comput. Appl. 86(4), 43–49 (2014)Google Scholar
  10. Jung, N., Wranke, C., Hamburger, K., Knauff, M.: How emotions affect logical reasoning: evidence from experiments with mood-manipulated participants, spider phobics, and people with exam anxiety. Front. Psychol. 5, 570 (2014)Google Scholar
  11. King, R., Bambling, M., Reid, W., Thomas, I.: Telephone and online counselling for young people: a naturalistic comparison of session outcome, session impact and therapeutic alliance. Couns. Psychother. Res. 6(3), 175–181 (2006)CrossRefGoogle Scholar
  12. Kołakowska, A., Landowska, A., Szwoch, M., Szwoch, W., Wróbel, M.R.: Emotion recognition and its applications. In: Hippe, Z.S., Kulikowski, J.L., Mroczek, T., Wtorek, J. (eds.) Human-Computer Systems Interaction: Backgrounds and Applications 3. AISC, vol. 300, pp. 51–62. Springer, Cham (2014).  https://doi.org/10.1007/978-3-319-08491-6_5CrossRefGoogle Scholar
  13. Kolog, E.A.: Contextuallising the application of human language technologies for counselling. Ph.D. thesis, University of Eastern Finland (2017a)Google Scholar
  14. Kolog, E.A., Montero, C.S.: Towards automated e-counselling system based on counsellors’ emotion perception. Educ. Inf. Technol. 23(2), 911–933 (2018)CrossRefGoogle Scholar
  15. Kolog, E.A., Montero, C.S., Toivonen, T.: Using machine learning for sentiment and social influence analysis in text. In: Rocha, A., Guarda, T. (eds.) Proceedings of the International Conference on Information Technology & Systems (ICITS 2018). AISC, vol. 721, pp. 453–463. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-73450-7_43CrossRefGoogle Scholar
  16. Kolog, E.A., Sutinen, E.,Vanhalakka-Ruoho, M.: E-counselling implementation: students’ life stories and counselling technologies in perspective. Int. J. Educ. Dev. Using Inf. Commun. Technol. 10(3), 32 (2014)Google Scholar
  17. Kolog, E.A., Sutinen, E., Vanhalakka-Ruoho, M., Sohunen, J., Anohah, E.: Using unified theory of acceptance and use of technology model to predict students’ behavioral intention to adopt and use e - counseling in Ghana. Int. J. Mod. Educ. Comput. Sci. 7(11), 1–11 (2015)CrossRefGoogle Scholar
  18. Kolog, E.A., Montero, S.C., Sutinen, E.: Annotation agreement of emotions in text: the influence of counselors’ emotional state on their emotion perception. In: Proceeding of International Conference on Advanced Learning Technologies (ICALT), pp. 357–359. IEEE (2016)Google Scholar
  19. Landis, J., Kouch, G.: The measurement of observer agreement for categorical data. Biometrics 33(1), 159–174 (1977)CrossRefGoogle Scholar
  20. Lerner, J., Li, Y., Valdesolo, P., Kassam, K.S.: Emotion and decision making. Annu. Rev. Psychol. 66, 799–823 (2015)CrossRefGoogle Scholar
  21. Lugmayr, A., Sutinen, E., Suhonen, J., Sedano, C., Hlavacs, H., Montero, C.: Serious storytelling – a first definition and review. Multimed. Tools Appl. 76, 1–27 (2016)Google Scholar
  22. Mohammad, S.M.: Sentiment analysis: detecting valence, emotions, and other affectual states from text. In: Emotion measurement, pp. 201–238 (2015)CrossRefGoogle Scholar
  23. Odbal, S., Wang, Z.: Segment-based fine-grained emotion detection for chinese text. In: CLP, p. 52 (2014)Google Scholar
  24. Peffers, K., Tuunanen, T., Gengler, C.E., Rossi, M., Hui, W., Virtanen, V., Bragge, J.: The design science research process: a model for producing and presenting information systems research. In: Proceedings of the First International Conference on Design Science Research in Information Systems and Technology, pp. 83–106 (2006)Google Scholar
  25. Plutchik, R.: Emotion: Theory, Research, and Experience: Theories of Emotion, vol. 1, p. 399. Academic Press, New York (1980)Google Scholar
  26. Roser, M., Ortiz-Ospina, E.: Global Rise of Education (2017). From WorldInData.org: https://ourworldindata.org/global-rise-of-education. Retrieved 5 July 2017
  27. Sebe, N., Cohen, I., Gevers, T., Huang, T.S.: Multimodal approaches for emotion recognition: a survey. In: Proceedings of SPIE, vol. 5670, pp. 56–67 (2005)Google Scholar
  28. Suttles, J., Ide, N.: Distant supervision for emotion classification with discrete binary values. In: Gelbukh, A. (ed.) Computational Linguistics and Intelligent Text Processing (CICLing 2013). LNCS, vol. 7817, pp. 121–136. Springer, Heidelberg (2013).  https://doi.org/10.1007/978-3-642-37256-8_11CrossRefGoogle Scholar
  29. UNESCO: Technical and vocational education and training in the 21st century: New roles and challenges for guidance and counselling (2002)Google Scholar
  30. Witten, I.H., Frank, E., Hall, M.A., Pal, C.J.: Data mining: practical machine learning tools and techniques (2014)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.School of ComputingUniversity of Eastern FinlandJoensuuFinland

Personalised recommendations