Abstract
There is a crucial need for advancement in the online educational system due to the unexpected, forced migration of classroom activities to a fully remote format, due to the coronavirus pandemic. Not only this, but online education is the future, and its infrastructure needs to be improved for an effective teaching–learning process. One of the major concerns with the current video call-based online classroom system is student engagement analysis. Teachers are often concerned about whether the students can perceive the teachings in a novel format. Such analysis was involuntarily done in the offline mode, however, is difficult in an online environment. This research presents an autonomous system for analyzing the students’ engagement in the class by detecting the emotions exhibited by the students. This is done by capturing the video feed of the students and passing the detected faces to an emotion detection mode. The emotion detection model in the proposed architecture was designed by fine-tuning VGG16 pre-trained image classifier model. Lastly, the average student engagement index is calculated. Authors received considerable performance setting reliability of the use of the proposed system in real time giving a future scope to this research.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Dutt, A., Ismail, M.A., Herawan, T.: A systematic review on educational data mining. IEEE Access 5, 15991–16005 (2017)
Bahel, V., Bajaj, P., Thomas, A.: Knowledge discovery in educational databases in Indian educational system: a case study of GHRCE, Nagpur. In: 2019 International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), Dec 2019, pp. 235–239. IEEE.
Bahel, V., Malewar, S., Thomas, A.: student interest group prediction using clustering analysis: an EDM approach. In: 2021 International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), pp. 481–484. IEEE (2021)
Bahel, V., Thomas, A.: Text similarity analysis for evaluation of descriptive answers. arXiv preprint arXiv:2105.02935 (2021)
Raes, A., Vanneste, P., Pieters, M., Windey, I., Van Den Noortgate, W., Depaepe, F.: Learning and instruction in the hybrid virtual classroom: an investigation of students’ engagement and the effect of quizzes. Comput. Edu. 143, 103682 (2020)
Weitze, C.L.: Pedagogical innovation in teacher teams: an organizational learning design model for continuous competence development. In: EXCEL 2015: The 14th European Conference on E-Learning, pp. 629–638. Academic Conferences and Publishing International (2015)
Torrey, L., Shavlik, J.: Transfer learning. In Handbook of research on machine learning applications and trends: algorithms, methods, and techniques, pp. 242–264. IGI global
Li, X., Grandvalet, Y., Davoine, F., Cheng, J., Cui, Y., Zhang, H., Yang, M.H.: Transfer learning in computer vision tasks: remember where you come from. Image Vis. Comput. 93, 103853 (2020)
Bahel, V., Pillai, S.: Detection of COVID-19 using chest radiographs with intelligent deployment architecture. In: Big Data Analytics and Artificial Intelligence Against COVID-19: Innovation Vision and Approach, pp. 117–130. Springer, Cham (2020)
Cao, Q., Shen, L., Xie, W., Parkhi, O.M., Zisserman, A.: Vggface2: A dataset for recognizing faces across pose and age. In: 2018 13th IEEE international conference on automatic face & gesture recognition (FG 2018), May 2018, pp. 67–74. IEEE (2018)
Ali, N., Zafar, B., Riaz, F., Dar, S.H., Ratyal, N.I., Bajwa, K.B., Iqbal, M.K., Sajid, M.: A hybrid geometric spatial image representation for scene classification. PLoS ONE 13(9), e0203339 (2018)
Ali, N., Zafar, B., Iqbal, M.K., Sajid, M., Younis, M.Y., Dar, S.H., Mahmood, M.T., Lee, I.H.: Modeling global geometric spatial information for rotation invariant classification of satellite images. PLoS ONE 14, 7 (2019)
Ali, N., Bajwa, K.B., Sablatnig, R., Chatzichristofs, S.A., Iqbal, Z., Rashid, M., Habib, H.A.: A novel image retrieval based on visual words integration of SIFT and SURF. PLoS ONE 11(6), e0157428 (2016)
Sajid, M., Iqbal Ratyal, N., Ali, N., Zafar, B., Dar, S.H., Mahmood, M.T., Joo, Y.B.: The impact of asymmetric left and asymmetric right face images on accurate age estimation. Math. Prob. Eng. 2019, 1–10 (2019)
Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. J. Personal Soc. Psychol. 17(2), 124 (1971)
Mehendale, N.: Facial emotion recognition using convolutional neural networks (FERC). SN Appl. Sci. 2(3), pp.1–8 (2020)
McDuff, D., et al.: AffectAura: an intelligent system for emotional memory. In: Proceedings of CHI, 2012
Bradski, G., Kaehler, A.: Learning OpenCV: Computer Vision with the OpenCV Li-brary. O’Reilly Press (2008)
Sablić, M., Mirosavljević, A., Škugor, A.: Video-based learning (VBL)—past, present, and future: an overview of the research published from 2008 to 2019. Technol. Knowl. Learn. https://doi.org/10.1007/s10758-020-09455-5
Mayer, R., Mayer, R.E.: The Cambridge Handbook of Multimedia Learning. Cambridge University Press (2005)
Paivio, A.: Dual coding theory: retrospect and current status. Can. J. Psychol. 45(3), 255 (1991)
Kim, J., Guo, P.J., Seaton, D.T., Mitros, P., Gajos, K.Z., Miller, R.C.: Understanding in-video dropouts and interaction peaks in-online lecture videos. In: Proceedings of the First ACM Conference on Learning @ Scale Conference, Atlanta, Georgia, USA (L@S ’14). Association for Computing (2014)
Hazarika, D., Poria, S., Zimmermann, R., Mihalcea, R.: Conversational transfer learning for emotion recognition. School of Computing, National University of Singapore, Singapore. Computer Science & Engineering, University of Michigan, USA, Information Systems Technology and Design, Singapore University of Technology and Design, Singapore. Received 28 Nov 2019, Revised 20 May 2020, Accepted 13 June 2020, Available online 1 July 2020
Kentsch, S., Lopez Caceres, M.L., Serrano, D., Roure, F., Diez, Y.: Computer vision and deep learning techniques for the analysis of drone-acquired forest images, a transfer learning study. Remote Sens. 12, 1287 (2020). https://doi.org/10.3390/rs12081287
Bo, S., Yongna, L., Jiubing, C., Jihong, L., Di, Z.: Emotion analysis based on facial expression recognition in smart learning environment. Mod. Distance Edu. Res. 2, 96–103 (2015)
Nigam H., Biswas P.: (2021) Web scraping: from tools to related legislation and implementation using Python. In: Raj J.S., Iliyasu A.M., Bestak R., Baig Z.A. (eds.) Innovative Data Communication Technologies and Application. Lecture Notes on Data Engineering and Communications Technologies, vol. 59. Springer, Singapore. https://doi.org/10.1007/978-981-15-9651-3_13
Kasereka, H.: Importance of web scraping in e-commerce and e-marketing, 19 Jan 2021. Available at SSRN: https://ssrn.com/abstract=3769593 or https://doi.org/10.2139/ssrn.3769593
Hutchinson, M.L., Antono, E., Gibbons, B.M., Paradiso, S., Ling, J., Meredig, B.: Overcoming data scarcity with transfer learning. arXiv preprint arXiv:1711.05099 (2017)
Simonyan, K., Zisserman, A., Visual Geometry Group.: Very deep convolutional networks for large-scale image recognition. Department of Engineering Science, University of Oxford
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Karan, K.V., Bahel, V., Ranjana, R., Subha, T. (2022). Transfer Learning Approach for Analyzing Attentiveness of Students in an Online Classroom Environment with Emotion Detection. In: Roy, S., Sinwar, D., Perumal, T., Slowik, A., Tavares, J.M.R.S. (eds) Innovations in Computational Intelligence and Computer Vision . Advances in Intelligent Systems and Computing, vol 1424. Springer, Singapore. https://doi.org/10.1007/978-981-19-0475-2_23
Download citation
DOI: https://doi.org/10.1007/978-981-19-0475-2_23
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-0474-5
Online ISBN: 978-981-19-0475-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)