Smart Learning Environments

  • Katashi NagaoEmail author


Our university is currently developing an advanced physical–digital learning environment that can train students to enhance their discussion and presentation skills. The environment guarantees an efficient discussion among users with state-of-the-art technologies such as touch panel discussion tables, digital posters, and an interactive wall-sized whiteboard. It includes a data mining system that efficiently records, summarizes, and annotates discussions held inside our facility. We also developed a digital poster authoring tool, a novel tool for creating interactive digital posters displayed using our digital poster presentation system. Evaluation results show the efficiency of using our facilities: the data mining system and the digital poster authoring tool. In addition, our physical–digital learning environment will be further enhanced with a vision system that will detect interactions with the digital poster presentation system and the different discussion tools enabling a more automated skill evaluation and discussion mining. In addition, we argue that students’ heart rate (HR) data can be used to effectively evaluate their cognitive performance, specifically the performance in a discussion that consists of several Q&A segments (question-and-answer pairs). We collected HR data during a discussion in real time and generate machine learning models for evaluation. HR data are used to estimate the degree of self-confidence of speech while speakers participate in Q&A sessions. We checked whether there is a correlation between the degree of confidence and the appropriateness of statements. So, we can evaluate the mental appropriateness of the statements. Furthermore, we realized a presentation rehearsal system using virtual reality technology. Based on the system, students can easily experience the act of presentation in front of many audiences with a wide auditorium in virtual space. In this chapter, I will also describe them in detail.


Leading graduate school Leaders’ saloon Presentation skills Digital poster Psychophysiology-based activity evaluation Virtual reality presentation rehearsal system 


  1. K. Armstrong, Big data: a revolution that will transform how we live, work, and think. Inf. Commun. Soc. 17(10), 1300–1302 (2014)CrossRefGoogle Scholar
  2. Y. Bengio, Learning deep architectures for AI. Found. Trends Mach. Learn. 2(1), 1–127 (2009)MathSciNetCrossRefGoogle Scholar
  3. A.J. Camm, M. Malik, J. Bigger, G. Breithardt, S. Cerutti, R. Cohen, P. Coumel, E. Fallen, H. Kennedy, R. Kleiger, Heart rate variability: standards of measurement, physiological interpretation and clinical use. Eur. Heart J. 17(3), 354–381 (1996)CrossRefGoogle Scholar
  4. L. Cutrone, M. Chang, Kinshuk, Auto-assessor: computerized assessment system for marking student’s short-answers automatically, in 2011 IEEE International Conference on Technology for Education (T4E), pp. 81–88 (2011)Google Scholar
  5. G.R. Hess, K.W. Tosney, L.H. Liegel, Creating effective poster presentations: AMEE guide no. 40. Med. Teach. 31(4), 319–321 (2009)CrossRefGoogle Scholar
  6. D. Iakovakis, L. Hadjileontiadis, Standing Hypotension Prediction Based on Smartwatch Heart Rate Variability Data: A Novel Approach, in Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 1109–1112 (ACM, 2016)Google Scholar
  7. D. Kerby, J. Romine, Develop oral presentation skills through accounting curriculum design and course-embedded assessment. J. Educ. Bus. 85(3), 172–179 (2009)CrossRefGoogle Scholar
  8. K. Kurihara, M. Goto, J. Ogata, Y. Matsusaka, T. Igarashi, Presentation Sensei: A Presentation Training System using Speech and Image Processing, in Proceedings of the 9th International Conference on Multimodal Interfaces, ICMI’07, pp. 358–365 (ACM, New York, NY, USA, 2007)Google Scholar
  9. A. Luque-Casado, M. Zabala, E. Morales, M. Mateo-March, D. Sanabria, Cognitive performance and heart rate variability: the influence of fitness level. PLoS ONE. (2013)CrossRefGoogle Scholar
  10. S. Ohira, K. Kawanishi, K. Nagao, Assessing motivation and capacity to argue in a gamified seminar setting, in Proceedings of the Second International Conference on Technological Ecosystems for Enhancing Multiculturality. TEEM’14, pp. 197–204. ACM, New York, NY, USA (2014)Google Scholar
  11. Y. Omori, K. Ito, S. Nishida, T. Kihira, Study on supporting group discussions by improving discussion skills with ex post evaluation, in IEEE International Conference on Systems, Man and Cybernetics, 2006. SMC’06., vol. 3, pp. 2191–2196 (2006)Google Scholar
  12. T. Pereira, P.R. Almeida, J.P. Cunha, A. Aguiar, Heart rate variability metrics for fine-grained stress level assessment. Comput. Meth. Programs Biomed. 148, 71–80 (2017)CrossRefGoogle Scholar
  13. S. Peng and K. Nagao, Automatic Evaluation of Presenters’ Discussion Performance based on Their Heart Rate, in Proceedings of the 10th International Conference on Computer Supported Education (CSEDU 2018) (2018)Google Scholar
  14. A.J. Sellen, S. Whittaker, Beyond total capture:a constructive critique of lifelogging. Commun. ACM 53(5), 70–77 (2010)CrossRefGoogle Scholar
  15. H. Trinh, K. Yatani, D. Edge, PitchPerfect: Integrated rehearsal environment for structured presentation preparation, in Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, CHI’14, pp. 1571–1580 (ACM, New York, NY, USA, 2014)Google Scholar
  16. N. Wanas, M. El-Saban, H. Ashour, W. Ammar, Automatic scoring of online discussion posts, in Proceedings of the 2Nd ACM Workshop on Information Credibility on the Web. WICOW ’08, pp. 19–26 (ACM, New York, NY, USA, 2008)Google Scholar
  17. X. Wang, X. Ding, S. Su, Z. Li, H. Riese, J.F. Thayer, F. Treiber, H. Snieder, Genetic influences on heart rate variability at rest and during stress. Psychophysiology 46(3), 458–465 (2009)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  1. 1.Nagoya UniversityNagoyaJapan

Personalised recommendations