Skip to main content

Using Cobots, Virtual Worlds, and Edge Intelligence to Support On-line Learning

  • Conference paper
  • First Online:
HCI International 2021 - Late Breaking Papers: Cognition, Inclusion, Learning, and Culture (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 13096))

Included in the following conference series:

  • 1301 Accesses

Abstract

In this project the use of Virtual World technology and Artificial Intelligence to produce a shared social landscape for the society of learners. The idea is to create a Virtual World in which learners can participate and interact. One that is parallel to the learning environment or classroom. This can be viewed as an online multi-user environment such as “Second-Life” where on-line learners can interact and construct their own spaces. Their ability to work in that space is governed by input from their robot mentor. Skills in the Virtual World are provided as a result of a student’s behavior in the learning environment. The Virtual World can persist after the learning session is concluded so it provided an incentive for learners to do well in the learning session so that they can acquire points that translate into skills in the corresponding Virtual World. That Virtual World can be shared by several learning sessions or classes to provide a more comprehensive learning environment.

The overall approach is two-tiered in that each Robot mentor can acquire knowledge about the learner’s behavior within a given learning environment or class. The learner’s behavior is then translated into focus scores that can be applied to the Virtual World by a Supervisor, the Instructor Robot Learning Unit (IRLU). The Supervisor is in charge of updating the world based upon learner performances and compiling an ethnography of the social activities that take place within the environment. This ethnography of online users will describe in general terms how the environment is utilized by the group of learners. This information can be used by the Supervisor to adjust the Robots interaction with the learners and th cycle begins again. Such an approach with a singl learner has been studied previously by the authors [1].

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Palazzolo, T., Lemke, A., Zhang, C., Saad, S., Reynolds, R.G., O'Shea, J.: DeepDive: The use of virtual worlds to create an ethnography of an ancient civilization. HCI International (2021)

    Google Scholar 

  2. UNESCO, COVID-19 Educational Disruption and Response. 22 Dec 2020. https://en.unesco.org/themes/education-emergencies/coronavirus-school-closures

  3. Gardener, L.: COVID-19 Has Forced Higher Edu to Pivot to Online Learning. Here Are 7 Takeaways So Far. The Chronicles of Higher Education (2020)

    Google Scholar 

  4. Kelly, R.: 4,000-Plus U.S. Higher Ed Institutions Impacted by COVID-19; More Than 25 Million Students Affected. Campus Technology (2020)

    Google Scholar 

  5. Ally, M.: Foundations of educational theory for online learning. In: Theory and Practice of Online Learning, Athabasca University, Athabasca (2004)

    Google Scholar 

  6. Sun, J.C.Y., Rueda, R.: Situational interest, computer self-efficacy and self-regulation: their impact on student engagement in distance education. Br. J. Educ. Technol. 43(2), 191–204 (2021)

    Google Scholar 

  7. Wu, J.Y.: The indirect relationship of media multitasking self-efficacy on learning performance within the personal learning environment: implications from the mechanisms of perceived attention problems and self-regulation strategies. Comput. Educ. 106, 56–72 (2017)

    Google Scholar 

  8. Petersen, S.E., Posner, M.I.: The attention system of the human brain: 20 Years After. Ann. Rev. Neurosci. 13(1), 73–89 (2012)

    Google Scholar 

  9. Kuo, Y.C., Walker, A.E., Schroder, K.E., Belland, B.R.: Interaction, internet self-efficacy, and self-regulated learning as predictors of student satisfaction in online education courses. Internet High. Educ. 20, 35–50 (2014)

    Google Scholar 

  10. Heller, B., Procter, M.: Embodied and embedded intelligence: actor agents on virtual stages. Intelligent and Adaptive Learning Systems: Technology Enchanged Support for Students and Teachers, pp. 280–292 (2012)

    Google Scholar 

  11. Pereira, A., Martinho, C., Leite, I., Paiva, A.: iCat, the chess player: the influence of embodiment in the enjoyment of a game. In: Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems, pp. 1253–1256 (2008)

    Google Scholar 

  12. Mac Iver, M.A., Mac Iver, D.J.: STEMming the swell of absenteeism in urban middle grade schools: impacts of a summer robotics program. Society for Research on Educational Effectiveness (2014)

    Google Scholar 

  13. Gomoll, A., Hmelo-Silver, C.E., Sabanovic, S., Francisco, M.: Dragons, Ladybugs, and Softballs: Girls’ STEM engagement with human-centered robotics. J. Sci. Educ. Technol. 25(6), 899–914 (2016)

    Google Scholar 

  14. Dennins, M., Masthoff, J., Mellish, C.: Adapting progress feedback and emotional support to student personality. Int. J. Artif. Intell. Educ. 26(3), 877–931 (2016)

    Google Scholar 

  15. Tegos, S., Demetriadis, S., Tsiatsos, T.: A configurable conversational agent to trigger students' productive dialogue: a pilot student in the CALL Domain. Int. J. Aritif. Intell. Educ. 24(1), 62–91 (2014)

    Google Scholar 

  16. Hwang, W.Y., Wu, S.Y.: A case studet of collaboration with multi-robots and its effect on children's interaction. Interact. Learn. Environ. 22(4), 429–443 (2014)

    Google Scholar 

  17. Menekse, M., Higashi, R., Schunn, C.D., Baehr, E.: The role of robotics teams' collaboration quality on team performance in a robotics tournament. J. Eng. Educ. 106(4), 564–584 (2017)

    Google Scholar 

  18. Chen, G., Shen, J., Barth-Cohen, L., Jiang, S., Huang, X., Eltoukhy, M.: Assessing elementary students' computational thinking in everyday reasoning and robotics programming. Comput. Educ. 109, 162–175 (2017)

    Google Scholar 

  19. Leonard, J., et al.: Using robotics and game design to enhance children's self-efficacy, STEM attitudes, and computational thinking skills. J. Sci. Educ. Technol. 25(6), 860–876 (2016)

    Google Scholar 

  20. Liu, E.Z.F., Lin, C.H., Liou, P.Y., Feng, H.C., Hou, H.T.: An analysis of teacher-student interaction patterns in a robotics course for kindergarten children: a pilot student. Turkish Online J. Educ. Technol.-TOJET 12(1), 9–18 (2013)

    Google Scholar 

  21. Daniel, K., Kamioka, E.: Detection of learner's concentration in distance learning system with multiple biological information. J. Comput. Commun. 5(4), 1 (2017)

    Google Scholar 

  22. Hwang, G., Chang, H.: A formative assessment-based mobile learning approachto improving the learning attitudes and achievements of students. Comput. Educ. 56(4), 1023–1031 (2011)

    Article  Google Scholar 

  23. Krithika, L., Lakshmi Priya, G.G.: Student Emotion Recognition System (SERES) for e-learning improvement based on learner concentration metric. Procedia Comput. Sci. 85, 767–776 (2016)

    Google Scholar 

  24. Su, Y., Hsu, C., Chen, H., Huang, K., Huang, Y.: Developing a sensor-based learning concentration detection system. Engineering Computations (2014)

    Google Scholar 

  25. Sharma, P., Joshi, S., Gautam, S., Maharjan, S., Filipe, V., Reis, M.J.: Student engagement detection using emotion analysis, eye tracking, and head movement with machine learning. arXiv (2019)

    Google Scholar 

  26. Shi, W., Cao, J., Zhang, Q., Li, Y., Xu, L.: Edge computing: vision and challenges. IEEE Internet Things J. 3(5), 637–646 (2016)

    Google Scholar 

  27. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. Commun. ACM 60(6), 84–90 (2017)

    Google Scholar 

  28. Vaswani, A., et al.: Attention is All You Need. In: Advances in neural Information Processing Systems, pp. 5998–6008 (2017)

    Google Scholar 

  29. Amodei, D., et al.: Deep speech 2: end-to-end speech recognition in english and mandarin. In: International Conference on Machine Learning, pp. 173–182 (2016)

    Google Scholar 

  30. Zhang, X., Qiao, M., Liu, L., Xu, Y., Shi, W.: Collaborative cloud-edge computation for personalized driving behavior modeling. In: Proceedings of the 4th ACM/IEEE Symposium on Edge Computing, pp. 209–221 (2019)

    Google Scholar 

  31. Han, S., Pool, J., Tran, J., Dally, W.: Learning both weights and connections for efficient neural network. In: Advances in Neural Information Processing Systems, pp. 1135–1143 (2015)

    Google Scholar 

  32. Han, S., Mao, H.D.W.J.: Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding (2014). https://papers.nips.cc/paper/2015/hash/ae0eb3eed39d2bcef4622b2499a05fe6-Abstract.html

  33. Gong, Y., Liu, L., Yang, M., Bourdev, L.: Compressing Deep Convolutional Networks Using Vector Quantization (2014). [Online]

    Google Scholar 

  34. Hinton, G., Vinyals, O., Dean, J.: Distilling the Knowledge in a Neural Network (2015). [Online]

    Google Scholar 

  35. Cai, H., Zhu, L., Han, S.: Proxylessnas: Direct Neural Architecture Search on Target Task and Hardware (2018). [Online]

    Google Scholar 

  36. Cao, J., Cao, M., Wang, J., Yin, C., Wang, D., Vidal, P.P.: Urban noise recognition with convolutional neural network. Multimedia Tools Appl. 78(20), 29021–29041 (2019)

    Article  Google Scholar 

  37. McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. Artif. Intell. Stat. 54, 1273–1282 (2017)

    Google Scholar 

  38. McCarthy, J., Wright, P.: Technology as experience. Interactions 11(5), 42–43 (2004)

    Article  Google Scholar 

  39. Bardzell, S., Odom, W.: The experience of embodied space in virtual worlds: an ethnography of a second life community. Space Cult. 11(3), 239–259 (2008)

    Article  Google Scholar 

  40. Zhang, X., Wang, Y., Lu, S., Liu, L., Shi, W.: OpenEI: an open framework for edge intelligence. In: 2019 IEEE 39th International Conference on Distributed Computing Systems, pp. 1840–1851 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert G. Reynolds .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Djuric, A., Zhu, M., Shi, W., Palazzolo, T., Reynolds, R.G. (2021). Using Cobots, Virtual Worlds, and Edge Intelligence to Support On-line Learning. In: Stephanidis, C., et al. HCI International 2021 - Late Breaking Papers: Cognition, Inclusion, Learning, and Culture. HCII 2021. Lecture Notes in Computer Science(), vol 13096. Springer, Cham. https://doi.org/10.1007/978-3-030-90328-2_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90328-2_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90327-5

  • Online ISBN: 978-3-030-90328-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics