Skip to main content
SpringerLink
Log in
Book cover

International Conference on Augmented Reality, Virtual Reality and Computer Graphics

AVR 2021: Augmented Reality, Virtual Reality, and Computer Graphics pp 290–305Cite as

Initial Evaluation of an Intelligent Virtual Museum Prototype Powered by AI, XR and Robots

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12980))

Abstract

This paper presents the design, development and initial evaluation of an intelligent virtual museum prototype based on a new type of Cyber-Physical-Social Eco-System (CPSeS) framework aiming to merge the real with virtual worlds interchangeably using AI, XR and Robots. Whereas virtual environments have become prominent tools in many domains, offering shared and interactive virtual worlds, the proposed prototype incorporates multi-user and interactive functionalities together with a new agent, namely, a physical robot and its digital twin. The physical robot is located and acts in a real environment whilst its avatar (further referred to as its digital twin) lives in the virtual world. The users are able to see and explore both worlds simultaneously through the ‘eyes’ of the robot. Together with multi-user infrastructure and communication capabilities, the environment also involves additional agents guiding the user in the virtual world, and an educational game, aiming at developing a CPSeS capable of blending the real with digital worlds, and to be influenced by its users, real and artificial agents and elements. The user-based qualitative evaluation of the proposed system was favourable but also constructive providing the research team with valuable observations on its performance.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Daugherty, P., Carrel-Billiard, M.M.B.: Accenture Technology Vision (2018). https://www.accenture.com/t00010101T000000Z__w__/nz-en/_acnmedia/Accenture/next-gen-7/tech-vision-2018/pdf/Accenture-TechVision-2018-Tech-Trends-Report.pdf

  2. Valin, J.: Humans still needed: an analysis of skills and tools in public relations. Chartered Ins. Public Relat. 23, 1–12 (2018)

    Google Scholar 

  3. Luck, M., Aylett, R.: Applying artificial intelligence to virtual reality: intelligent virtual environments. Appl. Artif. Intell. 14(1), 3–32 (2000)

    Article  Google Scholar 

  4. Williams, T., Szafir, D., Chakraborti, T., Amor, H.B.: Virtual, augmented, and mixed reality for human-robot interaction. In: Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, Chicago, IL, USA pp 403–404. Association for Computing Machinery (2018)

    Google Scholar 

  5. Nisiotis, L., Alboul, L., Beer, M.: A prototype that fuses virtual reality, robots, and social networks to create a new cyber–physical–social eco-society system for cultural heritage. Sustainability 12(2), 645 (2020)

    Article  Google Scholar 

  6. Ghosh, A., Chakraborty, D., Law, A.: Artificial intelligence in internet of things. CAAI Trans. Intell. Technol. 3(4), 208–218 (2018)

    Article  Google Scholar 

  7. de Saint Laurent, C.: In defence of machine learning: debunking the myths of artificial intelligence. Eur. J. Psychol. 14(4), 734–747 (2018)

    Article  Google Scholar 

  8. Nielsen, M.A.: Neural Networks and Deep Learning, Vol. 25. Determination press, San Francisco (2015)

    Google Scholar 

  9. Contreras, S., Rosa, F.D.L.: Using deep learning for exploration and recognition of objects based on images. In: 2016 XIII Latin American Robotics Symposium and IV Brazilian Robotics Symposium (LARS/SBR), pp 1–6 (2016)

    Google Scholar 

  10. Jain, A., Kulkarni, G., Shah, V.: Natural language processing. Int. J. Comput. Sci. Eng. 6(1), 161–167 (2018)

    Google Scholar 

  11. Remian, D.: Augmenting education: ethical considerations for incorporating artificial intelligence in education. Instr. Des. Capstones Collect. 52, 1–54 (2019)

    Google Scholar 

  12. Slater, M.: Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. R. Soc B: Biol. Sci. 364(1535), 3549–3557 (2009)

    Article  Google Scholar 

  13. Handa, M., Aul, G., Bajaj, S.: Immersive technology–uses, challenges and opportunities. Int. J. Comput. Bus. Res. 6(2), 1–11 (2012)

    Google Scholar 

  14. OxfordDictionary: Virtual Reality. https://www.lexico.com/definition/virtual_reality.

  15. Klopfer, E., Squire, K.: Environmental detectives—the development of an augmented reality platform for environmental simulations. Educ. Tech. Res. Dev. 56(2), 203–228 (2008)

    Article  Google Scholar 

  16. Cawood, S., Fiala, M.: Augmented reality: a practical guide (2008)

    Google Scholar 

  17. Milgram, P., Colquhoun, H.: A taxonomy of real and virtual world display integration. Mixed reality: Merg. real virtual worlds 1(1999), 1–26 (1999)

    Google Scholar 

  18. Alizadehsalehi, S., Hadavi, A., Huang, J.C.: From BIM to extended reality in AEC industry. Autom. Constr. 116, 103254 (2020)

    Article  Google Scholar 

  19. IEEE Digital Reality Initiative: Digital Transformation. https://digitalreality.ieee.org/images/files/pdf/DRI_White_Paper_-_Digital_Transformation_-_Final_25March21.pdf.

  20. Garcia, T.J.L., Rodriguez-Aguilar, R.M., Alvarez-Cedillo, J.A., Alvarez-Sanchez, T.: Development of software architecture for a 3d virtual environment with the incorporation of a reactive intelligent agent. J. Theor. Appl. Inf. Technol. 97(17), 4589–4599 (2019)

    Google Scholar 

  21. Lepouras, G., Vassilakis, C.: Adaptive virtual reality museums on the web in adaptable and adaptive hypermedia systems. In: Sherry, Y.C., George, D.M. (Eds.) IGI Global, Hershey (2005)

    Google Scholar 

  22. de Aquino, M.S., de Souza, F.d.F.: Adaptive virtual environments: the role of intelligent agents In: Practical Applications of Agent-Based Technology, pp. 87–110. INTECH Open Science (2012)

    Google Scholar 

  23. Kiourt, C., Pavlidis, G., Koutsoudis, A., Kalles, D.: Multi-agents based virtual environments for cultural heritage. In: 2017 XXVI International Conference on Information, Communication and Automation Technologies (ICAT), pp 1–6 (2017)

    Google Scholar 

  24. Osório, F.S., Musse, S.R., Santos, C.D., Heinen, F., Braun, A., Silva, A.D.: Intelligent virtual reality environments (IVRE): Principles, implementation, interaction, examples and practical applications. Virtual Concept (Proceedings-Tutorials) 1, 1–64 (2005)

    Google Scholar 

  25. Russell, S., Norvig, P.: Artificial intelligence: a modern approach (2002)

    Google Scholar 

  26. Duguleană, M., Briciu, V.-A., Duduman, I.-A., Machidon, O.M.: A virtual assistant for natural interactions in museums. Sustainability 12(17), 6958 (2020)

    Article  Google Scholar 

  27. Petrović, V.M.: Artificial intelligence and virtual worlds–toward human-level AI agents. IEEE Access 6, 39976–39988 (2018)

    Article  Google Scholar 

  28. Lee, J., Bagheri, B., Kao, H.-A.: Recent advances and trends of cyber-physical systems and big data analytics in industrial informatics. In: International Proceeding of International Conference on Industrial Informatics (INDIN). pp 1–6 (2014)

    Google Scholar 

  29. Krogh, B.H.: Cyber physical systems: the need for new models and design paradigms. Presentation Report (2008)

    Google Scholar 

  30. Monostori, L.: Cyber-physical production systems: roots, expectations and R&D challenges. Procedia CIRP 17, 9–13 (2014)

    Article  Google Scholar 

  31. Xiong, G., et al.: Cyber-physical-social system in intelligent transportation. IEEE/CAA J. Automatica Sinica 2(3), 320–333 (2015)

    Article  MathSciNet  Google Scholar 

  32. Naudet, Y., Yilma, B.A., Panetto, H.: Personalisation in cyber physical and social systems: the case of recommendations in cultural heritage spaces. In: 2018 13th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP), pp. 75–79 (2018)

    Google Scholar 

  33. Murakami, K.J.: CPSS (cyber-physical-social system) initiative-beyond CPS (cyber-physical system) for a better future. In: Keynote Speech, the First Japan-Egypt Conference on Electronics Communication and Computers JEC-ECC (2012)

    Google Scholar 

  34. Nisiotis, L., Alboul, L., Beer, M.: Virtual museums as a new type of cyber-physical-social system. In: De Paolis, L.T., Bourdot, P. (eds.) AVR 2019. LNCS, vol. 11614, pp. 256–263. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-25999-0_22

    Chapter  Google Scholar 

  35. Alboul, L., Beer, M., Nisiotis, L.: Robotics and virtual reality gaming for cultural heritage preservation. In: Resilience and Sustainability of Cities in Hazardous Environments, Napoli, pp. 335-345 (2019)

    Google Scholar 

  36. Alboul, L., Beer, M., Nisiotis, L.: Merging realities in space and time: towards a new cyber-physical eco-society. In: Dimitrova, M., Wagatsuma, H. (Eds.) Cyber-Physical Systems for Social Applications, IGI Global, Pennsylvania (2019). https://doi.org/10.4018/978-1-5225-7879-6

  37. Nisiotis, L., Alboul, L.: Work-in-progress—converging virtual reality, robots, and social networks to support immersive learning. In: 2020 6th International Conference of the Immersive Learning Research Network (iLRN), pp. 308–311 (2020)

    Google Scholar 

  38. Nisiotis, L., Alboul, L.: Work-in-progress—an intelligent immersive learning system using AI, XR and robots. In: 7th International Conference of the Immersive Learning Research Network (iLRN), (2021)

    Google Scholar 

  39. Valchkova, N.F., Zahariev, R.Z.: Optimization of model operator for service robot, intended to service persons with disability. IFAC-PapersOnLine 52(25), 174–179 (2019)

    Article  MathSciNet  Google Scholar 

  40. Papakostas, G., Sidiropoulos, G., Bella, M., Kaburlasos, V.: Social robots in special education: current status and future challenges. The Proceedings of JSME annual Conference on Robotics and Mechatronics (Robomec) 2018, 1P1-A15. The Japan Society of Mechanical Engineers (2018)

    Google Scholar 

  41. Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., Tanaka, F.: Social robots for education: a review. Sci. Rob. 3(21), eaat5954 (2018)

    Google Scholar 

  42. Marques, M.M., et al.: Use of multi-domain robots in search and rescue operations—contributions of the ICARUS team to the euRathlon 2015 challenge. In: OCEANS 2016-Shanghai, pp 1–7 (2016)

    Google Scholar 

  43. Goswami, A., Vadakkepat, P.: Humanoid Robotics: A Reference. Springer, Dordrecht (2019)

    Book  Google Scholar 

  44. Robla-Gómez, S., Becerra, V.M., Llata, J.R., González-Sarabia, E., Torre-Ferrero, C., Pérez-Oria, J.: Working together: a review on safe human-robot collaboration in industrial environments. IEEE Access 5, 26754–26773 (2017)

    Article  Google Scholar 

  45. FetchRobotics: Fetch Robotics. https://fetchrobotics.com/.

  46. Unity3D: Unity 3D Game Engine Software. https://unity3d.com/.

  47. GoogleVR: Google AR/VR. https://arvr.google.com/.

  48. AndroidSDK: Android Studio SDK. https://developer.android.com/studio.

  49. MrCardboard: Mr Cardboard HMD. https://mrcardboard.eu/.

  50. PhotonEngine: Photon Engine. https://www.photonengine.com/pun.

  51. PhotonEngine: Photon Engine Voice. https://www.photonengine.com/en/voice.

  52. ROS: Robotic Operating System http://wiki.ros.org/.

  53. RosBridge: Rosbridge Library. http://wiki.ros.org/rosbridge_library.

  54. Ros#: ROS#. https://github.com/siemens/ros-sharp.

  55. Hajjaj, S.S.H., Sahari, K.S.M.: Establishing remote networks for ROS applications via port forwarding: a detailed tutorial. Int. J. Adv. Rob. Syst. 14(3), 1–13 (2017)

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Centre for Automation and Robotics Research (CARR), Industry and Innovation Research Institute at Sheffield Hallam University (UK), and the School of Sciences at the University of Central Lancashire, Cyprus Campus, for providing the equipment and the working environment. Also, special thanks to the students: Robin Ghys, Jean-Alexis Hermel, Léo Dedeine, Grzegorz Szargot who have contributed to the development of the system, and to Dr Martin Beer for useful discussions. This paper is in memory of our dear friend, colleague and collaborator Professor Jacques Penders.

Author information

Authors and Affiliations

  1. University of Central Lancashire, Cyprus Campus, Pyla, Cyprus

    Louis Nisiotis

  2. Sheffield Hallam University, Sheffield, UK

    Lyuba Alboul

Authors
  1. Louis Nisiotis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lyuba Alboul
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Louis Nisiotis .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Naples Federico II, Naples, Italy

    Pasquale Arpaia

  3. University of Paris-Sud, Orsay, France

    Patrick Bourdot

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nisiotis, L., Alboul, L. (2021). Initial Evaluation of an Intelligent Virtual Museum Prototype Powered by AI, XR and Robots. In: De Paolis, L.T., Arpaia, P., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2021. Lecture Notes in Computer Science(), vol 12980. Springer, Cham. https://doi.org/10.1007/978-3-030-87595-4_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87595-4_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87594-7

  • Online ISBN: 978-3-030-87595-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation