Abstract
From CRTs to virtual displays, the perception of the digital world we know is continually evolving. Technologies like computer vision and object recognition can be used in conjunction with augmented reality to create an interactive and enhanced user experience of the real world. People are familiar with digital assistants like Siri on iPhone, Google Assistant on android, Cortana on Windows, or Alexa and Google Home in households. As the digital assistant market increases, so does their functionalities and capabilities. They perform a wide variety of tasks ranging from answering the most basic questions, to playing a song, telling jokes, setting alarms, reading audiobooks, and even take control of IoT devices in a smart home system. With this paper, we aim at incorporating the same in an environment where the user can see and interact with the agent, which increases user satisfaction and enhances the overall experience.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
K. Maxwellm Augmented Reality—definition of Augmented Reality, http://www.macmillandictionary.com/buzzword/entries/augmented-reality.html
J.W. Meulstee, J. Nijsink, R. Schreurs, L.M. Verhamme, T. Xi, H.H.K. Delye, W.A. Borstlap, T.J.J. Maal, Toward holographic-guided surgery. Surg. Innov. (2019). https://doi.org/10.1177/1553350618799552
L. Fan, J. Chen, Y. Miao, J. Ren, Y. Wang, Multi-vehicle cooperative military training simulation system based on augmented reality, in Adjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 (2019)
C.S.C. Dalim, H. Kolivand, H. Kadhim, M.S. Sunar, M. Billinghurst, Factors influencing the acceptance of augmented reality in education: a review of the literature (2017)
D.D. Han, T. Jung, Dublin AR: implementing augmented reality (AR) in tourism. Inf. Commun. Technol. Tour. 2014 (2013). https://doi.org/10.1007/978-3-319-03973-2
J. Hamari, A. Malik, J. Koski, A. Johri, Uses and gratifications of pokémon go: why do people play mobile location-based augmented reality games? Int. J. Hum. Comput. Interact. (2019). https://doi.org/10.1080/10447318.2018.1497115
M. Yuan, I.R. Khan, F. Farbiz, S. Yao, A. Niswar, M.H. Foo, A mixed reality virtual clothes try-on system. IEEE Trans. Multimedia (2013). https://doi.org/10.1109/TMM.2013.2280560
G. Chollet, J. Boudy, A. Esposito, G. Pelosi, Mines-t, I.: Building the next generation of personal digital assistants, in International Conference on Advanced Technologies for Signal and Image Processing, vol. 1 (2014), pp. 458–463
S. Haesler, K. Kim, G. Bruder, G. Welch, Seeing is believing: improving the perceived trust in visually embodied Alexa in augmented reality, in 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (2018), pp. 204–205. https://doi.org/10.1109/ISMAR-Adjunct.2018.00067
K. Kim, L. Boelling, S. Haesler, J. Bailenson, G. Bruder, G.F. Welch, Does a digital assistant need a body? The influence of visual embodiment and social behavior on the perception of intelligent virtual agents in AR, in 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (2019), pp. 105–114. https://doi.org/10.1109/ISMAR.2018.00039
N. Saquib, R.H. Kazi, L.Y. Wei, W. Li, Interactive body-driven graphics for augmented video performance, in Conference on Human Factors in Computing Systems—Proceedings (2019)
R. Reuter, F. Hauser, D. Muckelbauer, T. Stark, E. Antoni, J. Mottok, C. Wolff, Using augmented reality in software engineering education? First insights to a comparative study of 2D and AR UML modeling, in Proceedings of the 52nd Hawaii International Conference on System Sciences, vol. 6 (2019), pp. 7798–7807. https://doi.org/10.24251/hicss.2019.938
Y. Liu, H. Dong, L. Zhang, A. El Saddik, Technical evaluation of HoloLens for multimedia: a first look. IEEE Multimedia (2018). https://doi.org/10.1109/MMUL.2018.2873473
S. Prakash, A. Bahremand, L.D. Nguyen, R. LiKamWa, GleaM: an illumination estimation framework for real-time photorealistic augmented reality on mobile devices, in MobiSys 2019—Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services (2019), pp. 142–154. https://doi.org/10.1145/3307334.3326098
A. Hartholt, S. Mozgai, E. Fast, M. Liewer, A. Reilly, W. Whitcup, A.S. Rizzo, Virtual humans in augmented reality: a first step towards real-world embedded virtual roleplayers, in HAI 2019—Proceedings of the 7th International Conference on Human-Agent Interaction (2019), pp. 205–207. https://doi.org/10.1145/3349537.3352766
M. Kytö, B. Ens, T. Piumsomboon, G.A. Lee, M. Billinghurst, Pinpointing: Precise head- and eye-based target selection for augmented reality, in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, Apr 2018. https://doi.org/10.1145/3173574.3173655
S.S. Deshmukh, C.M. Joshi, R.S. Patel, Y.B. Gurav, 3D object tracking and manipulation in augmented reality. Int. Res. J. Eng. Technol. 5, 287–289 (2018)
G. Ng, J.G. Shin, A. Plopski, C. Sandor, D. Saakes, Situated game level editing in augmented reality, in Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction, Jan 2018, pp. 409–418. https://doi.org/10.1145/3173225.3173230
A. Schmeil, W. Broll, MARAA mobile augmented reality-based virtual assistant, in Proceedings—2007 IEEE Virtual Reality Conference (2007), pp. 267–270. https://doi.org/10.1109/VR.2007.352497
Q. Xu, Visual code marker detection, pp. 2–4 (2006)
A. Wu, H. Xiao, F. Zeng, A camera calibration method based on OpenCV, in ACM International Conference Proceeding Series (2019), pp. 320–324. https://doi.org/10.1145/3378065.3378127
Docs.opencv.org: OpenCV: Camera Calibration, https://docs.opencv.org/master/dc/dbb/tutorial_py_calibration.html
E. Angel, D. Shreiner, Introduction to modern OpenGL programming, in ACM SIGGRAPH 2012 Courses, SIGGRAPH’12 (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Verma, V., Sharma, A., Jain, K.K., Adlakha, S. (2021). Digital Assistant with Augmented Reality. In: Tuba, M., Akashe, S., Joshi, A. (eds) ICT Systems and Sustainability. Advances in Intelligent Systems and Computing, vol 1270. Springer, Singapore. https://doi.org/10.1007/978-981-15-8289-9_38
Download citation
DOI: https://doi.org/10.1007/978-981-15-8289-9_38
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8288-2
Online ISBN: 978-981-15-8289-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)