Abstract
Recent years have seen an explosion in the academic and commercial applications of digital assistants. These technologies have become increasingly prolific, and their use has resulted in fairly rigid and standardized techniques for achieving a desired result. Whether this includes physical actions, or direct voice queries to the system via pre-defined wake words and queries, there is a stark boundary between the human and the system. We aim to explore a shift in the paradigm of these current implementations, to that of an Ambient Intelligent (AmI) environment in which users can interface with the system in a more natural, seamless, and multi-modal manner. Applications of this type of technology range from assisted living, to smart conference rooms and meeting spaces. In this paper we introduce an architectural framework for building an ambient intelligent platform using a combination of video and audio sensors to capture and process the data in a given area of interest.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Augusto, J.C.: Ambient intelligence: the confluence of ubiquitous/pervasive computing and artificial intelligence. In: Schuster, A.J. (ed.) Intelligent Computing Everywhere, pp. 213–234. Springer, London (2007). https://doi.org/10.1007/978-1-84628-943-9_11
Augusto, J.C., Callaghan, V., Cook, D., Kameas, A., Satoh, I.: Intelligent environments: a manifesto. Hum. Cent. Comput. Inf. Sci. 3(1), 1–18 (2013). https://doi.org/10.1186/2192-1962-3-12
Bagchi, S., Wynter, L.: Method for a natural language question-answering system to complement decision-support in a real-time command center. US Patent 8,601,030, 3 December 2013
Cao, Q., Shen, L., Xie, W., Parkhi, O.M., Zisserman, A.: Vggface2: a dataset for recognising faces across pose and age. CoRR abs/1710.08092 (2017). http://arxiv.org/abs/1710.08092
Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., Sheikh, Y.: OpenPose: realtime multi-person 2D pose estimation using Part Affinity Fields. arXiv preprint arXiv:1812.08008 (2018)
Chung, J.S., Nagrani, A., Zisserman, A.: Voxceleb2: deep speaker recognition. CoRR abs/1806.05622 (2018). http://arxiv.org/abs/1806.05622
Coen, M.H., et al.: Design principles for intelligent environments. In: AAAI/IAAI, pp. 547–554 (1998)
Cook, D.J., Augusto, J.C., Jakkula, V.R.: Ambient intelligence: technologies, applications, and opportunities. Pervasive Mob. Comput. 5(4), 277–298 (2009). https://doi.org/10.1016/j.pmcj.2009.04.001. http://www.sciencedirect.com/science/article/pii/S157411920900025X
Corno, F., De Russis, L.: Training engineers for the ambient intelligence challenge. IEEE Trans. Educ. 60(1), 40–49 (2017). https://doi.org/10.1109/TE.2016.2608785
Hannun, A.Y., et al.: Deep speech: scaling up end-to-end speech recognition. CoRR abs/1412.5567 (2014). http://arxiv.org/abs/1412.5567
Kleinberger, T., Becker, M., Ras, E., Holzinger, A., Müller, P.: Ambient intelligence in assisted living: enable elderly people to handle future interfaces. In: Stephanidis, C. (ed.) UAHCI 2007. LNCS, vol. 4555, pp. 103–112. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-73281-5_11
Lindwer, M., et al.: Ambient intelligence visions and achievements: linking abstract ideas to real-world concepts. In: 2003 Design, Automation and Test in Europe Conference and Exhibition, pp. 10–15, March 2003. https://doi.org/10.1109/DATE.2003.1253580
Noury, N.: Ambient intelligence might support increased longevity. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 1760–1764, August 2014. https://doi.org/10.1109/EMBC.2014.6943949
Ramos, C., Augusto, J.C., Shapiro, D.: Ambient intelligence–the next step for artificial intelligence. IEEE Intell. Syst. 23(2), 15–18 (2008). https://doi.org/10.1109/MIS.2008.19
Schroff, F., Kalenichenko, D., Philbin, J.: FaceNet: a unified embedding for face recognition and clustering. CoRR abs/1503.03832 (2015). http://arxiv.org/abs/1503.03832
Yachir, A., Amirat, Y., Chibani, A., Badache, N.: Event-aware framework for dynamic services discovery and selection in the context of ambient intelligence and internet of things. IEEE Trans. Autom. Sci. Eng. 13(1), 85–102 (2016). https://doi.org/10.1109/TASE.2015.2499792
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply
About this paper
Cite this paper
Bennett, J., Nguyen, P., Lucero, C., Lange, D. (2020). Towards an Ambient Intelligent Environment for Multimodal Human Computer Interactions. In: Streitz, N., Konomi, S. (eds) Distributed, Ambient and Pervasive Interactions. HCII 2020. Lecture Notes in Computer Science(), vol 12203. Springer, Cham. https://doi.org/10.1007/978-3-030-50344-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-50344-4_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50343-7
Online ISBN: 978-3-030-50344-4
eBook Packages: Computer ScienceComputer Science (R0)