Designing Federated Architectures for Multimodal Interface Design and Human Computer Interaction in Virtual Environments
Advances in 3D immersive environments offer great potential for collaboration in circumstances that rely heavily on 3D visual models for collaboration, coordination, and data visualization (e.g., construction, medical, architecture). As existing platforms quickly evolve, become more widespread, and research aims to validate the benefits of AR/VR over more traditional platforms, user-centered approaches become more important, especially when supporting multiple users in 3D immersive environments. This article discusses our experience designing an adaptable, non-domain-specific, federated architecture for multimodal systems and virtual environments based on Human Factors and Human Computer Interaction methodologies.
KeywordsHuman Factors Multimodal interaction Human centered design Virtual and augmented reality Cognitive Systems Engineering
- 1.Nasir, S., Zahid, M., Khan, T., Kadir, K., Khan, S.: Augmented reality application for architects and interior designers: Interno a cost effective solution. In: 2018 IEEE 5th International Conference on Smart Instrumentation, Measurement and Application (ICSIMA) (2018)Google Scholar
- 2.Lim, C., Pan, Y., Lee, J.: Human factors and design issues in multimodal (speech/gesture) interface. JDCTA 2, 67–77 (2008)Google Scholar
- 3.Bisantz, A., Burns, C.: Applications of Cognitive Work Analysis. CRC Press, Boca Raton (2009)Google Scholar
- 4.Bonetti, F., Pantano, E., Warnaby, G., Quinn, L., Perry, P.: Augmented reality in real stores: empirical evidence from consumers’ interaction with AR in a retail format. Augmented Reality Virtual Reality, 3–16 (2019)Google Scholar
- 6.Brudy, F., Holz, C., Rädle, R., Wu, C., Houben, S., Klokmose, C., Marquardt, N.: Cross-device taxonomy: survey, opportunities and challenges of interactions spanning across multiple devices. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI 2019 (2019)Google Scholar