Abstract
Gaming environments are applications that have the great potential to increase people engagement in a participatory and collaborative way. Players interact with games under various situations, where the content, the form, and the modalities will be manipulated to fit the player’s behaviours. This paper provides a multimodal environment for gaming by using a grammar-based approach for supporting the interaction process in the application scenario of scope card game, instantiating grammar by the elements and the rules of the game. Moreover, the paper focuses on the correct interpretation of the player’s input during the game by the use of a HMM-based approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Crawford, C.: Lessons from Computer Game Design. In: Laurel, B. (ed.) The Art of Human-Computer Interface Design, pp. 103–111. Addison-Wesley Pub. Co., Reading (1990)
Caschera, M.C., Ferri, F., Grifoni, P.: Multimodal interaction systems: information and time features. International Journal of Web and Grid Services (IJWGS) 3(1), 82–99 (2007)
Zyda, M., et al.: Educating the Next Generation of Mobile Game Developers. IEEE Computer Graphics and Applications 27(2), 96, 92–95 (2007)
Piekarski, W., Thomas, B.: ARQuake: The Outdoor Augmented Reality Gaming System. Communications of the ACM 45(1), 36–38 (2002)
iPhone, http://www.apple.com/iphone
Magerkurth, C., Stenzel, R., Streitz, N., Neuhold, E.: 2003. A multimodal interaction framework for pervasive game applications. Artificial Intelligence in Mobile System (Aims), Fraunhofer Ipsi (2003)
Tse, E., Greenberg, S., Shen, C., Forlines, C.: Multimodal multiplayer tabletop gaming. ACM Comput. Entertaint. 5(2), Article 12, 12 pages (2007), http://doi.acm.org/10.1145/1279540.1279552 , doi:10.1145/1279540.1279552
Gruenstein, A.: Shape game: A multimodal game featuring incremental understanding. Term project, Massachusetts Institute of Technology (May 2007)
D’Ulizia, A.: Exploring Multimodal Input Fusion Strategies. In: The Handbook of Research on Multimodal Human Computer Interaction and Pervasive Services: Evolutionary Techniques for Improving Accessibility, pp. 34–57. IGI Publishing (2009)
Caschera, M.C.: Interpretation methods and ambiguity management in multimodal systems. In: Grifoni, P. (ed.) Handbook of Research on Multimodal Human Computer Interaction and Pervasive Services: Evolutionary Techniques for Improving Accessibility, pp. 87–102. IGI Global, USA (2009)
D’Ulizia, A., Ferri, F., Grifoni, P.: Generating Multimodal Grammars for Multimodal Dialogue Processing. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 40(6), 1130–1145 (2010)
Caschera, M.C., Ferri, F., Grifoni, P.: InteSe: An Integrated Model for Resolving Ambiguities in Multimodal Sentences. IEEE Transactions on Systems, Man, and Cybernetics: Systems 43(4), 911–931 (2013)
Mitchell, P.M., Santorini, B., Marcinkiewicz, M.A.: Building a large annotated corpus of English: The penn treebank. Comput. Linguistics 19(2), 313–330 (1994)
D’Ulizia, A., Ferri, F., Grifoni, P.: A Learning Algorithm for Multimodal Grammar Inference. EEE Transactions on Systems, Man, and Cybernetics, Part B 41(6), 1495–1510 (2011)
Oliver, N., Garg, A., Horvitz, E.: Layered representations for learning and inferring office activity from multiple sensory channels. Computer Vision and Image Understanding 96(2), 163–180 (2004)
Fine, S., Singer, Y., Tishby, N.: The hierarchical hidden Markov model: Analysis and applications. Machine Learning 32(1), 41–62 (1998)
Skounakis, M., Craven, M., Ray, S.: Hierarchical hidden Markov models for information extraction. In: Proc. of the 18th Int. Joint Conference on Artificial Intelligence, Acapulco, Mexico, pp. 427–433. Morgan Kaufmann, San Francisco (2003)
Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. of the IEEE 77, 257–285 (1989)
Fine, S., Singer, Y., Tishby, N.: The hierarchical hidden Markov model: Analysis and applications. Machine Learning 32(1), 41–62 (1998)
He, J., Hu, S., Tan, J.: Layered hidden Markov models for real-time daily activity monitoring using body sensor networks. In: Int. Workshop Wearable and Implantable Body Sensor Network, Hong Kong, China (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Caschera, M.C., D’Ulizia, A., Ferri, F., Grifoni, P. (2013). Multimodal Interaction in Gaming. In: Demey, Y.T., Panetto, H. (eds) On the Move to Meaningful Internet Systems: OTM 2013 Workshops. OTM 2013. Lecture Notes in Computer Science, vol 8186. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41033-8_87
Download citation
DOI: https://doi.org/10.1007/978-3-642-41033-8_87
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41032-1
Online ISBN: 978-3-642-41033-8
eBook Packages: Computer ScienceComputer Science (R0)