Abstract
Given recent technological advancements in mobile devices, military research initiatives are investigating these devices as a means to support multimodal cooperative interactions. Military components are executing dynamic combat and humanitarian missions while dismounted and on the move. Paramount to their success is timely and effective information sharing and mission planning to enact more effective actions. In this paper, we describe a prototype multimodal collaborative Android application. The mobile application was designed to support real-time battlefield perspective, acquisition, and dissemination of information among distributed operators. The prototype application was demonstrated in a scenario where teammates utilize different features of the software to collaboratively identify and deploy a virtual tracker-type device on hostile entities. Results showed significant improvements in completion times when users visually shared their perspectives versus relying on verbal descriptors. Additionally, the use of shared video significantly reduced the required utterances to complete the task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Kraut, R.E., Fussell, S.R., Seigel, J.: Visual Information as a Conversational Resource in Collaborative Physical Tasks. Human Computer Interaction 18, 13–49
Clark, H., Wilkes-Gibbs, D.: Referring as a Collaborative Process. Cognition 22, 1–39 (1986)
Brehmer, B.: Dynamic Decision Making: Human Control of Complex Systems. Acta Psychologies 81(3), 211–241 (1992)
Kuzuoka, H., Kosuge, T., Tanaka, K.: GestureCam: A Video Communication System for Sympathetic Remote Collaboration. In: CSCW 1994, pp. 35–45. ACM Press, New York (1994)
Fussel, S.R., Kraut, R.E., Siegel, J.: Coordination of Communication: Effects of Shared Visual Context on Collaborative Work. In: CSCW 2000, Philadelphia, PA (2000)
Ou, J., Fussell, S.R., Chen, X., Setlock, L.D., Yang, J.: Gestural Communication over Video Stream: Supporting Multimodal Interaction for Remote Colloborative Physical Tasks. In: International Conference on Multimodal Interfaces. ACM Press, Vancouver (2003)
Stevenson, D., Li, J., Smith, J., Hutchins, M.: A Collaborative Guidance Case Study. In: AUIC 2008, Wollongong, NSW, Australia (2008)
Kraut, R.E., Darren, G., Fussell, S.R.: The Use of Visual Information in Shared Visual Co-Presence. In: CSCW 2002, New Orleans (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Burnett, G.M., Wischgoll, T., Finomore, V., Calvo, A. (2013). Multimodal Mobile Collaboration Prototype Used in a Find, Fix, and Tag Scenario. In: Uhler, D., Mehta, K., Wong, J.L. (eds) Mobile Computing, Applications, and Services. MobiCASE 2012. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 110. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-36632-1_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-36632-1_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-36631-4
Online ISBN: 978-3-642-36632-1
eBook Packages: Computer ScienceComputer Science (R0)