Abstract
Facilitating general access to data from sensor networks (including traffic, hydrology and other domains) increases their utility. In this paper we argue that the journalistic metaphor can be effectively used to automatically generate multimedia presentations that help non-expert users analyze and understand sensor data. The journalistic layout and style are familiar to most users. Furthermore, the journalistic approach of ordering information from most general to most specific helps users obtain a high-level understanding while providing them the freedom to choose the depth of analysis to which they want to go. We describe the general characteristics and architectural requirements for an interactive intelligent user interface for exploring sensor data that uses the journalistic metaphor. We also describe our experience in developing this interface in real-world domains (e.g., hydrology).
Chapter PDF
References
André, E.: The generation of multimedia presentations. In: Dale, R., Moisl, H., Somers, H. (eds.) A Handbook of Natural Language Processing: Techniques and Applications for the Processing of Language as Text, pp. 305–327. Marcel Dekker Inc., New York (2000)
André, E., Rist, T.: The design of illustrated documents as a planning task. In: Maybury, M. (ed.) Intelligent Multimedia Interfaces, pp. 94–116. AAAI Press, Menlo Park (1993)
Bateman, J., Kleinz, J., Kamps, T., Reichenberger, K.: Towards Constructive Text, Diagram, and Layout Generation for Information Presentation. Computational Linguistics 27(3) (2001)
Barbosa, L., Feng, J.: Robust sentiment detection on Twitter from biased and noisy data. In: 23rd International Conference on Computational Linguistics, COLING (2010)
Card, S.K., Mackinlay, J.D., Shneiderman, B. (eds.): Readings in Information Visualization – Using Vision to Think. Morgan Kaufmann, San Francisco (1999)
Carenini, G., Moore, J.: A strategy for generating evaluative arguments. In: First Int’l Conf. on Natural Language Generation (2000)
Demberg, V., Moore, J.: Information presentation in spoken dialogue systems. In: 11th Conf. European Chapter of the Association for Computational Linguistics (2006)
Falb, J., Kavaldjian, S., Popp, R., Raneburger, D., Arnautovic, E., Kaindl, H.: Fully automatic user interface generation from discourse models. In: 14th International Conference on Intelligent User Interfaces (2009)
Green, N., Carenini, G., Kerpedjiev, S., Mattis, J., Moore, J., Roth, S.: AutoBrief: an Experimental System for the Automatic Generation of Briefings in Integrated Text and Information Graphics. International Journal of Human-Computer Studies 61(1), 32–70 (2004)
Hunter, J., Gatt, A., Portet, F., Reiter, E., Sripada, S.: Using natural language generation technology to improve information flows in intensive care units. In: 5th Conf. on Prestigious Applications of Intelligent Systems (2008)
Keim, D.A.: Information visualization and visual data mining. IEEE Trans. on Visualization & Computer Graphics 8(1), 1–8 (2002)
Kopp, S., Tepper, P., Cassell, J.: Towards integrated microplanning of language and iconic gesture for multimodal output. In: 6th Int. Conference on Multimodal Interfaces (2004)
Mann, W., Thompson, S.: Rhetorical Structure Theory: Toward a functional theory of text organization. Text 8(3), 243–281 (1988)
McKeown, K.R., Feiner, S.K.: Interactive multimedia explanation for equipment maintenance and repair. In: DARPA Speech and Language Workshop (1990)
Molina, M., Parodi, E., Stent, A.: Combining text and graphics for interactive exploration of behaviour datasets. In: 22nd Int. Conference on Tools with Artificial Intelligence (2010)
Molina, M., Flores, V.: A presentation model for multimedia summaries of behavior. In: 13th International Conference on Intelligent User Interfaces (2008)
Molina, M., Stent, A.: A knowledge-based method for generating summaries of spatial movement in geographic areas. International Journal on Artificial Intelligence Tools 19(4), 393–415 (2010)
Obis-Seamap, http://seamap.env.duke.edu/
Radev, D.R., Otterbacher, J., Winkel, A., Blair-Goldensohn, S.: NewsInEssence: Summarizing online news topics. Communications of the ACM 48(10), 95–98 (2005)
Reiter, E., Dale, R.: Building Natural Language Generation Systems. Cambridge University Press, Cambridge (2000)
Reiter, E., Sripada, S., Hunter, J., Yu, J., Davy, I.: Choosing words in computer-generated weather forecasts. Artificial Intelligence 67(1-2), 137–169 (2005)
UCR, Uniform Crime Reports, http://www.fbi.gov/ucr/ucr.htm
VOSclim, http://www.ncdc.noaa.gov/oa/climate/vosclim/vosclim.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 IFIP International Federation for Information Processing
About this paper
Cite this paper
Molina, M., Parodi, E., Stent, A. (2011). Using the Journalistic Metaphor to Design User Interfaces That Explain Sensor Data. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2011. INTERACT 2011. Lecture Notes in Computer Science, vol 6948. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23765-2_43
Download citation
DOI: https://doi.org/10.1007/978-3-642-23765-2_43
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23764-5
Online ISBN: 978-3-642-23765-2
eBook Packages: Computer ScienceComputer Science (R0)