Abstract
Information graphics such as bar, line and pie charts appear frequently in electronic media and often contain information that is not found elsewhere in documents. Unfortunately, sight-impaired users have difficulty accessing and assimilating information graphics. Our goal is an interactive natural language system that provides effective access to information graphics for sight-impaired individuals. This paper describes how image processing has been applied to transform an information graphic into an XML representation that captures all aspects of the graphic that might be relevant to extracting knowledge from it. It discusses the problems that were encountered in analyzing and categorizing components of the graphic, and the algorithms and heuristics that were successfully applied. The resulting XML representation serves as input to an evidential reasoning component that hypothesizes the message that the graphic was intended to convey.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Meijer, P.: An Experimental System for Auditory Image Representations. IEEE Transactions on Biomedical Engineering 39, 291–300 (1992)
Kennel, A.: Audiograf: A diagram-reader for the blind. In: Proc. of the International Conference on Intelligent User Interfaces, pp. 51–56 (1996)
Yu, J., Hunter, J., Reiter, E., Sripada, S.: Recognising Visual Patterns to Communicate Gas Turbine Time-Series Data. In: ES 2002, pp. 105–118 (2002)
St. Amant, R., Riedl, M.: A Perception/Action Substrate for Cognitive Modeling in HCI. International Journal of Human-Computer Studies 55, 15–39 (2000)
Futrelle, R., Kakadiaris, I., Alexander, J., Futrelle, J., Carriero, C., Nikolakis, N.: Understanding Diagrams in Technical Documents. IEEE Computer 25, 75–78 (1992)
Futrelle, R., Nikolakis, N.: Diagram Analysis using Context-Based Constraint Grammars. Technical Report NC-CCS-96-01, College of Computer Science, Northeastern University (1996)
Futrelle, R.: Ambiguity in Visual Language Theory and its Role in Diagram Parsing. In: A Proceedings of the IEEE Symposium on Visual Languages, pp. 172–175 (1999)
Futrelle, R.: Summarization of Diagrams in Documents. In: Mani, I., Maybury, M. (eds.) Advances in Automated Text Summarization, pp. 403–421. MIT Press, Cambridge (1999)
Carberry, S., Elzer, S., Green, N., McCoy, K., Chester, D.: Understanding information graphics: a discourse-level problem. In: Proceedings of the Fourth SIGDial Workshop on Discourse and Dialogue, pp. 1–12 (2003)
Elzer, S., Green, N., Carberry, S., McCoy, K.: Extending plan inference techniques to recognize intentions in information graphics. In: Proceedings of the Nineth International Conference on user Modeling, pp. 122–132 (2003)
Carberry, S., Elzer, S., Green, N., McCoy, K., Chester, D.: Extending document summarization to information graphics. In: Proceedings of the ACL Workshop on Text Summarization (2004)
Elzer, S., Green, N., Carberry, S., Hoffman, J.: Incorporating perceptual task effort into the recognition of intention in information graphics. In: Blackwell, A.F., Marriott, K., Shimojima, A. (eds.) Diagrams 2004. LNCS (LNAI), vol. 2980, pp. 255–270. Springer, Heidelberg (2004)
Corio, M., Lapalme, G.: Generation of texts for information graphics. In: Proceedings of the 7th European Workshop on Natural Language Generation (EWNLG 1999), pp. 49–58 (1999)
Tan, C., Loo, P.: Word Extraction Using Irregular Pyramid. In: Kantora, P., Lopresti, D., Zhou, J. (eds.) Proceedings of SPIE– Document Recognition and Retrieval VIII, vol. 4307, pp. 363–371 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Chester, D., Elzer, S. (2005). Getting Computers to See Information Graphics So Users Do Not Have to. In: Hacid, MS., Murray, N.V., Raś, Z.W., Tsumoto, S. (eds) Foundations of Intelligent Systems. ISMIS 2005. Lecture Notes in Computer Science(), vol 3488. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11425274_68
Download citation
DOI: https://doi.org/10.1007/11425274_68
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25878-0
Online ISBN: 978-3-540-31949-8
eBook Packages: Computer ScienceComputer Science (R0)