Skip to main content

Helping People with Visual Impairments Gain Access to Graphical Information Through Natural Language: The iGraph System

  • Conference paper
Computers Helping People with Special Needs (ICCHP 2006)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4061))

Included in the following conference series:

Abstract

Much numerical information is visualized in graphs. However, this is a medium that is problematic for people with visual impairments. We have developed a system called iGraph which provides short verbal descriptions of the information usually depicted in graphs. This system was used as a preliminary solution that was validated through a process of User Needs Analysis (UNA). This process provided some basic data on the needs of people with visual impairments in terms of the components and the language to be used for graph comprehension and also validated our initial approach. The UNA provided important directions for the further development of iGraph particularly in terms of interactive querying of graphs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Shah, P., Carpenter, P.A.: Conceptual limitations in comprehending line graphs. Journal of Experimental Psychology: General 124(1), 43–61 (1995)

    Article  Google Scholar 

  2. Bertin, J.: Semiology of Graphics. The University of Wisconsin Press, Madison (1983)

    Google Scholar 

  3. Carpenter, P., Shah, P.: A model of the perceptual and conceptual processes in graph comprehension. Journal of Experimental Psychology: Applied, 4, 75–100 (1998)

    Article  Google Scholar 

  4. Pinker, S.: A theory of graph comprehension. In: Freedle, R. (ed.) Artificial intelligence and the future of testing, pp. 73–126. Lawrence Erlbaum, Hillsdale (1990)

    Google Scholar 

  5. Trickett, S.B., Ratwani, R.M., Trafton, J.G.: Real-world graph comprehension: High-level questions, complex graphs, and spatial cognition (under review)

    Google Scholar 

  6. Kosslyn, S.: Understanding charts and graphs. Applied Cognitive Psychology 3, 185–226 (1989)

    Article  Google Scholar 

  7. Lohse, J.: A cognitive model for the perception and understanding of graphs. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 137–144. ACM Press, New York (1991)

    Google Scholar 

  8. Foster, M.: Evaluating models of visual comprehension. In: Proceedings of EuroCogsci 2003 (2003)

    Google Scholar 

  9. Flowers, J.H., Hauer, T.A.: The ear’s versus the eye’s potential to assess characteristics of numeric data: Are we too visuocentric? Behavior Research Methods, Instruments, & Computers 24(2), 258–264 (1992)

    Article  Google Scholar 

  10. Flowers, J.H.: Thirteen years of reflection on auditory graphing: Promises, pitfalls, and potential new directions. In: Proceedings of ICAD 2005-Eleventh Meeting of the International Conference on Auditory Display (2005)

    Google Scholar 

  11. Brown, L., Brewster, S., Ramloll, R., Burton, M., Riedel, B.: Design guidelines for audio presentation of graphs and tables. In: Proceedings of ICAD 2003 Workshop on Auditory Displays In Assistive Technologies, University of Boston (2003)

    Google Scholar 

  12. McCoy, K.F., Carberry, M.S., Roper, T., Green, N.: Towards generating textual summaries of graphs. In: Proceedings of the 1st International Conference on Universal Access in Human-Computer Interaction, ACM Press, New York (2001)

    Google Scholar 

  13. Fasciano, M., Lapalme, G.: Postgraphe: a system for the generation of statistical graphics and text. In: Proceedings of the 8th International Workshop on Natural Language Generation (INLG 1996) (1996)

    Google Scholar 

  14. Corio, M., Lapalme, G.: Generation of texts for information graphics. In: Saint-Dizier, P. (ed.) Proceedings of the 7th. European Workshop on Natural Language Generation (EWNLG 1999), Toulouse, pp. 49–58 (1999)

    Google Scholar 

  15. Fasciano, M., Lapalme, G.: Intentions in the coordinated generation of graphics and text from tabular data. Knowl. Inf. Syst. 2(3), 310–339 (2000)

    Article  MATH  Google Scholar 

  16. Mittal, V.O., Carenini, G., Moore, J.D., Roth, S.: Describing complex charts in natural language: a caption generation system. Computational Linguistics 24(3), 431–467 (1998)

    Google Scholar 

  17. Kerpedjiev, S.M.: Automatic generation of multimodal weather reports from datasets. In: Proceedings of the third conference on Applied natural language processing, pp. 48–55. Association for Computational Linguistics (1992)

    Google Scholar 

  18. Goldberg, E., Driedger, N., Kittredge, R.: Using natural-language processing to produce weather forecasts. IEEE Expert 9, 45–53 (1994)

    Article  Google Scholar 

  19. Reiter, E., Dale, R.: Building applied natural language generation systems. Journal of Natural Language Engineering 3(1), 57–87 (1997)

    Article  Google Scholar 

  20. Reiter, E., Dale, R.: Building natural language generation systems. Cambridge University Press, Cambridge (2000)

    Book  Google Scholar 

  21. Yu, J., Reiter, E., Hunter, J., Sripada, S.: A new architecture for summarising time series data. In: Proceedings of INLG 2004 Poster Session, pp. 47–50 (2004)

    Google Scholar 

  22. Yu, J., Reiter, E., Hunter, J., Sripada, S.: Sumtime-turbine: A knowledge-based system to communicate time series data in the gas turbine domain. In: Proceedings of IEA/AIE-2003, pp. 379–384 (2003)

    Google Scholar 

  23. Sripada, S., Reiter, E., Hunter, J., Yu, J.: Summarising neonatal time series data. In: Proceedings of 2003 Conference of the European Chapter of the Association for Computation Linguistics, Companion Volume, pp. 734–743 (2003)

    Google Scholar 

  24. Dahlbäck, N., Jönsson, A., Ahrenberg, L.: Wizard of oz studies – why and how. Knowledge-Based Systems 6(4), 258–266 (1993)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ferres, L., Parush, A., Roberts, S., Lindgaard, G. (2006). Helping People with Visual Impairments Gain Access to Graphical Information Through Natural Language: The iGraph System. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds) Computers Helping People with Special Needs. ICCHP 2006. Lecture Notes in Computer Science, vol 4061. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11788713_163

Download citation

  • DOI: https://doi.org/10.1007/11788713_163

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-36020-9

  • Online ISBN: 978-3-540-36021-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics