Skip to main content
SpringerLink
Log in

Event Recognition during the Exploration of Line-Based Graphics in Virtual Haptic Environments

  • Conference paper
Spatial Information Theory (COSIT 2013)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8116))

Included in the following conference series:

  • 2380 Accesses

Abstract

Pictorial representations are widely used in human problem solving. For blind and visually impaired people, haptic interfaces can provide perceptual access to graphical representations. We propose line-based graphics as a type of graphics, which are suitable to be explored by blind and visually impaired people, and which can be successfully augmented with auditory assistance by speech or non-verbal sounds. The central prerequisite for realizing powerful assistive interaction is monitoring the users’ haptic exploration and in particular the recognition of exploratory events. The representational layers of line-based graphics as well as of exploration-event descriptions are specified by qualitative spatial propositions. Based on these representations, event recognition is performed by rule-based processes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Tversky, B.: Visualizing Thought. Topics in Cognitive Science 3, 499–535 (2011)

    Article  Google Scholar 

  2. De Felice, F., Renna, F., Attolico, G., Distante, A.: A Haptic/Acoustic Application to Allow Blind the Access to Spatial Information. In: World Haptics Conference, pp. 310–315 (2007)

    Google Scholar 

  3. Shimomura, Y., Hvannberg, E., Hafsteinsson, H.: Haptic cues as a utility to perceive and recognise geometry. Universal Access in the Information Society Online First, doi: 10.1007/s10209-012-0271-2

    Google Scholar 

  4. Sjöström, C., Danielsson, H., Magnusson, C., Rassmus-Gröhn, K.: Phantom-based Haptic Line Graphics for Blind Persons. Visual Impairment Research 5, 13–32 (2003)

    Article  Google Scholar 

  5. Yu, J., Habel, C.: A Haptic-Audio Interface for Acquiring Spatial Knowledge about Apartments. In: Magnusson, C., Szymczak, D., Brewster, S. (eds.) HAID 2012. LNCS, vol. 7468, pp. 21–30. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  6. Yu, W., Brewster, S.A.: Evaluation of Multimodal Graphs for Blind People. Journal of Universal Access in the Information Society 2, 105–124 (2003)

    Article  Google Scholar 

  7. Loomis, J., Klatzky, R., Lederman, S.: Similarity of Tactual and Visual Picture Recognition with Limited Field of View. Perception 20, 167–177 (1991)

    Article  Google Scholar 

  8. Beaudouin-Lafon, M.: Designing Interaction, not Interfaces. In: Proceedings of the Working Conference on Advanced Visual Interfaces, pp. 15–22. ACM (2004)

    Google Scholar 

  9. Lohmann, K., Habel, C.: Extended Verbal Assistance Facilitates Knowledge Acquisition of Virtual Tactile Maps. In: Stachniss, C., Schill, K., Uttal, D. (eds.) Spatial Cognition 2012. LNCS, vol. 7463, pp. 299–318. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  10. Lohmann, K., Kerzel, M., Habel, C.: Verbally Assisted Virtual-Environment Tactile Maps: A Prototype System. In: Proceedings of the Workshop on Spatial Knowledge Acquisition with Limited Information Displays, pp. 25–30 (2012)

    Google Scholar 

  11. Alaçam, Ö., Habel, C., Acartürk, C.: Towards Designing Audio Assistance for Comprehending Haptic Graphs: A Multimodal Perspective. In: Stephanidis, C. (ed.) UAHCI/HCII 2013, Part I. LNCS, vol. 8009, pp. 409–418. Springer, Heidelberg (2013)

    Google Scholar 

  12. Habel, C., Kerzel, M., Lohmann, K.: Verbal Assistance in Tactile-Map Explorations: A Case for Visual Representations and Reasoning. In: Proceedings of AAAI Workshop on Visual Representations and Reasoning 2010, pp. 34–41. AAAI, Menlo Park (2010)

    Google Scholar 

  13. Tversky, B.: Cognitive Maps, Cognitive Collages, and Spatial Mental Models. In: Campari, I., Frank, A.U. (eds.) COSIT 1993. LNCS, vol. 716, pp. 14–24. Springer, Heidelberg (1993)

    Google Scholar 

  14. Tversky, B., Zacks, J., Lee, P., Heiser, J.: Lines, Blobs, Crosses and Arrows: Diagrammatic Communication with Schematic Figures. In: Anderson, M., Cheng, P., Haarslev, V. (eds.) Diagrams 2000. LNCS (LNAI), vol. 1889, pp. 221–230. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  15. Giudice, N.A., Palani, H., Brenner, E., Kramer, K.M.: Learning Non-Visual Graphic Information using a Touch-Based Vibro-Audio Interface. In: Proceedings 14th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 103–110. ACM (2012)

    Google Scholar 

  16. Parkes, D.: NOMAD - An Audio-Tactile Tool for the Acquisition, Use and Management of Spatially Distributed Information by Partially Sighted and Blind People. In: Tatham, A., Dodds, A. (eds.) Proceedings of the 2nd International Conference on Maps and Graphics for Visually Disabled People, pp. 24–29. King’s College, London (1988)

    Google Scholar 

  17. Moustakas, K., Nikolakis, G., Kostopoulos, K., Tzovaras, D., Strintzis, M.G.: Haptic Rendering of Visual Data for the Visually Impaired. IEEE Multimedia 14, 62–72 (2007)

    Article  Google Scholar 

  18. Wang, Z., Li, B., Hedgpeth, T., Haven, T.: Instant Tactile-Audio Map: Enabling Access to Digital Maps for People with Visual Impairment. In: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 43–50. ACM, Pittsburg (2009)

    Google Scholar 

  19. Lederman, S.J., Klatzky, R.L.: Haptic Perception: A Tutorial. Attention, Perception, and Psychophysics 71, 1439–1459 (2009)

    Article  Google Scholar 

  20. Allen, J.: Maintaining Knowledge about Temporal Intervals. Communication of the ACM 26, 832–843 (1983)

    Article  MATH  Google Scholar 

  21. Eschenbach, C., Kulik, L.: An Axiomatic Approach to the Spatial Relations Underlying ‘left’–‘right’ and ‘in front of’–‘behind’. In: Brewka, G., Habel, C., Nebel, B. (eds.) KI 1997. LNCS (LNAI), vol. 1303, pp. 207–218. Springer, Heidelberg (1997)

    Chapter  Google Scholar 

  22. Eschenbach, C., Habel, C., Kulik, L.: Representing Simple Trajectories as Oriented Curves. In: Kumar, A.N., Russell, I. (eds.) FLAIRS 1999, Proceedings 12th International Florida AI Research Society Conference, pp. 431–436. AAAI, Menlo Park (1999)

    Google Scholar 

  23. Habel, C.: Representational Commitment in Maps. In: Duckham, M., Goodchild, M., Worboys, M. (eds.) Foundations of Geographic Information Science, pp. 69–93. Taylor & Francis, London (2003)

    Chapter  Google Scholar 

  24. Klippel, A.: Wayfinding Choremes. In: Kuhn, W., Worboys, M.F., Timpf, S. (eds.) COSIT 2003. LNCS, vol. 2825, pp. 301–315. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  25. Reiter, R., Mackworth, A.: A Logical Framework for Depiction and Image Interpretation. Artificial Intelligence 41, 125–155 (1989)

    Article  MathSciNet  MATH  Google Scholar 

  26. Pfoser, D., Jensen, C.: Indexing of Network Constrained Moving Objects. In: Proceedings of the 11th ACM International Symposium on Advances in Geographic Information Systems, pp. 25–32. ACM (2003)

    Google Scholar 

  27. Shipley, T., Maguire, M.: Geometric Information for Event Segmentation. Understanding Events: How Humans See, Represent, and Act on Events. In: Shipley, T.F., Zacks, J.M. (eds.) Understanding Events: How Humans See, Represent, and Act on Events, pp. 415–435. Oxford University Press, New York (2008)

    Google Scholar 

  28. Luckham, D.C.: The Power of Events: An Introduction to Complex Event Processing in Distributed Enterprise Systems. Addison-Wesley, Reading (2002)

    Google Scholar 

  29. Eckert, M., Bry, F.: Complex Event Processing (cep). In: Informatik-Spektrum 32, pp. 163–167 (2009)

    Google Scholar 

  30. Hayes-Roth, F.: Rule-Based Systems. Communications of the ACM 28, 921–932 (1985)

    Article  Google Scholar 

  31. Anderson, J.R.: ACT: A Simple Theory of Complex Cognition. American Psychologist 51, 355–365 (1996)

    Article  Google Scholar 

  32. Forgy, C.L.: Rete: A Fast Algorithm for the Many Pattern/Many Object Pattern Match Problem. Artificial Intelligence 19, 17–37 (1982)

    Article  Google Scholar 

  33. Walzer, K., Breddin, T., Groch, M.: Relative Temporal Constraints in the Rete Algorithm for Complex Event Detection. In: Proceedings of the Second International Conference on Distributed Event-Based Systems, pp. 147–155. ACM (2008)

    Google Scholar 

  34. Kerzel, M.: Rule Patterns for Event Recognition During Exploration of Hapic Virtual Environment Line-based Graphics. Technical Report, Department of Informatics, University of Hamburg, Germany (2013)

    Google Scholar 

  35. Mackworth, A.K.: Adequacy Criteria for Visual Knowledge Representation. In: Pylyshyn, Z. (ed.) Computational Processes in Human Vision, pp. 464–476. Ablex Publishers, Norwood (1988)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Informatics, University of Hamburg, D-22527, Hamburg, Germany

    Matthias Kerzel & Christopher Habel

Authors
  1. Matthias Kerzel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christopher Habel
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Linguistics & English Language, Bangor University, College Road, LL57 2DG, Bangor, UK

    Thora Tenbrink

  2. School of Computing, University of Leeds, Woodhouse Lane, LS2 9JT, Leeds, UK

    John Stell

  3. College of Engineering, Mathematics and Physical Sciences, University of Exeter, Harrison Building, North Park Road, EX4 4QF, Exeter, UK

    Antony Galton  & Zena Wood  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer International Publishing Switzerland

About this paper

Cite this paper

Kerzel, M., Habel, C. (2013). Event Recognition during the Exploration of Line-Based Graphics in Virtual Haptic Environments. In: Tenbrink, T., Stell, J., Galton, A., Wood, Z. (eds) Spatial Information Theory. COSIT 2013. Lecture Notes in Computer Science, vol 8116. Springer, Cham. https://doi.org/10.1007/978-3-319-01790-7_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-01790-7_7

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-01789-1

  • Online ISBN: 978-3-319-01790-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation