Behavior Research Methods

, Volume 39, Issue 4, pp 824–834 | Cite as

Computer-based automatic finger- and speech-tracking system

  • Björn BreidegardEmail author


This article presents the first technology ever for online registration and interactive and automatic analysis of finger movements during tactile reading (Braille and tactile pictures). Interactive software has been developed for registration (with two cameras and a microphone), MPEG-2 video compression and storage on disk or DVD as well as an interactive analysis program to aid human analysis. An automatic finger-tracking system has been implemented which also semiautomatically tracks the reading aloud speech on the syllable level. This set of tools opens the way for large scale studies of blind people reading Braille or tactile images. It has been tested in a pilot project involving congenitally blind subjects reading texts and pictures.


Index Finger Oral Reading Plain Text Left Index Finger Whitening Effect 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. Becchetti, C., &Ricotti, L. P. (1999).Speech recognition: Theory and C ++implementation. New York: Wiley.Google Scholar
  2. Bertelson, P., Mousty, P., &D’Alimonte, G. (1985). A study of Braille reading: II. Patterns of hand activity in one-handed and twohanded reading.Quarterly Journal of Experimental Psychology,37A, 235–256.PubMedGoogle Scholar
  3. Breidegard, B., Eriksson, Y., Fellenius, K., Jönsson, B., Holmqvist, K., & Strömqvist, S. (in press). Enlightened: The art of finger reading.Studia Linguistica.Google Scholar
  4. Breidegard, B., Fellenius, K., Jönsson, B., &Strömqvist, S. (2006). Disclosing the secrets of braille reading: Computer aided registration and interactive analysis.Visual Impairment Research,3, 49–59.CrossRefGoogle Scholar
  5. Brookner, E. (1998).Tracking and Kalman filtering made easy. New York: Wiley.CrossRefGoogle Scholar
  6. Kruglinski, D., Shepherd, G., &Wingo, S. (1998).Programming Visual C++. Redmond, WA: Microsoft Press.Google Scholar
  7. Linetsky, M. (2001).Programming Microsoft DirectShow. Plano, TX: Wordware Publishing.Google Scholar
  8. Millar, S. (1988). An apparatus for recording hand-movements.British Journal of Visual Impairment & Blindness,1, 87–103.CrossRefGoogle Scholar
  9. Millar, S. (1997).Reading by touch. London: Routledge.CrossRefGoogle Scholar
  10. Mousty, P., &Bertelson, P. (1985). A study of Braille reading: I. Reading speed as a function of hand usage and context.Quarterly Journal of Experimental Psychology,37A, 217–233.PubMedGoogle Scholar
  11. Paesce, M. (2003).Programming DirectShow for digital video, television and DVD. Redmond, WA: Microsoft Press.Google Scholar
  12. Wirth, N. (1971). Program development by stepwise refinement.Communications of the ACM (Vol. 14, pp. 221–227). New York: Association for Computing Machinery.Google Scholar

Copyright information

© Psychonomic Society, Inc. 2007

Authors and Affiliations

  1. 1.Department of Design SciencesLund UniversityLundSweden

Personalised recommendations