A Sign Language Screen Reader for Deaf
Screen reader technology has appeared first to allow blind and people with reading difficulties to use computer and to access to the digital information. Until now, this technology is exploited mainly to help blind community. During our work with deaf people, we noticed that a screen reader can facilitate the manipulation of computers and the reading of textual information. In this paper, we propose a novel screen reader dedicated to deaf. The output of the reader is a visual translation of the text to sign language. The screen reader is composed by two essential modules: the first one is designed to capture the activities of users (mouse and keyboard events). For this purpose, we adopted Microsoft MSAA application programming interfaces. The second module, which is in classical screen readers a text to speech engine (TTS), is replaced by a novel text to sign (TTSign) engine. This module converts text into sign language animation based on avatar technology.
KeywordsScreen reader TTSing engine Deaf Avatar
Unable to display preview. Download preview PDF.
- 1.Blenkhorn, P., Evans, G.: Architecture and requirements for a Windows screen reader. In: Speech and Language Processing for Disabled and Elderly People (2000)Google Scholar
- 4.Jemni, M., El ghoul, O.: An avatar based approach for automatic interpretation of text to Sign language. In: 9th European Conference for the Advancement of the Assistive Technologies in Europe, San Sebastián, Spain (2007)Google Scholar
- 5.Jemni, M., El ghoul, O.: A System to Make Signs Using Collaborative Approach. In: International Conference on Computers Helping People with Special Needs, Linz, Austria, pp. 670–677 (2008)Google Scholar
- 6.Kaibel, A., Grote, K., Knoerzer, K., Sieprath, H., Florian, K.: Hypertext in sign language. In: 9th ERCIM Workshop "User Interfaces For All". Königswinter, Germany (2006)Google Scholar
- 7.Lazar, J., Allen, A., Kleinman, J., Malarkey, C.: What frustrates screen reader users on the web: A study of 100 blind users. International Journal of Human-Computer Interaction 22, 247–269 (2007)Google Scholar
- 8.Marschark, M., Harris, M.: Success and failure in learning to read: The special case of deaf children. In: Reading comprehension difficulties: Processes and intervention, pp. 279–300. Lawrence Erlbaum, Mahwah (1996)Google Scholar
- 10.Research Laboratory of technologies of Information and Communication, http://www.utic.rnu.tn
- 11.World Federation of the Deaf (WFD), Position Paper regarding the United Nations Convention on the Rights of People with Disabilities, Ad Hoc Committee on a Comprehensive and Integral International Convention on the Protection and Promotion of the Rights and Dignity of Persons with Disabilities (June 24, 2003)Google Scholar