Skip to main content
SpringerLink
Log in

A rule triggering system for automatic text-to-sign translation

  • Long Paper
  • Published:
Universal Access in the Information Society Aims and scope Submit manuscript

Abstract

The topic of this paper is machine translation (MT) from French text into French sign language (LSF). After arguing in favour of a rule-based method, it presents the architecture of an original MT system, built on two distinct efforts: formalising LSF production rules and triggering them with text processing. The former is made without any concern for text or translation and involves corpus analysis to link LSF form features to linguistic functions. It produces a set of production rules which may constitute a full LSF production grammar. The latter is an information extraction task from text, broken down in as many subtasks as there are rules in the grammar. After discussing this architecture, comparing it to the traditional methods and presenting the methodology for each task, the paper present the set of production rules found to govern event precedence and duration in LSF and gives a progress report on the implementation of the rule triggering system. With this proposal, it is also hoped to show how MT can benefit today from sign language processing.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. This was done manually in the work reported here.

  2. WebSourd® services contracted, www.websourd.org.

  3. EU-FP7 project (www.dictasign.eu) ended February 2012, corpus available for viewing at www.sign-lang.uni-hamburg.de/dicta-sign/portal.

  4. “Natural language processing”, used here in its traditional sense of “text processing”.

References

  1. Aït-Mokhtar, S., Chanod, J.P., Roux, C.: Robustness beyond shallowness: incremental deep parsing. Nat. Lang. Eng. 8, 121–144 (2002)

    Article  Google Scholar 

  2. Boitet, C.: Automated translation. Revue française de linguistique appliquée 8, 99–121 (2003). (in English)

    Google Scholar 

  3. Braffort, A., Filhol, M., Bolot, L., Delorme, M., Verrecchia, C., Choisier, A.: KAZOO: a sign language generation platform based on production rules. In: Proceedings of the Sign Language Translation and Avatar Technology Workshop (SLTAT) (2013)

  4. Cuxac, C.: Langue des signes française, les voies de l’iconicité, vols. 15–16. Ophrys, Paris (2000)

  5. Dandapat, S., Morrissey, S., Way, A., Forcada, M.L.: Using example-based MT to support statistical MT when translating homogeneous data in a resource-poor setting. In: 15th Annual Meeting of the European Association for Machine Translation (2011)

  6. Filhol, M.: Combining two synchronisation methods in a linguistic model to describe sign language. In: Gesture and Sign Language in Human–Computer Interaction and Embodied Communication. Lecture Notes in Computer Science (LNCS), vol. 7206. Springer, Berlin (2012)

  7. Filhol, M., Braffot, A.: DictaSign Deliverable D4.2: Report on the Linguistic Structures Modelled for the Sign Wiki. DictaSign Project, EU-FP7 (2010)

  8. Filhol, M., Tannier, X.: Construction of a French-LSF corpus. In: Language Resources and Evaluation Conference, Building and Using Comparable Corpora, Iceland (2014)

  9. Glauert, J., et al.: DictaSign Deliverable D7.3: Sign Wiki Prototype (2012). http://www.dictasign.eu

  10. Hanke, T., et al.: ViSiCAST Deliverable D5-1: Interface Definitions (2002). http://www.visicast.cmp.uea.ac.uk

  11. Huenerfauth, M.: Generating American Sign Language Classifier Predicates for English-to-ASL Machine Translation. Ph.D. discussion, University of Pennsylvania (2006)

  12. Marshall, I., Sáfár, É.: Sign language generation in an ALE HPSG. In: Proceedings of the HPSG04 (2004)

  13. Morrissey, S.: Data-Driven Machine Translation for Sign Languages. Ph.D. discussion, Dublin City University (2008)

  14. Papineni, K., Roukos, S., Ward, T., Zhu, W.J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the ACL (2002)

  15. Rosset, S., Galibert, O., Bernard, G., Bilinski, E., Adda, G.: The LIMSI participation to the QAst track. In: Working Notes of CLEF Workshop (2008)

  16. San-Segundo, R., Barra, R., Córdoba, R., D’Haro, L.F., Fernández, F., Ferreiros, J., Lucas, J.M., Macías-Guarasa, J., Montero, J.M., Pardo, J.M.: Speech to sign language translation system for spanish. Speech Commun. 50, 11–12 (2008)

    Article  Google Scholar 

  17. Schmid, H.: TreeTagger. http://www.cis.uni-muenchen.de/~schmid/tools/TreeTagger

  18. Stein, D., Schmidt, C., Ney, H.: Analysis, preparation, and optimization of statistical sign language machine translation. Mach. Transl. 26(4), 325–357 (2012)

    Article  Google Scholar 

  19. Stokoe, W.: Sign language structure: an outline of the visual communication system of the American deaf. J. Deaf. Stud. Deaf. Educ. 10(1), 3–37 (1960)

    Article  Google Scholar 

  20. Veale, T., Conway, A., Collins, B.: The challenges of cross-modal translation: english to sign language translation in the ZARDOZ system. Mach. Transl. 13 (1998)

  21. Vertan, C., Karagiozov, D.: Deliverable D6.1: Machine Translation in Atlas (2012). http://www.atlas.polito.it/

  22. Wu, C.H., Su, H.Y., Chiu, Y.H., Linal, C.H.: Transfer-based statistical translation of Taiwanese sign language using PCFG. In: ACM Transactions on Asian Language Information Processing (TALIP) (2007)

  23. Zhao, L., Kipper, K., Schuler, W., Vogler, C., Badler, N., Palmer, M.: A machine translation system from English to American sign language. In: White J.S. (ed.) Envisioning Machine Translation in the Information Future. Lecture Notes in Computer Science, vol. 1934, pp. 54–67. Springer, Berlin, Heidelberg (2000)

Download references

Author information

Authors and Affiliations

  1. LIMSI, CNRS, Rue John Von Neumann, bât. 508, 91400, Orsay, France

    Michael Filhol, Mohamed N. Hadjadj & Benoît Testu

  2. Université Paris sud, Campus d’Orsay, 91400, Orsay, France

    Mohamed N. Hadjadj & Benoît Testu

Authors
  1. Michael Filhol
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohamed N. Hadjadj
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Benoît Testu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael Filhol.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Filhol, M., Hadjadj, M.N. & Testu, B. A rule triggering system for automatic text-to-sign translation. Univ Access Inf Soc 15, 487–498 (2016). https://doi.org/10.1007/s10209-015-0413-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10209-015-0413-4

Keywords

Search

Navigation