Large Scale Inference of Deterministic Transductions: Tenjinno Problem 1
We discuss the problem of large scale grammatical inference in the context of the Tenjinno competition, with reference to the inference of deterministic finite state transducers, and discuss the design of the algorithms and the design and implementation of the program that solved the first problem. Though the OSTIA algorithm has good asymptotic guarantees for this class of problems, the amount of data required is prohibitive. We therefore developed a new strategy for inferring large scale transducers that is more adapted for large random instances of the type in question, which involved combining traditional state merging algorithms for inference of finite state automata with EM based alignment algorithms and state splitting algorithms.
KeywordsMachine Translation Expectation Maximisation Algorithm Input String State Automaton Input Language
Unable to display preview. Download preview PDF.
- 3.Carrasco, R.C., Oncina, J.: Learning stochastic regular grammars by means of a state merging method. In: Carrasco, R.C., Oncina, J. (eds.) ICGI 1994. LNCS (LNAI), vol. 862, pp. 139–152. Springer, Heidelberg (1994)Google Scholar
- 4.Clark, A.: Memory-based learning of morphology with stochastic transducers. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL), pp. 513–520 (2002)Google Scholar
- 5.Clark, A.: Learning deterministic context free grammars in the Omphalos competition. Machine Learning (to appear, 2006)Google Scholar
- 6.Clark, A., Thollard, F.: Partially distribution-free learning of regular languages from positive samples. In: Proceedings of COLING, Geneva, Switzerland (2004)Google Scholar
- 9.Emele, M.C.: Unification with lazy non-redundant copying. In: Meeting of the Association for Computational Linguistics, pp. 323–330 (1991)Google Scholar
- 10.Casacuberta, F.: Probabilistic estimation of stochastic regular syntax-directed translation schemes. In: Moreno, R. (ed.) VI Spanish Symposium on Pattern Recognition and Image Analysis, pp. 201–297. AERFAI (1995)Google Scholar
- 14.Starkie, B., van Zaanen, M., Estival, D.: Tenjinno machine translation competition (2006), http://www.ics.mq.edu.au/~tenjinno/
- 16.Wu, D.: Stochastic inversion transduction grammars, with application to segmentation, bracketing, and alignment of parallel corpora. In: IJCAI 1995, Montreal, pp. 1328–1335 (August 1995)Google Scholar
- 17.Zhang, H., Gildea, D.: Stochastic lexicalized inversion transduction grammar for alignment. In: Proceedings of the 43rd Annual Conference of the Association for Computational Linguistics (ACL 2005) (2005)Google Scholar