Skip to main content

Identification of Bilingual Suffix Classes for Classification and Translation Generation

Part of the Lecture Notes in Computer Science book series (LNAI,volume 8864)

Abstract

We examine the possibility of learning bilingual morphology using the translation forms taken from an existing, manually validated, bilingual translation lexicon. The objective is to evaluate the use of bilingual stem and suffix based features on the performance of the existing Support Vector Machine based classifier trained to classify the automatically extracted word-to-word translations. We initially induce the bilingual stem and suffix correspondences by considering the longest sequence common to orthogonally similar translations. Clusters of stem-pairs characterised by identical suffix-pairs are formed, which are then used to generate out-of-vocabulary translations that are identical to, but different from, the previously existing translations, thereby completing the existing lexicon. Using the bilingual stem and suffix correspondences induced from the augmented lexicon we come up with 5 new features that reflects the (non)existence of morphological coverage (agreement) between a term and its translation. Specifically, we examine and evaluate the use of suffix classes, bilingual stem and suffix correspondences as features in selecting correct word-to-word translations from among the automatically extracted ones. With a training data of approximately 35.8K word translations for the language pair English-Portuguese, we identified around 6.4K unique stem pairs and 0.25K unique suffix pairs. Further, experimental results show that the newly added features improved the word-to-word classification accuracy by 9.11\(\%\) leading to an overall improvement in the classifier accuracy by 2.15\(\%\) when all translations (single- and multi-word translations) were considered.

Keywords

  • Bilingual suffix classes
  • Translation classification
  • Support vector machine
  • Lexicon augmentation
  • OOV terms

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-12027-0_13
  • Chapter length: 13 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-12027-0
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aires, J., Lopes, G.P., Gomes, L.: Phrase translation extraction from aligned parallel corpora using suffix arrays and related structures. In: Lopes, L.S., Lau, N., Mariano, P., Rocha, L.M. (eds.) EPIA 2009. LNCS, vol. 5816, pp. 587–597. Springer, Heidelberg (2009)

    CrossRef  Google Scholar 

  2. Brown, P.F., Pietra, V.J.D., Pietra, S.A.D., Mercer, R.L.: The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics 19(2), 263–311 (1993)

    Google Scholar 

  3. Lardilleux, A., Lepage, Y.: Sampling-based multilingual alignment. In: Proceedings of Recent Advances in Natural Language Processing, pp. 214–218 (2009)

    Google Scholar 

  4. Gomes, L., Pereira Lopes, J.G.: Measuring spelling similarity for cognate identification. In: Antunes, L., Pinto, H.S. (eds.) EPIA 2011. LNCS, vol. 7026, pp. 624–633. Springer, Heidelberg (2011)

    CrossRef  Google Scholar 

  5. Gomes, L., Lopes, G.P.: Parallel texts alignment. In: New Trends in Artificial Intelligence, 14th Portuguese Conference in Artificial Intelligence, EPIA 2009, Aveiro, pp. 513–524 (October 2009)

    Google Scholar 

  6. Kavitha, K.M., Gomes, L., Lopes, G.P.: Using svms for filtering translation tables for parallel corpora alignment. In: 15th Portuguese Conference in Arificial Intelligence, EPIA 2011, pp. 690–702 (October 2011)

    Google Scholar 

  7. Déjean, H.: Morphemes as necessary concept for structures discovery from untagged corpora. In: Proceedings of the Joint Conferences on New Methods in Language Processing and Computational Natural Language Learning, pp. 295–298. Association for Computational Linguistics (1998)

    Google Scholar 

  8. Goldsmith, J.: Unsupervised learning of the morphology of a natural language. Computational Linguistics 27(2), 153–198 (2001)

    CrossRef  MathSciNet  Google Scholar 

  9. Creutz, M., Lagus, K.: Unsupervised discovery of morphemes. In: Proceedings of the ACL 2002 Workshop on Morphological and Phonological Learning, vol. 6, pp. 21–30. Association for Computational Linguistics (2002)

    Google Scholar 

  10. Hammarström, H., Borin, L.: Unsupervised learning of morphology. Computational Linguistics 37(2), 309–350 (2011)

    CrossRef  Google Scholar 

  11. Monson, C., Carbonell, J., Lavie, A., Levin, L.: Paramor and morpho challenge 2008. In: Peters, C., Deselaers, T., Ferro, N., Gonzalo, J., Jones, G.J.F., Kurimo, M., Mandl, T., Peñas, A., Petras, V. (eds.) CLEF 2008. LNCS, vol. 5706, pp. 967–974. Springer, Heidelberg (2009)

    CrossRef  Google Scholar 

  12. Momouchi, H.S.K.A.Y. Tochinai, K.: Prediction method of word for translation of unknown word. In: Proceedings of the IASTED International Conference, Artificial Intelligence and Soft Computing, Banff, Canada, July 27-August 1 1997, p. 228. Acta Pr. (1997)

    Google Scholar 

  13. de Gispert, A., Marino, J.B.: On the impact of morphology in English to Spanish statistical MT. Speech Communication 50(11–12), 1034–1046 (2008)

    CrossRef  Google Scholar 

  14. Vapnik, V.: The Nature of Statistical Learning Theory. Data Mining and Knowledge Discovery, 1–47 (2000)

    Google Scholar 

  15. Sato, K., Saito, H.: Extracting word sequence correspondences based on support vector machines. Journal of Natural Language Processing 10(4), 109–124 (2003)

    CrossRef  Google Scholar 

  16. Bergsma, S., Kondrak, G.: Alignment-based discriminative string similarity. In: Annual Meeting-ACL, vol. 45, p. 656 (2007)

    Google Scholar 

  17. Kutsumi, T., Yoshimi, T., Kotani, K., Sata, I., Isahara, H.: Selection of entries for a bilingual dictionary from aligned translation equivalents using support vector machines. In: Proceedings of Pacific Association for Computational Linguistics

    Google Scholar 

  18. Gaussier, É.: Unsupervised learning of derivational morphology from inflectional lexicons. In: Proceedings of ACL 1999 Workshop: Unsupervised Learning in Natural Language Processing (1999)

    Google Scholar 

  19. Zhao, Y., Karypis, G.: Evaluation of hierarchical clustering algorithms for document datasets. In: Proceedings of the Eleventh International Conference on Information and Knowledge Management, pp. 515–524. ACM (2002)

    Google Scholar 

  20. Gusfield, D.: Algorithms on strings, trees, and sequences: computer science and computational biology, pp. 52–61. Cambridge Univ. Pr. (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Karimbi Mahesh Kavitha .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Kavitha, K.M., Gomes, L., Lopes, J.G.P. (2014). Identification of Bilingual Suffix Classes for Classification and Translation Generation. In: Bazzan, A., Pichara, K. (eds) Advances in Artificial Intelligence -- IBERAMIA 2014. IBERAMIA 2014. Lecture Notes in Computer Science(), vol 8864. Springer, Cham. https://doi.org/10.1007/978-3-319-12027-0_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-12027-0_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12026-3

  • Online ISBN: 978-3-319-12027-0

  • eBook Packages: Computer ScienceComputer Science (R0)