Skip to main content
SpringerLink
Log in

Missing Phrase Recovering by Combining Forward and Backward Phrase Translation Tables

  • Conference paper
New Frontiers in Applied Data Mining (PAKDD 2009)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5669))

Included in the following conference series:

  • 620 Accesses

Abstract

We propose a method to recover missing phrases dropped in the phrase extraction algorithm. Those phrases, therefore, are not translated even though we tested the system with the training data. On the other hand, in native-to-foreign, or backward training, some missing phrases can be recovered. In this paper, we combined two phrase translation tables extracted by the source-to-target and target-to-source training for the sake of more complete phrase translation table. We re-estimated the lexical weights and phrase translation probabilities for each phrase pair. Additional combining weights were applied to both tables. We assessed our method on different combining weights by counting the missing phrases and calculating the BLEU scores and NIST scores. Approximately 7% of missing phrases are recovered and 1.3% of BLEU score is increased.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Brown, P.F., Stephen, A.D.P., Vincent, J.D.P., Robert, L.M.: The Mathematics of Statistical Machine Translation: Parameter Estimation. Computational Linguistics 19, 263–311 (1993)

    Google Scholar 

  2. Koehn, P., Franz, J.O., Daniel, M.: Statistical Phrase-Based Translation. In: Human Language Technology conference/North American chapter of the Association for Computational Linguistics (2003)

    Google Scholar 

  3. Hideo, O., Yamamoto, H., Sumita, E.: Introducing Translation Dictionary Into Phrase-based SMT. In: Proceedings of Machine Translation Summit, pp. 361–367 (2007)

    Google Scholar 

  4. Amittai, A.: Factored Language Model for Statistical Machine Translation. MRes Thesis. Edinburgh University (2006)

    Google Scholar 

  5. Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., Dyer, C., Bojar, O., Constantin, A., Herbst, E.: Moses: Open Source Toolkit for Statistical Machine Translation. In: Annual Meeting of the Association for Computational Linguistics (ACL), demonstration session, Prague, Czech Republic (2007)

    Google Scholar 

  6. Stolcke, A.: SRILM an Extensible Language Modeling Toolkit. In: International Conference on Spoken Language Processing (2002)

    Google Scholar 

  7. Papineni, K., Roukos, S., Ward, T., Zhu, W.-J.: BLEU: a method for automatic evaluation of machine translation. Technical Report RC22176 (W0109-022), IBM Research Report (2001)

    Google Scholar 

  8. Doddington, G.: Automatic evaluation of machine translation quality using n-gram co-occurrence statistics. In: Proceedings of ARPA Workshop on Human Language Technology (2002)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Human Language Technology Laboratory, National Electronics and Computer Technology, 112 Thailand Science Park, KlongNueng, KlongLuang, Pathumthani, Thailand, 12120

    Peerachet Porkaew & Thepchai Supnithi

Authors
  1. Peerachet Porkaew
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thepchai Supnithi
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Thammasat University, Sirindhorn International Institute of Technology,, 131 Moo 5 Tiwanont Road, Bangkadi, 12000, Muang, Pathumthani, Thailand

    Thanaruk Theeramunkong

  2. Department of Architecture for Intelligence, The Institute of Scientific and Industrial Research, Osaka University, 8-1 Mihogaoka,Ibaraki, 567-0047, Osaka, Japan

    Cholwich Nattee

  3. Center for Informatics, Federal University of Pernambuco, Brazil

    Paulo J. L. Adeodato

  4. Computer Science and Engineering Department, University of Notre Dame, 353 Fitzpatrick Hall, 46556, Notre Dame, IN, USA

    Nitesh Chawla

  5. Department of Computer Science, The Australian National University, Australia

    Peter Christen

  6. TELECOM Bretagne, Lab-STICC, Institut TELECOM, Brest, France

    Philippe Lenca

  7. School of Information Technologies, University of Sydney, P.O. Box, Australia

    Josiah Poon

  8. Australian Taxation Office, Australia

    Graham Williams

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Porkaew, P., Supnithi, T. (2010). Missing Phrase Recovering by Combining Forward and Backward Phrase Translation Tables. In: Theeramunkong, T., et al. New Frontiers in Applied Data Mining. PAKDD 2009. Lecture Notes in Computer Science(), vol 5669. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14640-4_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-14640-4_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-14639-8

  • Online ISBN: 978-3-642-14640-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation