Skip to main content
SpringerLink
Log in

Analysis of Complexity Between Spoken and Written Language for Statistical Machine Translation in West-Slavic Group

  • Conference paper
  • First Online:
Multimedia and Network Information Systems

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 506))

Abstract

The multilingual nature of the world makes translation a crucial requirement today. Within this research we apply state of the art statistical machine translation techniques to the West-Slavic languages group. We do West-Slavic languages classification and choose Polish as a representative candidate for our research. The experiments are conducted on written and spoken texts, which characteristics are defined as well. The machine translation systems are trained within West-Slavic group as well as into English. Translation systems and data sets are analyzed, prepared and adapted for the needs of West-Slavic—* translation. To evaluate the effects of different preparations on translation results, we conducted experiments and used the BLEU, NIST and TER metrics. By defining proper translation parameters to morphologically rich languages we improve the translation quality and draw the conclusions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://bookshop.europa.eu.

  2. 2.

    http://alt.qcri.org/resources/qedcorpus/.

References

  1. Mohammadi, M.; Ghasemaghaee, N.: Building bilingual parallel corpora based on wikipedia. In: 2010 Second International Conference on Computer Engineering and Applications (ICCEA), pp. 264–268. IEEE (2010)

    Google Scholar 

  2. Ruiz, N., Federico, M.: Complexity of spoken versus written language for machine translation. In: Proceedings of the 17th Annual Conference of the European Association for Machine Translation, pp. 173–180 (2014)

    Google Scholar 

  3. Dalewska-Greń, H.: Języki słowiańskie. Wydawn, Naukowe PWN (1997)

    Google Scholar 

  4. Stieber, Z.: Zarys gramatyki porównawczej języków słowiańskich Wydawn. Naukowe PWN (2005)

    Google Scholar 

  5. Oczkowa, B., Szczepańska, E., Kwoka T.: Słowiańskie języki literackie. Wydawnictwo Uniwersytetu Jagiellońskiego (2011)

    Google Scholar 

  6. Języki zachodniosłowiańskie last modified October 16 2015. https://pl.wikipedia.org/wiki/J%C4%99zyki_zachodnios%C5%82owia%C5%84skie

  7. Wołk, K., Marasek, K.: Polish–English speech statistical machine translation systems for the IWSLT 2013. In: Proceedings of the 10th International Workshop on Spoken Language Translation, Heidelberg, Germany, pp. 113–119 (2013)

    Google Scholar 

  8. Swan, O.E.: Polish Grammar in a Nutshell (2003)

    Google Scholar 

  9. Choong C.: The Difference between Written and Spoken English. Assignment Unit 1 A in fulfillment of Graduate Diploma in English (2014)

    Google Scholar 

  10. Daniels, P. T., Bright, W.: The World’s Writing Systems. Oxford University Press (1996)

    Google Scholar 

  11. Coleman, J., A speech is not an essay. Harv. Bus. Rev. (2014)

    Google Scholar 

  12. Ager, S.: Differences between writing and speech, Omniglot—the online encyclopedia of writing systems and languages. http://www.omniglot.com/writing/writingvspeech.htm. Accessed 8 Aug 2013

  13. Koehn, P., et al.: Moses: Open source toolkit for statistical machine translation. In: Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pp. 177–180. Association for Computational Linguistics (2007)

    Google Scholar 

  14. Stolcke, A., et al.: SRILM-an extensible language modeling toolkit. In: INTERSPEECH (2002)

    Google Scholar 

  15. Heafield, K.: KenLM: Faster and smaller language model queries. In: Proceedings of the Sixth Workshop on Statistical Machine Translation, pp. 187–197. Association for Computational Linguistics (2011)

    Google Scholar 

  16. Gao, Q., Vogel, S.: Parallel implementations of word alignment tool. In: Software Engineering, Testing, and Quality Assurance for Natural Language Processing, pp. 49–57. Association for Computational Linguistics (2008)

    Google Scholar 

  17. Joachims, T.: Text Categorization with Support Vector Machines: Learning with Many Relevant Features, pp. 137–142. Springer, Berlin, Heidelberg (1998)

    Google Scholar 

  18. Tiedemann, J.: News from OPUS-A collection of multilingual parallel corpora with tools and interfaces. In: Recent Advances in Natural Language Processing, pp. 237–248 (2009)

    Google Scholar 

  19. Wu, D., Fung, P.: Inversion transduction grammar constraints for mining parallel sentences from quasi-comparable corpora. In: Natural Language Processing–IJCNLP 2005, pp. 257–268. Springer, Berlin, Heidelberg (2005)

    Google Scholar 

  20. Tiedemann, J.: Parallel data, tools and interfaces in OPUS. LREC 2012, 2214–2218 (2012)

    Google Scholar 

Download references

Acknowledgments

This research was supported by Polish-Japanese Academy of Information Technology statutory resources (ST/MUL/2016), resources for young researchers at PJATK and CLARIN ERIC research program.

Author information

Authors and Affiliations

  1. Polish-Japanese Academy of Information Technology, ul. Koszykowa 86, 02-008, Warsaw, Poland

    Agnieszka Wołk, Krzysztof Wołk & Krzysztof Marasek

Authors
  1. Agnieszka Wołk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Krzysztof Wołk
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Krzysztof Marasek
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Krzysztof Wołk .

Editor information

Editors and Affiliations

  1. Department of Information Systems, Faculty of Computer Science and Management, Wrocław University of Science and Technology, Wroclaw, Poland

    Aleksander Zgrzywa

  2. Department of Information Systems, Faculty of Computer Science and Management, Wrocław University of Science and Technology, Wrocław, Poland

    Kazimierz Choroś

  3. Department of Information Systems, Faculty of Computer Science and Management, Wrocław University of Science and Technology, Wrocław, Poland

    Andrzej Siemiński

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this paper

Cite this paper

Wołk, A., Wołk, K., Marasek, K. (2017). Analysis of Complexity Between Spoken and Written Language for Statistical Machine Translation in West-Slavic Group. In: Zgrzywa, A., Choroś, K., Siemiński, A. (eds) Multimedia and Network Information Systems. Advances in Intelligent Systems and Computing, vol 506. Springer, Cham. https://doi.org/10.1007/978-3-319-43982-2_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-43982-2_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-43981-5

  • Online ISBN: 978-3-319-43982-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation