Skip to main content

Developing a Transfer-Based System for Arabic Dialects Translation

  • Chapter
  • First Online:
Intelligent Natural Language Processing: Trends and Applications

Part of the book series: Studies in Computational Intelligence ((SCI,volume 740))

Abstract

The prominent Arabic Domestic changes have influenced the usage of the Arabic dialects among Arabs communications, which was, previously, limited on daily activities inside their own territories the role of the Modern Standard. Arabic MSA as an official Arabic language started to be diminished, since the Arabic dialects play a greater role than using it during the daily activities. The continuity of using these dialects whether in media or writing may eliminate the dominance of MSA as an official form of Arabic language in the Arab world. Besides, comprehending the Arabic language by non-native speakers, as well as, processing machine translations became a sophisticated process that requires harder effort. Accordingly, a requirement of language processing to interact with the permanent development of the dialects and to flourish the standard Arabic became imperative. Thus, it is planned to built a Hybrid Machine translation system (AlMoFseH) to translate the different Arabic dialects by using the MSA as a pivot. This research is a part of this project which emphasizes on developing a transfer-based system that transfers the Egyptian Arabic dialect EGY used in social media to MSA. For that purpose, a lexical database of 3k words presenting Egyptian Arabic dialect was built. Different texts extracted from Social media were used as a main resource of the database. The system consists of three components: disambiguation of the morphological analysis output using Naive Bayesian learning, a rule based transfer system and a dictionary look up system. The evaluation revealed a high accuracy of the system’s performance, since 92.7% of the test data was transferred correctly.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 299.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Dasigi, P., Diab, M.T.: CODACT: Towards identifying orthographic variants in dialectal Arabic. In: IJCNLP, pp. 318–326 (2011)

    Google Scholar 

  2. Ibrahim, Z.: Beyond Lexical Variation in Modern Standard Arabic: Egypt. Cambridge Scholars Publishing, Lebanon and Morocco (2009)

    Google Scholar 

  3. Zbib, R., Malchiodi, E., Devlin, J., Stallard, D., Matsoukas, S., Schwartz, R., Makhoul, J., Zaidan, O.F., Callison-Burch, C.: Machine translation of Arabic dialects. In: Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 49–59. Association for Computational Linguistics (2012)

    Google Scholar 

  4. Bakr, H.A., Shaalan, K., Ziedan, I.: A hybrid approach for converting written Egyptian colloquial dialect into diacritized Arabic. In: The 6th International Conference on Informatics and Systems, infos2008. Cairo University (2008)

    Google Scholar 

  5. Monem, A.A., Shaalan, K., Rafea, A., Baraka, H.: Generating Arabic text in multilingual speech-to-speech machine translation framework. Mach. Transl. 22(4), 205–258 (2008)

    Article  Google Scholar 

  6. Sawaf, H.: Arabic dialect handling in hybrid machine translation. In: Proceedings of the conference of the Association for Machine Translation in the Americas (AMTA), Denver, Colorado (2010)

    Google Scholar 

  7. Salloum, W., Habash, N.: Elissa: a dialectal to standard Arabic machine translation system. In: COLING (demos), pp. 385–392 (2012)

    Google Scholar 

  8. Holes, C.: Modern Arabic: Structures, Functions, and Varieties. Georgetown University Press (2004)

    Google Scholar 

  9. El-Hassan, S.A.: Educated spoken Arabic in Egypt and the Levant: a critical review of diglossia and related concepts. Archivum Linguisticum Leeds 8(2), 112–132 (1977)

    Google Scholar 

  10. Bani-Khaled, T.A.A.: Standard Arabic and Diglossia: a problem for language education in the Arab World (2014)

    Google Scholar 

  11. Hassig, H.: Deriving Cairene Arabic from modern standard Arabic: a framework for using modern standard Arabic text to synthesize Cairene Arabic speech from phonetic transcription (2011)

    Google Scholar 

  12. Gadalla, H.A.: Comparative Morphology of Standard and Egyptian Arabic, vol. 5. Lincom Europa Munich (2000)

    Google Scholar 

  13. Okpor, M.: Machine translation approaches: issues and challenges. Int. J. Comput. Sci. Issues (IJCSI) 11(5), 159 (2014)

    Google Scholar 

  14. Shilon, R.: Transfer-based machine translation between morphologically-rich and resource-poor languages: the case of Hebrew and Arabic. Ph.D. thesis, Citeseer (2011)

    Google Scholar 

  15. Trujillo, A.: Translation Engines: Techniques for Machine Translation. Springer Science & Business Media (2012)

    Google Scholar 

  16. Hutchins, W.J., Somers, H.L.: An Introduction to Machine Translation, vol. 362. Academic Press London (1992)

    Google Scholar 

  17. Artetxe Zurutuza, M.: Distributional semantics and machine learning for statistical machine translation (2016)

    Google Scholar 

  18. Farghaly, A.: Arabic machine translation: a developmental perspective. Int. J. Inf. Commun. Technol. 3, 3–10 (2010)

    Google Scholar 

  19. Tze, L.L.: Multilingual lexicons for machine translation. In: Proceedings of the 11th International Conference on Information Integration and Web-based Applications and Services, pp. 734–738. ACM (2009)

    Google Scholar 

  20. Habash, N., Eskander, R., Hawwari, A.: A morphological analyzer for Egyptian Arabic. In: Proceedings of the Twelfth Meeting of the Special Interest Group on Computational Morphology and Phonology, pp. 1–9. Association for Computational Linguistics (2012)

    Google Scholar 

  21. Habash, N., Diab, M.T., Rambow, O.: Conventional orthography for dialectal Arabic. In: LREC, pp. 711–718 (2012)

    Google Scholar 

  22. Escudero, G., Màrquez, L., Rigau, G.: Machine Learning Techniques for Word Sense Disambiguation (2003)

    Google Scholar 

  23. Le, C.A., Shimazu, A.: High WSD accuracy using Naive Bayesian classifier with rich features. Proc. PACLIC 18, 105–113 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Salwa Hamada .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Hamada, S., Marzouk, R.M. (2018). Developing a Transfer-Based System for Arabic Dialects Translation. In: Shaalan, K., Hassanien, A., Tolba, F. (eds) Intelligent Natural Language Processing: Trends and Applications. Studies in Computational Intelligence, vol 740. Springer, Cham. https://doi.org/10.1007/978-3-319-67056-0_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67056-0_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67055-3

  • Online ISBN: 978-3-319-67056-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics