Advertisement

Arabic Transliteration of Romanized Tunisian Dialect Text: A Preliminary Investigation

  • Abir MasmoudiEmail author
  • Nizar Habash
  • Mariem Ellouze
  • Yannick Estève
  • Lamia Hadrich Belguith
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9041)

Abstract

In this paper, we describe the process of converting Tunisian Dialect text that is written in Latin script (also called Arabizi) into Arabic script following the CODA orthography convention for Dialectal Arabic. Our input consists of messages and comments taken from SMS, social networks and broadcast videos. The language used in social media and SMS messaging is characterized by the use of informal and non-standard vocabulary such as repeated letters for emphasis, typos, non-standard abbreviations, and nonlinguistic content, such as emoticons. There is a high degree of variation is spelling in Arabic dialects due to the lack of orthographic widely supported standards in both Arabic and Latin scripts. In the context of natural language processing, transliterating from Arabizi to Arabic script is a necessary step since most recently available tools for processing Arabic Dialects expect Arabic script input.

Keywords

Tunisian Dialect corpus transliteration normalization CODA 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Al-Badrashiny, M., Eskander, R., Habash, N., Rambow, O.: Automatic Transliteration of Romanized Dialectal Arabic. In: Proceedings of the Eighteenth Conference on Computational Language Learning, Maryland, USA (2014)Google Scholar
  2. 2.
    Al-Gaphari, G., Al-Yadoumi, M.: A method to convert Sana’ani accent to Modern Standard Arabic. International Journal of Information Science and Management (2010)Google Scholar
  3. 3.
    Bies, A., Song, Z., Maamouri, M., Grimes, S., Lee, H., Wright, J., Strassel, S., Habash, N., Eskander, R., Rambow, O.: Transliteration of Arabizi into Arabic Orthography: Developing a Parallel Annotated Arabizi-Arabic Script SMS/Chat Corpus. In: Arabic Natural Language Processing Workshop, Qatar (2014)Google Scholar
  4. 4.
    Chalabi, A., Gerges, H.: Romanized Arabic Transliteration. In: Proceedings of the Second Workshop on Advances in Text Input Methods (2012)Google Scholar
  5. 5.
    Cheng, X., Dale, C., Liu, J.: Understanding The Characteristics Of Internet Short Video Sharing: YouTube As A Case Study (2007)Google Scholar
  6. 6.
    Darwish, K.: Arabizi Detection and Conversion to Arabic. CoRR (2013)Google Scholar
  7. 7.
    Diab, M., Habash, N., Owen, R.: Conventional Orthography for Dialectal Arabic. In: Proceedings of the Language Resources and Evaluation Conference, Istanbul (2012)Google Scholar
  8. 8.
    Eskander, R., Al-Badrashiny, M., Habash, N., Rambow, O.: Foreign Words and the Automatic Processing of Arabic Social Media Text Written in Roman Script. In: Arabic Natural Language Processing Workshop, Qatar (2014)Google Scholar
  9. 9.
    Jarrar, M., Habash, N., Akra, D., Zalmout, N.: Building a Corpus for Palestinian Arabic: a Preliminary Study. In: Proceedings of the Arabic Natural Language Processing Workshop, EMNLP, Doha (2014)Google Scholar
  10. 10.
    Lawson, S., Sachdev, I.: Code Switching in Tunisia: attitudinal and behavioral dimensions. Journal of Pragmatics 32 (2000)Google Scholar
  11. 11.
    Masmoudi, A., Ellouze Khmekhem, M., Estève, Y., Bougares, F., Dabbar, S., Hadrich Belguith, L.: Phonétisation automatique du Dialecte Tunisien. 30 éme Journée d’étudessur la parole, Le Mans-France (2014)Google Scholar
  12. 12.
    Masmoudi, A., Ellouze Khmekhem, M., Estève, Y., Hadrich Belguith, L., Habash, N.: A corpus and a phonetic dictionary for Tunisian Arabic speech recognition. In: 19th edition of the Language Resources and Evaluation Conference, Iceland (2014)Google Scholar
  13. 13.
    Masmoudi, A., Estève, Y., Ellouze Khmekhem, M., Bougares, F., Hadrich Belguith, L.: Phonetic tool for the Tunisian Arabic. In: The 4th International Workshop on Spoken Language Technologies for Under-resourced Languages, Russia (2014)Google Scholar
  14. 14.
    Shaalan, K., Abo Bakr, H., Ziedan, I.: Transferring Egyptian Colloquial into Modern Standard Arabic. In: International Conference on Recent Advances in Natural Language Processing, Bulgaria (2007)Google Scholar
  15. 15.
    Zribi, I., Boujelbane, R., Masmoudi, A., Ellouze Khmekhem, M., Hadrich Belguith, L., Habash, N.: A Conventional Orthography for Tunisian Arabic. In: Proceedings of the Language Resources and Evaluation Conference, Iceland (2014)Google Scholar
  16. 16.
    Zribi, I., Ellouze Khmekhem, M., Hadrich Belguith, L.: Morphological Analysis of Tuni-sian Dialect. In: International Joint Conference on Natural Language Processing, Nagoya, Japan (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Abir Masmoudi
    • 1
    • 2
    Email author
  • Nizar Habash
    • 3
  • Mariem Ellouze
    • 1
  • Yannick Estève
    • 2
  • Lamia Hadrich Belguith
    • 1
  1. 1.ANLP Research group, MIRACL Lab.University of SfaxSfaxTunisia
  2. 2.LIUMUniversity of MaineOronoFrance
  3. 3.New York University Abu DhabiAbu DhabiUnited Arab Emirates

Personalised recommendations