Advertisement

The Soundex Phonetic Algorithm Revisited for SMS Text Representation

  • David Pinto
  • Darnes Vilariño
  • Yuridiana Alemán
  • Helena Gómez
  • Nahun Loya
  • Héctor Jiménez-Salazar
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7499)

Abstract

The growing use of information technologies such as mobile devices has had a major social and technological impact such as the growing use of Short Message Services (SMS), a communication system broadly used by cellular phone users. In 2011, it was estimated over 5.6 billion of mobile phones sending between 30 and 40 SMS at month. Hence the great importance of analyzing representation and normalization techniques for this kind of texts. In this paper we show an adaptation of the Soundex phonetic algorithm for representing SMS texts. We use the modified version of the Soundex algorithm for codifying SMS, and we evaluate the presented algorithm by measuring the similarity degree between two codified texts: one originally written in natural language, and the other one originally written in SMS “sub-language”. Our main contribution is basically an improvement of the Soundex algorithm which allows to raise the level of similarity between the texts in SMS and their corresponding text in English or Spanish language.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Reyes-Barragán, A., Villaseñor Pineda, L., Montes-y-Gómez, M.: INAOE at QAst 2009: Evaluating the usefulness of a phonetic codification of transcriptions. In: Proceedings of CLEF 2009 Workshop. Springer (2009)Google Scholar
  2. 2.
    Aiti, A., Min, Z., Pohkhim, Y., Zhenzhen, F., Jian, S.: Input normalization for an english-to-chinese sms translation system. In: MT Summit 2005 (2005)Google Scholar
  3. 3.
    Aw, A., Zhang, M., Xiao, J., Su, J.: A phrase-based statistical model for sms text normalization. In: Proceedings of the COLING/ACL on Main Conference Poster Sessions, COLING-ACL 2006, pp. 33–40. Association for Computational Linguistics, Stroudsburg (2006)CrossRefGoogle Scholar
  4. 4.
    Kothari, G., Negi, S., Faruquie, T.A., Chakaravarthy, V.T., Subramaniam, L.V.: SMS based interface for FAQ retrieval. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, ACL-IJCNLP 2009, vol. 2, pp. 852–860. Association for Computational Linguistics, Morristown (2009)Google Scholar
  5. 5.
    Contractor, D., Kothari, G., Faruquie, T.A., Subramaniam, L.V., Negi, S.: Handling noisy queries in cross language faq retrieval. In: Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing, EMNLP 2010, pp. 87–96. Association for Computational Linguistics, Stroudsburg (2010)Google Scholar
  6. 6.
    Hall, P.A.V., Dowling, G.R.: Approximate string matching. ACM Comput. Surv. 12, 381–402 (1980)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Rajkovic, P., Jankovic, D.: Adaptation and application of daitch-mokotoff soundex algorithm on Serbian names. In: XVII Conference on Applied Mathematics (2007)Google Scholar
  8. 8.
    Taft, R.: Name search techniques. Special report. Bureau of Systems Development, New York State Identification and Intelligence System (1970)Google Scholar
  9. 9.
    Philips, L.: Hanging on the metaphone. Computer Language Magazine 7, 38–44 (1990)Google Scholar
  10. 10.
    Knuth, D.E.: The art of computer programming, vol. 3: sorting and searching, 2nd edn. Addison Wesley Longman Publishing Co., Inc., Redwood City (1998)Google Scholar
  11. 11.
    Manning, C.D., Raghavan, P., Schtze, H.: Introduction to Information Retrieval. Cambridge University Press, New York (2008)zbMATHCrossRefGoogle Scholar
  12. 12.
    Romero, J., et al.: En patera y haciendo agua. Adicciones Digitales (2011), http://www.adiccionesdigitales.es/libro
  13. 13.
    Jaccard, P.: Etude comparative de la distribution florale dans une portion des Alpes et du Jura. Bulletin de Société vaudoise des Sciences Naturelles 37, 547–579 (1901)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • David Pinto
    • 1
  • Darnes Vilariño
    • 1
  • Yuridiana Alemán
    • 1
  • Helena Gómez
    • 1
  • Nahun Loya
    • 1
  • Héctor Jiménez-Salazar
    • 2
  1. 1.Faculty of Computer ScienceBenemérita Universidad Autónoma de PueblaMexico
  2. 2.Information Technologies DepartmentUniversidad Autónoma MetropolitanaDF, Mexico

Personalised recommendations