Zipf’s Law and Mandelbrot’s Constants for Turkish Language Using Turkish Corpus (TurCo)

  • Gökhan Dalkılıç
  • Yalçın Çebi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3261)

Abstract

Zipf’s Law is a common law applied for different kinds of observations. Many investigations were carried out to find the correspondences between Zipf’s Law and different languages. This study deals with the correspondence of Turkish with Zipf’s Law and finding Mandelbrot constants (c and B ) by using a large scale Turkish corpus (TurCo). In order to determine these constants, coefficient of determination was used, and different c and B values were examined. As both languages show agglutinative characteristics, the most suitable B value was found smaller than 1 for Turkish like Korean, and c value was found as 0.27.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Dalkılıç, G., Çebi, Y.: A 300MB Turkish Corpus and Word Analysis. In: Yakhno, T. (ed.) ADVIS 2002. LNCS, vol. 2457, pp. 205–212. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  2. 2.
    Çebi, Y., Dalkılıç, G.: Turkish Word N-gram Analyzing Algorithms for a Large Scale Turkish Corpus – TurCo. In: ITCC 2004, IEEE International Conference on Information Technology (2004) (accepted and will be published)Google Scholar
  3. 3.
    Dalkılıç, G., Çebi, Y.: Word Statistics of Turkish Language on a Large Scale Text Corpus – TurCo. In: ITCC 2004, IEEE International Conference on Information Technology (2004) (accepted and will be published)Google Scholar
  4. 4.
    Teahan, W.J.: Modeling English Text. Ph.D. Dissertation. The Univ. of Waikato. New Zealand, 50-52, 64-69 (1998)Google Scholar
  5. 5.
    Witten, I.H., Bell, T.C.: Source models for natural language text. Int. J. Man-Machine Studies 32(5), 545–579 (1990)CrossRefGoogle Scholar
  6. 6.
    Zipf, G.K.: Human behavior and the principle of least effort. Addison-Wesley Publishing, Reading (1949)Google Scholar
  7. 7.
    Choi, S.W.: Some Statistical Properties and Zipf’s Law in Korean Text Corpus. Journal of Quantitative Linguistics 7(1), 19–30 (2000)CrossRefGoogle Scholar
  8. 8.
    Ha, L.Q., Sicilia-Garcia, E.I., Ming, J., Smith, F.J.: Extension of Zipf’s Law to Words and Phrases. In: The 17th International Conference on Computational Linguistics (2002)Google Scholar
  9. 9.
    Manning, C.D., Schütze, H.: Foundations of Statistical Natural Language Processing, p. 119. The MIT Press, Cambridge (2000)Google Scholar
  10. 10.
    Miller, G.A., Newman, E.B., Fiedman, E.A.: Some effects of intermittent silence. American Journal of Psychology 70, 311–313 (1957)CrossRefGoogle Scholar
  11. 11.
    Robbins, J.L., Daneman, J.C.: The Best Known Statistic – Coefficient of Determination (r2): What it does and does not do in Regression Analysis. National Estimator Fall 2002, 18–27 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Gökhan Dalkılıç
    • 1
  • Yalçın Çebi
    • 1
  1. 1.Computer Engineering Dept.Dokuz Eylul UniversityBornova, IzmirTurkey

Personalised recommendations