Zipf’s Law and Mandelbrot’s Constants for Turkish Language Using Turkish Corpus (TurCo)
Zipf’s Law is a common law applied for different kinds of observations. Many investigations were carried out to find the correspondences between Zipf’s Law and different languages. This study deals with the correspondence of Turkish with Zipf’s Law and finding Mandelbrot constants (c and B ) by using a large scale Turkish corpus (TurCo). In order to determine these constants, coefficient of determination was used, and different c and B values were examined. As both languages show agglutinative characteristics, the most suitable B value was found smaller than 1 for Turkish like Korean, and c value was found as 0.27.
Unable to display preview. Download preview PDF.
- 2.Çebi, Y., Dalkılıç, G.: Turkish Word N-gram Analyzing Algorithms for a Large Scale Turkish Corpus – TurCo. In: ITCC 2004, IEEE International Conference on Information Technology (2004) (accepted and will be published)Google Scholar
- 3.Dalkılıç, G., Çebi, Y.: Word Statistics of Turkish Language on a Large Scale Text Corpus – TurCo. In: ITCC 2004, IEEE International Conference on Information Technology (2004) (accepted and will be published)Google Scholar
- 4.Teahan, W.J.: Modeling English Text. Ph.D. Dissertation. The Univ. of Waikato. New Zealand, 50-52, 64-69 (1998)Google Scholar
- 6.Zipf, G.K.: Human behavior and the principle of least effort. Addison-Wesley Publishing, Reading (1949)Google Scholar
- 8.Ha, L.Q., Sicilia-Garcia, E.I., Ming, J., Smith, F.J.: Extension of Zipf’s Law to Words and Phrases. In: The 17th International Conference on Computational Linguistics (2002)Google Scholar
- 9.Manning, C.D., Schütze, H.: Foundations of Statistical Natural Language Processing, p. 119. The MIT Press, Cambridge (2000)Google Scholar
- 11.Robbins, J.L., Daneman, J.C.: The Best Known Statistic – Coefficient of Determination (r2): What it does and does not do in Regression Analysis. National Estimator Fall 2002, 18–27 (2002)Google Scholar