Automatic Extraction of Kazakh Language

Abstract

This paper focuses on the automatic extraction and frequency of the Kazakh Language. With automatic extraction of Kazakh Common-use words as the goal, we used a formula based on improved words filed general usage to calculate the lexical general usage of Kazakh Common-use words. This general usage was calculated on the basis of the filed usage of traditional words. This enabled an improved method which has greater ability to rank the position of Kazakh Common-use words and to implement the statistical system of Kazakh lexical general usage. Based on the Common-use word properties as Filed generality, Regional generality, and Time generality, we used statistical methods to investigate the general usage of Kazakh word. On the basis of frequency statistics of Kazakh words, we derived a formula for Kazakh lexical general usage. We extracted Common-use words in terms of the OK value of lexical general usage. Experimental results show that the improved calculation formula has greater ability to rank word position than the traditional method used to extract Kazakh Common-use words.