Using word segmentation and SVM to assess readability of Thai text for primary school students
Patcharanut Daowadung, Yaw-Huei Chen · 2011
This research aims to develop a readability assessment technique to find appropriate Thai language reading materials for primary school students. The corpus contains 1050 articles from textbooks used by students from grade 1 to grade 6. We preprocess the articles by Ling CD program for Thai word segmentation and use mutual information (MI) to select the most important terms in the corpus. Term frequency and inverse document frequency (TF-IDF) are used as features for support vector machines (SVMs) to generate classification models. Experimental results show that the proposed method can reach 0.83 F-measure for identifying articles suitable for middle grades primary school students.