Research on Tibetan Stop Words Selection and Automatic Processing Method
Zhu Ji · Zhongwen xinxi xuebao · 2015
Stop words processing is a key preprocessing step in the text mining.In this paper,the selection method of stop words in Tibetan based on statistics is studied by combining with the existing techniques.Through experiments,TF,DF,and entropy calculation methods in the selection of Tibetan stop words are analyzed.An approach for the selection of Tibetan stop words is presented by the combination of Tibetan function words,special verb and automatic approach.The experimental results show that the proposed method can determine a reasonable Tibetan stop words list.