Generating a Category Set of Words Using a Hierarchical Part-of-Speech System and Tagged Corpus
丈幸 小島, 善行 小谷 · Waseda University Repository (Waseda University) · 2002
In this paper, we propose a method of generating a proper categorization of morphemes by giving a hierarchical part-of-speech system and a corpus tagged using this part-ofspeech system.Our method use hierarchical information in the part-of-speech system and statistical information in the corpus to generate a category set.The statistical information is based on the context of occurrence of categories.First, we specify the format of given information.Then, we describe an algorithm to generate a proper categorization.Finally, we present the results of our experiments in applying this method.We obtaind a moderately proper categorization and found several candidates for improvement.