A mixed word / morphological approach for extending CELEX for high coverage on contemporary large corpora
Joris Vaneyghen, Guy De Pauw, Dirk Van Compernolle, Walter M. P. Daelemans · 2006
This paper describes an alternative approach to morphological language modeling, which incorporates constraints on the morphological production of new words.This is done by applying the constraints as a preprocessing step in which only one morphological production rule can be applied to an extended lexicon of known morphemes, lemmas and word forms.This approach is used to extend the CELEX Dutch morphological database, so that a higher coverage can be reached on a large corpus of Dutch newspaper articles.We present experimental results on the coverage of this extended database and use the extension to further evaluate our morphological system, as well as the impact of the constraints on the coverage of out-of-vocabulary words.