Lemmatisation and morphosyntactic annotation for the spoken Dutch corpus
Frank Van Eynde, Jakub Zavrel, Walter M. P. Daelemans · 1999
This paper describes the lemmatisation and tagging guidelines developed for the \\Spoken Dutch Corpus", and lays out the philosophy behind the high granularity tagset that was designed for the project. To bootstrap the annotation of large quantities of material (10 million words) with this new tagset we tested several existing taggers and tagger generators on initial samples of the corpus. The results show that the most eective method, when trained on the small samples, is a high quality implementation of a Hidden Markov Model tagger generator. However, we also show that a combination of systems improves the accuracy, and that this combinatory approach allows us to leverage existing taggers with dierent tagsets and lexical resources. 1 Introduction The Dutch-Flemish project \\Corpus Gesproken Nederlands" (1998-2003) aims at the collection, transcription and annotation of ten million words of spoken Dutch, see Oostdijk (this volume). The rst layer of linguistic annotation concerns th...