VALEVAL: Testing Vallex Consistency and Experimenting with Word-Frame Disambiguation.
Ondřej Bojar, Jiří Semecký, Václava Benešová · The Prague Bulletin of Mathematical Linguistics · 2005
VALLEX is a valency lexicon of Czech verbs. We briefly introduce VALLEX and then we describe and evaluate the VALEVAL experiment: annotation of 10256 corpus instances of 109 Czech verbs with valency frames. The inter-annotator agreement of three parallel annotations ranges from 61% to 74% and κ from 0.52 to 0.62. More than 8000 sentences are now available as the “golden VALEVAL” for word-sense disambiguation experiments. In out first attempts using morphological and syntactic information, we achieve the accuracy of 70% to 80%.