Towards Replicability in Parsing
Daniel Dakota, Sandra Kübler · 2017
We investigate parsing replicability across 7 languages (and 8 treebanks), showing that choices concerning the use of grammatical functions in parsing or evaluation and the influence of the rare word threshold, as well as choices in test sentences and evaluation script options have considerable and often unexpected effects on parsing accuracies.All of those choices need to be carefully documented if we want to ensure replicability.