Active Learning and the Irish Treebank
Teresa Lynn, Jennifer Foster, Mark Dras, Elaine Uí Dhonnchadha · Dublin City University Open Access Institutional Repository (Dublin City University) · 2012
We report on our ongoing work in devel-oping the Irish Dependency Treebank, de-scribe the results of two Inter-annotator Agreement (IAA) studies, demonstrate improvements in annotation consistency which have a knock-on effect on parsing accuracy, and present the final set of de-pendency labels. We then go on to investi-gate the extent to which active learning can play a role in treebank and parser develop-ment by comparing an active learning boot-strapping approach to a passive approach in which sentences are chosen at random for manual revision. We show that active learn-ing outperforms passive learning, but when annotation effort is taken into account, it is not clear how much of an advantage the active learning approach has. Finally, we present results which suggest that adding automatic parses to the training data along with manually revised parses in an active learning setup does not greatly affect pars-ing accuracy. 1