RU-EVAL-2012: Evaluating Dependency Parsers for Russian
Anastasia Gareyshina, Maxim Ionov, Olga Lyashevskaya, Dmitry Konstantinovich Privoznov, Елена Вячеславовна Соколова, Svetlana Toldova · 2012
The paper reports on the recent forum RU-EVAL ‒ a new initiative for evaluation of Russian NLP resources, methods and toolkits. It started in 2010 with evaluation of morphological parsers, and the second event RU-EVAL 2012 (2011-2012) focused on syntactic parsing. Eight participating IT companies and academic institutions submitted their results for corpus parsing. We discuss the results of this evaluation and describe the so-called “soПt ” evaluation principles that allowed us to compare output dependency trees, which varied greatly depending on theoretical approaches, parsing methods, tag sets, and dependency orientations principles, adopted by the participants. TITLE AND ABSTRACT IN RUSSIAN RU-EVAL-2012: Оц���а �а����� � ��а��а��� � �а����������