The 2018 Shared Task on Extrinsic Parser Evaluation: On the Downstream Utility of
Murhaf Fares, Stephan Oepen, Lilja Øvrelid, Jari Björne, Richard Johansson · Proceedings of the · 2018
We summarize empirical results and tentative conclusions from the Second Extrinsic Parser Evaluation Initiative (EPE 2018).We review the basic task setup, downstream applications involved, and end-to-end results for seventeen participating parsers.Based on both quantitative and qualitative analysis, we correlate intrinsic evaluation results at different layers of morphsyntactic analysis with observed downstream behavior.