A Taxonomy for In-depth Evaluation of Normalization for User Generated Content
Rob van der Goot, Rik van Noord, Gertjan van Noord · 2018
In this work we present a taxonomy of error categories for lexical normalization, which is the task of translating user generated content to canonical language.We annotate a recent normalization dataset to test the practical use of the taxonomy and read a near-perfect agreement.This annotated dataset is then used to evaluate how an existing normalization model performs on the different categories of the taxonomy.The results of this evaluation reveal that some of the problematic categories only include minor transformations, whereas most regular transformations are solved quite well.