Returning the L in NLP: Why Language (Variety) Matters and How to Embrace it in Our Models
Barbara Plank · Accademia University Press eBooks · 2022
NLP’s success today is driven by advances in modeling together with huge amounts of unlabeled data to train language models. However, for many application scenarios like low-resource languages, non-standard data and dialects we do not have access to labeled resources and even unlabeled data might be scarce. Moreover, evaluation today largely focuses on standard splits, yet language varies along many dimensions (Plank 2016). What is more is that for almost every NLP task, the existence of a s...