LexiClean: An annotation tool for rapid multi-task lexical normalisation
Tyler Bikaun, Tim French, Melinda R. Hodkiewicz, Michael G. Stewart, Wei Liu · 2021
NLP systems are often challenged by difficulties arising from noisy, non-standard, and domain specific corpora.The task of lexical normalisation aims to standardise such corpora, but currently lacks suitable tools to acquire high-quality annotated data to support deep learning based approaches.In this paper, we present LexiClean 1 , the first open-source web-based annotation tool for multi-task lexical normalisation.LexiClean's main contribution is support for simultaneous in situ token-level modification and annotation that can be rapidly applied corpus wide.We demonstrate the usefulness of our tool through a case study on two sets of noisy corpora derived from the specialiseddomain of industrial mining.We show that LexiClean allows for the rapid and efficient development of high-quality parallel corpora.A demo of our system is available at: https: //youtu.be/P7_ooKrQPDU.