An exploratory approach to the Parallel Corpus Filtering shared task WMT20

Ankur Kejriwal, Philipp Koehn · 2020

This document describes an exploratory look into the Parallel Corpus Filtering Shared Task in WMT20.We submitted scores for both Pashto-English and Khmer-English systems combining multiple techniques like monolingual language model scores, length based filters, language ID filters with confidence and norm of embedings.

Read the paper · More papers on PaperTik