Corpus Database Management Design for Chinese-Portuguese Bidirectional Parallel Corpora
Lap Man Hoi, Wei Ke, Sio‐Kei Im · 2023
As deep learning techniques continue to mature, machine translation (MT) is gaining popularity among translators. However, the accuracy of machine translation depends not only on the size of the parallel corpus but also on the quality of the parallel corpus. The management of these massive parallel corpora is often unaware due to the lack of tools. As a result, many conflicting and confusing parallel corpora are trained together to influence the MT engines. Therefore, this study proposes a novel parallel corpus database design aimed at assisting data management efforts. After a series of experimental tests, our proposed database design can effectively generate domain-specific MT models with better BiLingual Evaluation Understudy (BLEU) values than other models. Furthermore, this database design helps to analyze, validate, and evaluate the quality of parallel corpora in database engines.