The BIGAI Offline Speech Translation Systems for IWSLT 2023 Evaluation
Zhihang Xie · 2023
This paper describes the BIGAI's submission to IWSLT 2023 Offline Speech Translation task on three language tracks from English to Chinese, German and Japanese.The end-to-end systems are built upon a Wav2Vec2 model for speech recognition and mBART50 models for machine translation.An adapter module is applied to bridge the speech module and the translation module.The CTC loss between speech features and source token sequence is incorporated during training.Experiments show that the systems can generate reasonable translations on three languages.The proposed models achieve BLEU scores of 22.3, 10.7 and 33.0 on tst2023 en→de, en→ja and en→zh TED datasets.It is found that the performance is decreased by a significant margin on complex scenarios like presentations and interviews.