A Mongolian-Chinese neural machine translation model based on Transformer’s two-branch gating structure
Genmao Zhang, Yonghong Tian, Jia Hao, Junjin Zhang · 2022
To design a new two-branch gating structure for the existence of Transformer structure, by dividing the attention mechanism into two pieces, one part adopts the attention mechanism for global information capture and the other part adopts dynamic convolution for local information capture, and the captured two-branch is fused with features by way of gating mechanism to replace the attention mechanism and feedforward neural network, which makes the model fewer parameters and higher ability of capturing information. The experimental results show that our BLEU4 value is improved by 3. 07 compared to the Transformer structure.