Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention
Biao Zhang, Ivan S. Titov, Rico Sennrich · 2019
Biao Zhang, Ivan Titov, Rico Sennrich. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.