Variable Mini-Batch Sizing and Pre-Trained Embeddings
Mostafa Abdou, Vladan Gloncak, Ondřej Bojar · 2017
This paper describes our submission to the WMT 2017 Neural MT Training Task.We modified the provided NMT system in order to allow for interrupting and continuing the training of models.This allowed mid-training batch size decrementation and incrementation at variable rates.In addition to the models with variable batch size, we tried different setups with pre-trained word2vec embeddings.Aside from batch size incrementation, all our experiments performed below the baseline.