The Annotated Transformer
Alexander M. Rush · 2018
A major aim of open-source NLP is to quickly and accurately reproduce the results of new work, in a manner that the community can easily use and modify.While most papers publish enough detail for replication, it still may be difficult to achieve good results in practice.This paper is an experiment.In it, I consider a worked exercise with the goal of implementing the results of the recent paper.The replication exercise aims at simple code structure that follows closely with the original work, while achieving an efficient usable system.An implicit premise of this exercise is to encourage researchers to consider this method for new results.