A Shared Task of a New, Collaborative Type to Foster Reproducibility: A First Exercise in the Area of Language Science and Technology with REPROLANG2020
António Branco, Nicoletta Calzolari, Piek T. J. M. Vossen, Gertjan van Noord, Dieter Van Uytvanck, João Silva, Luis Barata Gomes, André Moreira, Willem Elbers · University of Groningen research database (University of Groningen / Centre for Information Technology) · 2020
In this paper, we introduce a new type of shared task — which is collaborative rather than competitive — designed to support and fosterthe reproduction of research results. We also describe the first event running such a novel challenge, present the results obtained, discussthe lessons learned and ponder on future undertakings.