Italian Transformers Under the Linguistic Lens
Alessio Miaschi, Gabriele Sarti, Dominique Brunato⋄, Felice Dell’Orletta⋄, Giulia Venturi⋄ · Accademia University Press eBooks · 2020
In this paper we present an in-depth investigation of the linguistic knowledge encoded by the transformer models currently available for the Italian language. In particular, we investigate whether and how using different architectures of probing models affects the performance of Italian transformers in encoding a wide spectrum of linguistic features. Moreover, we explore how this implicit knowledge varies according to different textual genres.