CONcreTEXT @ EVALITA2020: The Concreteness in Context Task
Lorenzo Gregori, Maria Montefinese, Daniele Paolo Radicioni, Andrea Amelio Ravelli, Rossella Varvara · Accademia University Press eBooks · 2020
Focus of the CONcreTEXT task is conceptual concreteness: systems were solicited to compute a value expressing to what extent target concepts are concrete (i.e., more or less perceptually salient) within a given context of occurrence. To these ends, we have developed a new dataset which was annotated with concreteness ratings and used as gold standard in the evaluation of systems. Four teams participated in this first edition of the task, with a total of 15 runs submitted.Interestingly, these works extend information on conceptual concreteness available in existing (non contextual) norms derived from human judgments with new knowledge from recently developed neural architectures, in much the same multidisciplinary spirit whereby the CONcreTEXT task was organized.