KonTra at CMCL 2021 Shared Task: Predicting Eye Movements by Combining BERT with Surface, Linguistic and Behavioral Information
Qi Yu, Aikaterini-Lida Kalouli, Diego Frassinelli · 2021
This paper describes the submission of the team KonTra to the CMCL 2021 Shared Task on eye-tracking prediction.Our system combines the embeddings extracted from a finetuned BERT model with surface, linguistic and behavioral features, resulting in an average mean absolute error of 4.22 across all 5 eyetracking measures.We show that word length and features representing the expectedness of a word are consistently the strongest predictors across all 5 eye-tracking measures.