Experimental Study Using Annotation Experiments
Cristina Grisot · Yearbook of corpus linguistics and pragmatics · 2018
Experimental study using annotation experiments, includes four main sections and ends with a summary. First, it discusses several issues linked to using annotation data, such as reliability, validity and the measurement of inter-annotator agreement. Following the proposal made in Grisot (J Pragmat 117:245–263, 2017a), inter-annotator agreement rates, measured with the Қ coefficient, are interpreted as dependent on the degree of accessibility to consciousness and the degree of availability to conscious thought, and, as such, on their conceptual or procedural nature. Second, it advances a series of hypotheses regarding the meaning of Tense, Aktionsart and Aspect, and their predictions with respect to comprehenders’ behaviour when they have to evaluate it consciously in annotation experiments. Third, it describes the annotation experiments and discuss their results. Fourth, in order to assess the role of Tense, Aktionsart and Aspect in predicting the verbal tense used in a target language, the results of a generalized mixed model suited to the data are discussed.