An annotation scheme for agreement analysis
Siew Leng Toh, Fan Yang, Peter A. Heeman · 2006
To accomplish a task that requires collaboration, people would first agree on a strategy and then together carry it out [1]. Our research interest lies in understanding how people explore different strategies and reach an agreement in conversation. We began by examining two-person dialogues in a very limited domain, in which we could just focus on the agreement process. In this paper, we describe an annotation scheme of coding the conversants ’ behaviors of exploring possible strategies, suggesting and accepting the optimal one, and then maintaining it. We report the inter-coder reliability of the annotation scheme on three expert annotators and two non-experts. Index Terms: annotation scheme, agreement, inter-coder reliability, dialogue.