Improving Dialogue Annotation Reliability
Teresa Sikorski · 1998
Data collection and annotation represent the most signi cant portion of the e ort involved in building statistical models of dialogue. We must be able to annotate reliably if there is any hope of building predictive statistical models. This paper describes the annotation process being used to tag the TRAINS-93 corpus with dialogue acts, and measures we have taken to improve inter-annotator reliability.