Report on the Second Second Challenge on Generating Instructions in Virtual Environments (GIVE-2.5)
Kristina Striegnitz, Alexandre Denis, Andrew Gargett, Konstantina Garoufi, Alexander Koller, Mariët Theune · Open Research Online (The Open University) · 2011
GIVE-2.5 evaluates eight natural language generation (NLG) systems that guide human users through solving a task in a virtual environment. The data is collected via the Internet, and to date, 536 interactions of subjects with one of the NLG systems have been recorded. The systems are compared using both task performance measures and subjective ratings by human users. 1