GIVE-2.5 evaluates eight natural language generation (NLG) systems that guide human users through solving a task in a virtual environment. The data is collected via the Internet, and to date, 536 interactions of subjects with one of the NLG systems have been recorded. The systems are compared using both task performance measures and subjective ratings by human users.
|Title of host publication||Proceedings of the Generation Challenges Session at the 13th European Workshop on Natural Language Generation|
|Place of Publication||Nancy, France|
|Publisher||Association for Computational Linguistics (ACL)|
|Number of pages||10|
|ISBN (Print)||not assigned|
|Publication status||Published - Sep 2011|
|Publisher||Association for Computational Linguistics|
Striegnitz, K., Denis, A., Gargett, A., Garoufi, K., Koller, A., & Theune, M. (2011). Report on the Second Second Challenge on Generating Instructions in Virtual Environments (GIVE-2.5). In Proceedings of the Generation Challenges Session at the 13th European Workshop on Natural Language Generation (pp. 270-279). Nancy, France: Association for Computational Linguistics (ACL).