Report on the Second Second Challenge on Generating Instructions in Virtual Environments (GIVE-2.5)

Kristina Striegnitz, Alexandre Denis, Andrew Gargett, Konstantina Garoufi, Alexander Koller, Mariet Theune

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

    22 Citations (Scopus)
    21 Downloads (Pure)

    Abstract

    GIVE-2.5 evaluates eight natural language generation (NLG) systems that guide human users through solving a task in a virtual environment. The data is collected via the Internet, and to date, 536 interactions of subjects with one of the NLG systems have been recorded. The systems are compared using both task performance measures and subjective ratings by human users.
    Original languageUndefined
    Title of host publicationProceedings of the Generation Challenges Session at the 13th European Workshop on Natural Language Generation
    Place of PublicationNancy, France
    PublisherAssociation for Computational Linguistics (ACL)
    Pages270-279
    Number of pages10
    ISBN (Print)not assigned
    Publication statusPublished - Sep 2011

    Publication series

    Name
    PublisherAssociation for Computational Linguistics

    Keywords

    • IR-78532
    • EWI-20802
    • METIS-281564

    Cite this

    Striegnitz, K., Denis, A., Gargett, A., Garoufi, K., Koller, A., & Theune, M. (2011). Report on the Second Second Challenge on Generating Instructions in Virtual Environments (GIVE-2.5). In Proceedings of the Generation Challenges Session at the 13th European Workshop on Natural Language Generation (pp. 270-279). Nancy, France: Association for Computational Linguistics (ACL).