A generic architecture and dialogue model for multimodal interaction

D.H.W. Hofs, Hendrikus J.A. op den Akker, Antinus Nijholt

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    61 Downloads (Pure)

    Abstract

    This paper presents a generic architecture and a dialogue model for multimodal interaction. Architecture and model are transparent and have been used for different task domains. In this paper the emphasis is on their use for the navigation task in a virtual environment. The dialogue model is based on the information state approach and the recognition of dialogue acts. We explain how pairs of backward and forward looking tags and the preference rules of the dialogue act determiner together determine the structure of the dialogues that can be handled by the system. The system action selection mechanism and the problem of reference resolution are discussed in detail.
    Original languageUndefined
    Title of host publicationProceedings of the 1st Nordic Symposium on Multimodal Communication
    EditorsP. Paggio, K. Jokinen, A. Jönsson
    Place of PublicationCopenhagen
    PublisherCST Publication, Center for Sprokteknologi
    Pages79-91
    Number of pages13
    Publication statusPublished - Sep 2003
    Event1st Nordic Symposium on Multimodal Communication - Copenhagen, Denmark
    Duration: 25 Sep 200326 Sep 2003

    Publication series

    Name
    PublisherCST Publication, Center for Sprogteknologi
    Volume1
    ISSN (Print)1600-339X

    Workshop

    Workshop1st Nordic Symposium on Multimodal Communication
    Period25/09/0326/09/03
    Other25-26 Sep 2003

    Keywords

    • IR-66310
    • METIS-217378
    • EWI-6698

    Cite this