A generic architecture and dialogue model for multimodal interaction

D.H.W. Hofs, Hendrikus J.A. op den Akker, Antinus Nijholt

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    78 Downloads (Pure)


    This paper presents a generic architecture and a dialogue model for multimodal interaction. Architecture and model are transparent and have been used for different task domains. In this paper the emphasis is on their use for the navigation task in a virtual environment. The dialogue model is based on the information state approach and the recognition of dialogue acts. We explain how pairs of backward and forward looking tags and the preference rules of the dialogue act determiner together determine the structure of the dialogues that can be handled by the system. The system action selection mechanism and the problem of reference resolution are discussed in detail.
    Original languageUndefined
    Title of host publicationProceedings of the 1st Nordic Symposium on Multimodal Communication
    EditorsP. Paggio, K. Jokinen, A. Jönsson
    Place of PublicationCopenhagen
    PublisherCST Publication, Center for Sprokteknologi
    Number of pages13
    Publication statusPublished - Sep 2003
    Event1st Nordic Symposium on Multimodal Communication 2003 - Copenhagen, Denmark
    Duration: 25 Sep 200326 Sep 2003

    Publication series

    PublisherCST Publication, Center for Sprogteknologi
    ISSN (Print)1600-339X


    Workshop1st Nordic Symposium on Multimodal Communication 2003


    • IR-66310
    • METIS-217378
    • EWI-6698

    Cite this