Vidiam: Corpus-based Development of a Dialogue Manager for Multimodal Question Answering

B.W. van Schooten, Hendrikus J.A. op den Akker

    Research output: Chapter in Book/Report/Conference proceedingChapterAcademic

    209 Downloads (Pure)


    This chapter describes the Vidiam project, which covered the development of a dialogue management system for multimodal question answering (QA) dialogues, as carried out in the IMIX project. The approach followed was datadriven, i.e., corpus-based. Since research in QA dialogue of multimodal information retrieval is still new, no suitable corpora were available to base a system on. This chapter reports on the collection and analysis of three QA dialogue corpora, involving textual follow-up utterances, multimodal follow-up questions, and speech dialogues. Based on the data, a dialogue act typology was created, which helps translate user utterances to practical interactive QA strategies.
    Original languageUndefined
    Title of host publicationInteractive Multi-Modal Question Answering
    EditorsAntal van den Bosch, Gosse Bouma
    Place of PublicationBerlin, Heidelberg
    Number of pages30
    ISBN (Print)978-3-642-17524-4
    Publication statusPublished - May 2011

    Publication series

    NameTheory and Applications of Natural Language Processing
    PublisherSpringer Verlag
    ISSN (Print)2192-032X


    • METIS-286266
    • Multi-modal dialogue management
    • EWI-20809
    • iterative question answering
    • IR-80467

    Cite this