Experiments in Multimodal Information Presentation

Charlotte van Hooijdonk, W.E. Bosma, Emiel Krahmer, Alfons Maes, Mariet Theune

    Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review


    In this chapter we describe three experiments investigating multimodal information presentation in the context of a medical QA system. In Experiment 1, we wanted to know how non-experts design (multimodal) answers to medical questions, distinguishing between what questions and how questions. In Experiment 2, we concentrated on how people evaluate multimodal (text+picture) answer presentations on their informativeness and attractiveness. In Experiment 3, we evaluated two versions of an automatic picture selection method, and compared answer presentations with automatically selected pictures to answer presentations with manually selected pictures.
    Original languageUndefined
    Title of host publicationInteractive Multi-modal Question-Answering
    EditorsAntal van den Bosch, Gosse Bouma
    Place of PublicationBerlin
    Number of pages27
    ISBN (Print)978-3-642-17524-4
    Publication statusPublished - May 2011

    Publication series

    NameTheory and Applications of Natural Language Processing
    PublisherSpringer Verlag
    ISSN (Print)2192-032X


    • IR-78521
    • EWI-20798
    • METIS-281561

    Cite this