Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach

Charlotte van Hooijdonk, Emiel Krahmer, Alfons Maes, Mariët Theune, Wauter Bosma

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    39 Downloads (Pure)


    This paper describes a production experiment carried out to determine which modalities people choose to answer different types of questions. In this experiment participants had to create (multimodal) presentations of answers to general medical questions. The collected answer presentations were coded on types of manipulations (typographic, spatial, graphical), presence of visual media (i.e., photos, graphics, and animations), functions and position of these visual media. The results of a first analysis indicated that participants presented the information in a multimodal way. Moreover, significant differences were found in the information presentation of different answer and question types.
    Original languageEnglish
    Title of host publicationMOG 2007
    Subtitle of host publicationWorkshop on Multimodal Output Generation: CTIT Proceedings
    EditorsIelke van der Sluis, Mariët Theune, Ehud Reiter, Emiel Krahmer
    Place of PublicationEnschede
    PublisherCentre for Telematics and Information Technology (CTIT)
    Number of pages12
    Publication statusPublished - 25 Jan 2007
    EventWorkshop on Multimodal Output Generation, MOG 2007 - University of Aberdeen, Aberdeen, Scotland, United Kingdom
    Duration: 25 Jan 200726 Jan 2007

    Publication series

    NameCTIT Workshop Proceedings
    ISSN (Print)1574-0846
    ISSN (Electronic)0929-0672


    WorkshopWorkshop on Multimodal Output Generation, MOG 2007
    Abbreviated titleMOG
    Country/TerritoryUnited Kingdom
    CityAberdeen, Scotland


    • Multimodal information presentation
    • Cognitive engineering


    Dive into the research topics of 'Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach'. Together they form a unique fingerprint.

    Cite this