Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach

Charlotte van Hooijdonk, Emiel Krahmer, Alfons Maes, Mariët Theune, Wauter Bosma

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    15 Downloads (Pure)

    Abstract

    This paper describes a production experiment carried out to determine which modalities people choose to answer different types of questions. In this experiment participants had to create (multimodal) presentations of answers to general medical questions. The collected answer presentations were coded on types of manipulations (typographic, spatial, graphical), presence of visual media (i.e., photos, graphics, and animations), functions and position of these visual media. The results of a first analysis indicated that participants presented the information in a multimodal way. Moreover, significant differences were found in the information presentation of different answer and question types.
    Original languageEnglish
    Title of host publicationMOG 2007
    Subtitle of host publicationWorkshop on Multimodal Output Generation: CTIT Proceedings
    EditorsIelke van der Sluis, Mariët Theune, Ehud Reiter, Emiel Krahmer
    Place of PublicationEnschede
    PublisherCentre for Telematics and Information Technology (CTIT)
    Pages93-104
    Number of pages12
    Publication statusPublished - 25 Jan 2007
    EventWorkshop on Multimodal Output Generation, MOG 2007 - University of Aberdeen, Aberdeen, Scotland, United Kingdom
    Duration: 25 Jan 200726 Jan 2007

    Publication series

    NameCTIT Workshop Proceedings
    PublisherCTIT
    Number07-01
    ISSN (Print)1574-0846
    ISSN (Electronic)0929-0672

    Workshop

    WorkshopWorkshop on Multimodal Output Generation, MOG 2007
    Abbreviated titleMOG
    CountryUnited Kingdom
    CityAberdeen, Scotland
    Period25/01/0726/01/07

    Keywords

    • Multimodal information presentation
    • Cognitive engineering

    Fingerprint Dive into the research topics of 'Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach'. Together they form a unique fingerprint.

  • Cite this

    van Hooijdonk, C., Krahmer, E., Maes, A., Theune, M., & Bosma, W. (2007). Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach. In I. van der Sluis, M. Theune, E. Reiter, & E. Krahmer (Eds.), MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings (pp. 93-104). (CTIT Workshop Proceedings; No. 07-01). Enschede: Centre for Telematics and Information Technology (CTIT).