Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach

Charlotte van Hooijdonk; Emiel Krahmer; Alfons Maes; Mariët  Theune; Wauter Bosma

Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach

Charlotte van Hooijdonk, Emiel Krahmer, Alfons Maes, Mariët Theune, Wauter Bosma

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

15 Downloads (Pure)

Abstract

This paper describes a production experiment carried out to determine which modalities people choose to answer different types of questions. In this experiment participants had to create (multimodal) presentations of answers to general medical questions. The collected answer presentations were coded on types of manipulations (typographic, spatial, graphical), presence of visual media (i.e., photos, graphics, and animations), functions and position of these visual media. The results of a first analysis indicated that participants presented the information in a multimodal way. Moreover, significant differences were found in the information presentation of different answer and question types.

Original language	English
Title of host publication	MOG 2007
Subtitle of host publication	Workshop on Multimodal Output Generation: CTIT Proceedings
Editors	Ielke van der Sluis, Mariët Theune, Ehud Reiter, Emiel Krahmer
Place of Publication	Enschede
Publisher	Centre for Telematics and Information Technology (CTIT)
Pages	93-104
Number of pages	12
Publication status	Published - 25 Jan 2007
Event	Workshop on Multimodal Output Generation, MOG 2007 - University of Aberdeen, Aberdeen, Scotland, United Kingdom Duration: 25 Jan 2007 → 26 Jan 2007

Publication series

Name	CTIT Workshop Proceedings
Publisher	CTIT
Number	07-01
ISSN (Print)	1574-0846
ISSN (Electronic)	0929-0672

Workshop

Workshop	Workshop on Multimodal Output Generation, MOG 2007
Abbreviated title	MOG
Country	United Kingdom
City	Aberdeen, Scotland
Period	25/01/07 → 26/01/07

Keywords

Multimodal information presentation
Cognitive engineering

Access to Document

VanHooijdonk2007towards
open
Final published version, 376 KB

Fingerprint Dive into the research topics of 'Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach'. Together they form a unique fingerprint.

Cite this

van Hooijdonk, C., Krahmer, E., Maes, A., Theune, M., & Bosma, W. (2007). Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach. In I. van der Sluis, M. Theune, E. Reiter, & E. Krahmer (Eds.), MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings (pp. 93-104). (CTIT Workshop Proceedings; No. 07-01). Enschede: Centre for Telematics and Information Technology (CTIT).

van Hooijdonk, Charlotte ; Krahmer, Emiel ; Maes, Alfons ; Theune, Mariët ; Bosma, Wauter. / Towards automatic generation of multimodal answers to medical questions : a cognitive engineering approach. MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings. editor / Ielke van der Sluis ; Mariët Theune ; Ehud Reiter ; Emiel Krahmer. Enschede : Centre for Telematics and Information Technology (CTIT), 2007. pp. 93-104 (CTIT Workshop Proceedings; 07-01).

@inproceedings{6e89689f467241f9890b40d164382a33,

title = "Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach",

abstract = "This paper describes a production experiment carried out to determine which modalities people choose to answer different types of questions. In this experiment participants had to create (multimodal) presentations of answers to general medical questions. The collected answer presentations were coded on types of manipulations (typographic, spatial, graphical), presence of visual media (i.e., photos, graphics, and animations), functions and position of these visual media. The results of a first analysis indicated that participants presented the information in a multimodal way. Moreover, significant differences were found in the information presentation of different answer and question types.",

keywords = "Multimodal information presentation, Cognitive engineering",

author = "{van Hooijdonk}, Charlotte and Emiel Krahmer and Alfons Maes and Mari{\"e}t Theune and Wauter Bosma",

year = "2007",

month = "1",

day = "25",

language = "English",

series = "CTIT Workshop Proceedings",

publisher = "Centre for Telematics and Information Technology (CTIT)",

number = "07-01",

pages = "93--104",

editor = "{van der Sluis}, Ielke and Mari{\"e}t Theune and Ehud Reiter and Emiel Krahmer",

booktitle = "MOG 2007",

address = "Netherlands",

}

van Hooijdonk, C, Krahmer, E, Maes, A, Theune, M & Bosma, W 2007, Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach. in I van der Sluis, M Theune, E Reiter & E Krahmer (eds), MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings. CTIT Workshop Proceedings, no. 07-01, Centre for Telematics and Information Technology (CTIT), Enschede, pp. 93-104, Workshop on Multimodal Output Generation, MOG 2007, Aberdeen, Scotland, United Kingdom, 25/01/07.

Towards automatic generation of multimodal answers to medical questions : a cognitive engineering approach. / van Hooijdonk, Charlotte; Krahmer, Emiel; Maes, Alfons; Theune, Mariët ; Bosma, Wauter.

MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings. ed. / Ielke van der Sluis; Mariët Theune; Ehud Reiter; Emiel Krahmer. Enschede : Centre for Telematics and Information Technology (CTIT), 2007. p. 93-104 (CTIT Workshop Proceedings; No. 07-01).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Towards automatic generation of multimodal answers to medical questions

T2 - a cognitive engineering approach

AU - van Hooijdonk, Charlotte

AU - Krahmer, Emiel

AU - Maes, Alfons

AU - Theune, Mariët

AU - Bosma, Wauter

PY - 2007/1/25

Y1 - 2007/1/25

N2 - This paper describes a production experiment carried out to determine which modalities people choose to answer different types of questions. In this experiment participants had to create (multimodal) presentations of answers to general medical questions. The collected answer presentations were coded on types of manipulations (typographic, spatial, graphical), presence of visual media (i.e., photos, graphics, and animations), functions and position of these visual media. The results of a first analysis indicated that participants presented the information in a multimodal way. Moreover, significant differences were found in the information presentation of different answer and question types.

AB - This paper describes a production experiment carried out to determine which modalities people choose to answer different types of questions. In this experiment participants had to create (multimodal) presentations of answers to general medical questions. The collected answer presentations were coded on types of manipulations (typographic, spatial, graphical), presence of visual media (i.e., photos, graphics, and animations), functions and position of these visual media. The results of a first analysis indicated that participants presented the information in a multimodal way. Moreover, significant differences were found in the information presentation of different answer and question types.

KW - Multimodal information presentation

KW - Cognitive engineering

M3 - Conference contribution

T3 - CTIT Workshop Proceedings

SP - 93

EP - 104

BT - MOG 2007

A2 - van der Sluis, Ielke

A2 - Theune, Mariët

A2 - Reiter, Ehud

A2 - Krahmer, Emiel

PB - Centre for Telematics and Information Technology (CTIT)

CY - Enschede

ER -

van Hooijdonk C, Krahmer E, Maes A, Theune M, Bosma W. Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach. In van der Sluis I, Theune M, Reiter E, Krahmer E, editors, MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings. Enschede: Centre for Telematics and Information Technology (CTIT). 2007. p. 93-104. (CTIT Workshop Proceedings; 07-01).