This paper describes a production experiment carried out to determine which modalities people choose to answer different types of questions. In this experiment participants had to create (multimodal) presentations of answers to general medical questions. The collected answer presentations were coded on types of manipulations (typographic, spatial, graphical), presence of visual media (i.e., photos, graphics, and animations), functions and position of these visual media. The results of a first analysis indicated that participants presented the information in a multimodal way. Moreover, significant differences were found in the information presentation of different answer and question types.
|Title of host publication||MOG 2007|
|Subtitle of host publication||Workshop on Multimodal Output Generation: CTIT Proceedings|
|Editors||Ielke van der Sluis, Mariët Theune, Ehud Reiter, Emiel Krahmer|
|Place of Publication||Enschede|
|Publisher||Centre for Telematics and Information Technology (CTIT)|
|Number of pages||12|
|Publication status||Published - 25 Jan 2007|
|Event||Workshop on Multimodal Output Generation, MOG 2007 - University of Aberdeen, Aberdeen, Scotland, United Kingdom|
Duration: 25 Jan 2007 → 26 Jan 2007
|Name||CTIT Workshop Proceedings|
|Workshop||Workshop on Multimodal Output Generation, MOG 2007|
|Period||25/01/07 → 26/01/07|
- Multimodal information presentation
- Cognitive engineering
van Hooijdonk, C., Krahmer, E., Maes, A., Theune, M., & Bosma, W. (2007). Towards automatic generation of multimodal answers to medical questions: a cognitive engineering approach. In I. van der Sluis, M. Theune, E. Reiter, & E. Krahmer (Eds.), MOG 2007: Workshop on Multimodal Output Generation: CTIT Proceedings (pp. 93-104). (CTIT Workshop Proceedings; No. 07-01). Enschede: Centre for Telematics and Information Technology (CTIT).