Stress and Cognitive Load in Multimodal Conversational Interactions

A.I. Niculescu; Y. Cao; Antinus Nijholt

Stress and Cognitive Load in Multimodal Conversational Interactions

A.I. Niculescu
, Y. Cao
, Antinus Nijholt

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

1 Downloads (Pure)

Abstract

The quality assessment of multimodal conversational interactions is determined by many influence parameters. Stress and cognitive load are two of them. In order to assess the impact of stress and cognitive load on the perceived conversational quality it is essential to control their levels during the interaction. Therefore we present in this paper preliminary experiments carried out to determine the circumstances in which low/high levels of stress respectively cognitive load are achieved while interacting with the system. Different levels are manipulated by varying task difficulty (information complexity, task load, and simulated speech recognition errors), information presentation (modality usage, spatial organization and temporal order of information items) and time pressure. Heart rate variability (HRV) and galvanic skin response (GSR) as well as subjective judgments in the form of questionnaires are deployed to validate the induced stress and cognitive levels. Methods and preliminary results are presented.

Original language	Undefined
Title of host publication	HCI International. 13th International Conference on Human-Computer Interaction
Editors	C. Stephanides
Place of Publication	Heidelberg
Publisher	Springer
Pages	891-895
Number of pages	5
ISBN (Print)	978-3-642-02884-7
Publication status	Published - 19 Jul 2009
Event	13th International Conference on Human-Computer Interaction, HCI International 2009 - San Diego, United States Duration: 19 Jul 2009 → 23 Jul 2009 Conference number: 13 http://2009.hci.international/index.php?module=conference&CF_op=view&CF_id=21

Publication series

Name	Proceedings and Poster DVD
Publisher	Springer Verlag

Conference

Conference	13th International Conference on Human-Computer Interaction, HCI International 2009
Abbreviated title	HCI International
Country/Territory	United States
City	San Diego
Period	19/07/09 → 23/07/09
Internet address	http://2009.hci.international/index.php?module=conference&CF_op=view&CF_id=21

Keywords

IR-67819
METIS-263934
Cognitive load
EWI-15741
multimodal conversation
HMI-MI: MULTIMODAL INTERACTIONS
HMI-HF: Human Factors
Stress

Access to Document

http://eprints.eemcs.utwente.nl/secure2/15741/01/hcii2009-an2.pdf

Cite this

@inproceedings{3c76989e7b454512bf0b8ce25673f435,

title = "Stress and Cognitive Load in Multimodal Conversational Interactions",

abstract = "The quality assessment of multimodal conversational interactions is determined by many influence parameters. Stress and cognitive load are two of them. In order to assess the impact of stress and cognitive load on the perceived conversational quality it is essential to control their levels during the interaction. Therefore we present in this paper preliminary experiments carried out to determine the circumstances in which low/high levels of stress respectively cognitive load are achieved while interacting with the system. Different levels are manipulated by varying task difficulty (information complexity, task load, and simulated speech recognition errors), information presentation (modality usage, spatial organization and temporal order of information items) and time pressure. Heart rate variability (HRV) and galvanic skin response (GSR) as well as subjective judgments in the form of questionnaires are deployed to validate the induced stress and cognitive levels. Methods and preliminary results are presented.",

keywords = "IR-67819, METIS-263934, Cognitive load, EWI-15741, multimodal conversation, HMI-MI: MULTIMODAL INTERACTIONS, HMI-HF: Human Factors, Stress",

author = "A.I. Niculescu and Y. Cao and Antinus Nijholt",

year = "2009",

month = jul,

day = "19",

language = "Undefined",

isbn = "978-3-642-02884-7",

series = "Proceedings and Poster DVD",

publisher = "Springer",

pages = "891--895",

editor = "C. Stephanides",

booktitle = "HCI International. 13th International Conference on Human-Computer Interaction",

address = "Germany",

note = "13th International Conference on Human-Computer Interaction, HCI International 2009 ; Conference date: 19-07-2009 Through 23-07-2009",

url = "http://2009.hci.international/index.php?module=conference\&CF\_op=view\&CF\_id=21",

}

Niculescu, AI, Cao, Y & Nijholt, A 2009, Stress and Cognitive Load in Multimodal Conversational Interactions. in C Stephanides (ed.), HCI International. 13th International Conference on Human-Computer Interaction. Proceedings and Poster DVD, Springer, Heidelberg, pp. 891-895, 13th International Conference on Human-Computer Interaction, HCI International 2009, San Diego, California, United States, 19/07/09. <http://eprints.eemcs.utwente.nl/secure2/15741/01/hcii2009-an2.pdf>

Stress and Cognitive Load in Multimodal Conversational Interactions. / Niculescu, A.I.; Cao, Y.; Nijholt, Antinus.
HCI International. 13th International Conference on Human-Computer Interaction. ed. / C. Stephanides. Heidelberg: Springer, 2009. p. 891-895 (Proceedings and Poster DVD).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Stress and Cognitive Load in Multimodal Conversational Interactions

AU - Niculescu, A.I.

AU - Cao, Y.

AU - Nijholt, Antinus

N1 - Conference code: 13

PY - 2009/7/19

Y1 - 2009/7/19

N2 - The quality assessment of multimodal conversational interactions is determined by many influence parameters. Stress and cognitive load are two of them. In order to assess the impact of stress and cognitive load on the perceived conversational quality it is essential to control their levels during the interaction. Therefore we present in this paper preliminary experiments carried out to determine the circumstances in which low/high levels of stress respectively cognitive load are achieved while interacting with the system. Different levels are manipulated by varying task difficulty (information complexity, task load, and simulated speech recognition errors), information presentation (modality usage, spatial organization and temporal order of information items) and time pressure. Heart rate variability (HRV) and galvanic skin response (GSR) as well as subjective judgments in the form of questionnaires are deployed to validate the induced stress and cognitive levels. Methods and preliminary results are presented.

AB - The quality assessment of multimodal conversational interactions is determined by many influence parameters. Stress and cognitive load are two of them. In order to assess the impact of stress and cognitive load on the perceived conversational quality it is essential to control their levels during the interaction. Therefore we present in this paper preliminary experiments carried out to determine the circumstances in which low/high levels of stress respectively cognitive load are achieved while interacting with the system. Different levels are manipulated by varying task difficulty (information complexity, task load, and simulated speech recognition errors), information presentation (modality usage, spatial organization and temporal order of information items) and time pressure. Heart rate variability (HRV) and galvanic skin response (GSR) as well as subjective judgments in the form of questionnaires are deployed to validate the induced stress and cognitive levels. Methods and preliminary results are presented.

KW - IR-67819

KW - METIS-263934

KW - Cognitive load

KW - EWI-15741

KW - multimodal conversation

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - HMI-HF: Human Factors

KW - Stress

M3 - Conference contribution

SN - 978-3-642-02884-7

T3 - Proceedings and Poster DVD

SP - 891

EP - 895

BT - HCI International. 13th International Conference on Human-Computer Interaction

A2 - Stephanides, C.

PB - Springer

CY - Heidelberg

T2 - 13th International Conference on Human-Computer Interaction, HCI International 2009

Y2 - 19 July 2009 through 23 July 2009

ER -