Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support

A.I. Niculescu; Y. Cao

doi:10.1007/978-3-642-12397-9_11

Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support

A.I. Niculescu
, Y. Cao

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

12 Citations (Scopus)

16 Downloads (Pure)

Abstract

The quality assessment of multimodal conversational interfaces is influenced by many factors. Stress and cognitive load are two of most important. In the literature, these two factors are considered as being related and accordingly summarized under the single concept of ‘cognitive demand’. However, our assumption is that even if they are related, these two factors can still occur independently. Therefore, it is essential to control their levels during the interaction in order to determine the impact that each factor has on the perceived conversational quality. In this paper we present preliminary experiments in which we tried to achieve a factor separation by inducing alternating low/high levels of both stress and cognitive load. The stress/cognitive load levels were manipulated by varying task difficulty, information presentation and time pressure. Physiological measurements, performance metrics, as well as subjective reports were deployed to validate the induced stress and cognitive load levels. Results showed that our manipulations were successful for the cognitive load and partly for the stress. The levels of both factors were better indicated by subjective reports and performance metrics than by physiological measurements.

Original language	Undefined
Title of host publication	Development of Multimodal Interfaces: Active Listening and Synchrony
Editors	A. Esposito, N. Campbell, C. Vogel, A. Hussain, Antinus Nijholt
Place of Publication	Heidelberg
Publisher	Springer
Pages	134-147
Number of pages	15
ISBN (Print)	978-3-642-12396-2
DOIs	https://doi.org/10.1007/978-3-642-12397-9_11
Publication status	Published - 2010
Event	Second COST 2102 International Training School on Development of Multimodal Interfaces: Active Listening and Synchrony - Dublin, Ireland Duration: 23 Mar 2009 → 27 Mar 2009

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Verlag
Volume	5967
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Workshop

Workshop	Second COST 2102 International Training School on Development of Multimodal Interfaces: Active Listening and Synchrony
Period	23/03/09 → 27/03/09
Other	23-27 March 2009

Keywords

IR-70726
METIS-270733
Multimodal interfaces
Cognitive load
Stress
EWI-17441
physiological measurements
verbal communication
HMI-MI: MULTIMODAL INTERACTIONS
HMI-HF: Human Factors
qualitative evaluations

Access to Document

10.1007/978-3-642-12397-9_11

http://eprints.eemcs.utwente.nl/secure2/17441/01/dublin2009.pdf

Cite this

Niculescu, A. I., & Cao, Y. (2010). Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support. In A. Esposito, N. Campbell, C. Vogel, A. Hussain, & A. Nijholt (Eds.), Development of Multimodal Interfaces: Active Listening and Synchrony (pp. 134-147). (Lecture Notes in Computer Science; Vol. 5967). Springer. https://doi.org/10.1007/978-3-642-12397-9_11

Niculescu, A.I. ; Cao, Y. / Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support. Development of Multimodal Interfaces: Active Listening and Synchrony. editor / A. Esposito ; N. Campbell ; C. Vogel ; A. Hussain ; Antinus Nijholt. Heidelberg : Springer, 2010. pp. 134-147 (Lecture Notes in Computer Science).

@inproceedings{4642f9034a9d47a8a94e964d671358dc,

title = "Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support",

abstract = "The quality assessment of multimodal conversational interfaces is influenced by many factors. Stress and cognitive load are two of most important. In the literature, these two factors are considered as being related and accordingly summarized under the single concept of {\textquoteleft}cognitive demand{\textquoteright}. However, our assumption is that even if they are related, these two factors can still occur independently. Therefore, it is essential to control their levels during the interaction in order to determine the impact that each factor has on the perceived conversational quality. In this paper we present preliminary experiments in which we tried to achieve a factor separation by inducing alternating low/high levels of both stress and cognitive load. The stress/cognitive load levels were manipulated by varying task difficulty, information presentation and time pressure. Physiological measurements, performance metrics, as well as subjective reports were deployed to validate the induced stress and cognitive load levels. Results showed that our manipulations were successful for the cognitive load and partly for the stress. The levels of both factors were better indicated by subjective reports and performance metrics than by physiological measurements.",

keywords = "IR-70726, METIS-270733, Multimodal interfaces, Cognitive load, Stress, EWI-17441, physiological measurements, verbal communication, HMI-MI: MULTIMODAL INTERACTIONS, HMI-HF: Human Factors, qualitative evaluations",

author = "A.I. Niculescu and Y. Cao",

note = "10.1007/978-3-642-12397-9\_11 ; Second COST 2102 International Training School on Development of Multimodal Interfaces: Active Listening and Synchrony ; Conference date: 23-03-2009 Through 27-03-2009",

year = "2010",

doi = "10.1007/978-3-642-12397-9\_11",

language = "Undefined",

isbn = "978-3-642-12396-2",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "134--147",

editor = "A. Esposito and N. Campbell and C. Vogel and A. Hussain and Antinus Nijholt",

booktitle = "Development of Multimodal Interfaces: Active Listening and Synchrony",

address = "Germany",

}

Niculescu, AI & Cao, Y 2010, Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support. in A Esposito, N Campbell, C Vogel, A Hussain & A Nijholt (eds), Development of Multimodal Interfaces: Active Listening and Synchrony. Lecture Notes in Computer Science, vol. 5967, Springer, Heidelberg, pp. 134-147, Second COST 2102 International Training School on Development of Multimodal Interfaces: Active Listening and Synchrony, 23/03/09. https://doi.org/10.1007/978-3-642-12397-9_11

Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support. / Niculescu, A.I.; Cao, Y.
Development of Multimodal Interfaces: Active Listening and Synchrony. ed. / A. Esposito; N. Campbell; C. Vogel; A. Hussain; Antinus Nijholt. Heidelberg: Springer, 2010. p. 134-147 (Lecture Notes in Computer Science; Vol. 5967).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support

AU - Niculescu, A.I.

AU - Cao, Y.

N1 - 10.1007/978-3-642-12397-9_11

PY - 2010

Y1 - 2010

N2 - The quality assessment of multimodal conversational interfaces is influenced by many factors. Stress and cognitive load are two of most important. In the literature, these two factors are considered as being related and accordingly summarized under the single concept of ‘cognitive demand’. However, our assumption is that even if they are related, these two factors can still occur independently. Therefore, it is essential to control their levels during the interaction in order to determine the impact that each factor has on the perceived conversational quality. In this paper we present preliminary experiments in which we tried to achieve a factor separation by inducing alternating low/high levels of both stress and cognitive load. The stress/cognitive load levels were manipulated by varying task difficulty, information presentation and time pressure. Physiological measurements, performance metrics, as well as subjective reports were deployed to validate the induced stress and cognitive load levels. Results showed that our manipulations were successful for the cognitive load and partly for the stress. The levels of both factors were better indicated by subjective reports and performance metrics than by physiological measurements.

AB - The quality assessment of multimodal conversational interfaces is influenced by many factors. Stress and cognitive load are two of most important. In the literature, these two factors are considered as being related and accordingly summarized under the single concept of ‘cognitive demand’. However, our assumption is that even if they are related, these two factors can still occur independently. Therefore, it is essential to control their levels during the interaction in order to determine the impact that each factor has on the perceived conversational quality. In this paper we present preliminary experiments in which we tried to achieve a factor separation by inducing alternating low/high levels of both stress and cognitive load. The stress/cognitive load levels were manipulated by varying task difficulty, information presentation and time pressure. Physiological measurements, performance metrics, as well as subjective reports were deployed to validate the induced stress and cognitive load levels. Results showed that our manipulations were successful for the cognitive load and partly for the stress. The levels of both factors were better indicated by subjective reports and performance metrics than by physiological measurements.

KW - IR-70726

KW - METIS-270733

KW - Multimodal interfaces

KW - Cognitive load

KW - Stress

KW - EWI-17441

KW - physiological measurements

KW - verbal communication

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - HMI-HF: Human Factors

KW - qualitative evaluations

U2 - 10.1007/978-3-642-12397-9_11

DO - 10.1007/978-3-642-12397-9_11

M3 - Conference contribution

SN - 978-3-642-12396-2

T3 - Lecture Notes in Computer Science

SP - 134

EP - 147

BT - Development of Multimodal Interfaces: Active Listening and Synchrony

A2 - Esposito, A.

A2 - Campbell, N.

A2 - Vogel, C.

A2 - Hussain, A.

A2 - Nijholt, Antinus

PB - Springer

CY - Heidelberg

T2 - Second COST 2102 International Training School on Development of Multimodal Interfaces: Active Listening and Synchrony

Y2 - 23 March 2009 through 27 March 2009

ER -

Niculescu AI, Cao Y. Manipulating Stress and Cognitive Load in Conversational Interactions with a Multimodal System for Crisis Management Support. In Esposito A, Campbell N, Vogel C, Hussain A, Nijholt A, editors, Development of Multimodal Interfaces: Active Listening and Synchrony. Heidelberg: Springer. 2010. p. 134-147. (Lecture Notes in Computer Science). doi: 10.1007/978-3-642-12397-9_11