Multi-modal affect induction for affective brain-computer interfaces

C. Mühl; Egon van den Broek; Anne-Marie Brouwer; Femke Nijboer; Nelleke van Wouwe; Dirk K.J. Heylen

doi:10.1007/978-3-642-24600-5_27

Multi-modal affect induction for affective brain-computer interfaces

C. Mühl, Egon van den Broek, Anne-Marie Brouwer, Femke Nijboer, Nelleke van Wouwe, Dirk K.J. Heylen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

8 Citations (Scopus)

124 Downloads (Pure)

Abstract

Reliable applications of affective brain-computer interfaces (aBCI) in realistic, multi-modal environments require a detailed understanding of the processes involved in emotions. To explore the modality-specific nature of affective responses, we studied neurophysiological responses (i.e., EEG) of 24 participants during visual, auditory, and audiovisual affect stimulation. The affect induction protocols were validated by participants’ subjective ratings and physiological responses (i.e., ECG). Coherent with literature, we found modality-specific responses in the EEG: posterior alpha power decreases during visual stimulation and increases during auditory stimulation, anterior alpha power tends to decrease during auditory stimulation and to increase during visual stimulation. We discuss the implications of these results for multi-modal aBCI.

Original language	Undefined
Title of host publication	Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Part I
Editors	Sidney D’Mello, Arthur Graesser, Björn Schuller, Jean-Claude Martin
Place of Publication	New York
Publisher	Springer
Pages	235-245
Number of pages	11
ISBN (Print)	978-3-642-24599-2
DOIs	https://doi.org/10.1007/978-3-642-24600-5_27
Publication status	Published - 9 Oct 2011
Event	4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011 - Memphis, United States Duration: 9 Oct 2011 → 12 Oct 2011 Conference number: 4

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Verlag
Volume	6974
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011
Abbreviated title	ASCII
Country/Territory	United States
City	Memphis
Period	9/10/11 → 12/10/11

Keywords

METIS-281551
Auditory
Affective brain-computer interfaces
BCI
IR-78513
ECG
HMI-CI: Computational Intelligence
Visual
Emotion
Multimodal
EWI-20762
HMI-MI: MULTIMODAL INTERACTIONS
HMI-HF: Human Factors
EEG

Access to Document

10.1007/978-3-642-24600-5_27

Muhl11-Multi-modal_affect_induction_for_affective_BCI

Cite this

Mühl, C., van den Broek, E., Brouwer, A.-M., Nijboer, F., van Wouwe, N., & Heylen, D. K. J. (2011). Multi-modal affect induction for affective brain-computer interfaces. In S. D’Mello, A. Graesser, B. Schuller, & J.-C. Martin (Eds.), Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Part I (pp. 235-245). (Lecture Notes in Computer Science; Vol. 6974). Springer. https://doi.org/10.1007/978-3-642-24600-5_27

Mühl, C. ; van den Broek, Egon ; Brouwer, Anne-Marie et al. / Multi-modal affect induction for affective brain-computer interfaces. Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Part I. editor / Sidney D’Mello ; Arthur Graesser ; Björn Schuller ; Jean-Claude Martin. New York : Springer, 2011. pp. 235-245 (Lecture Notes in Computer Science).

@inproceedings{b44083e8a5924da89740a9e65e77660a,

title = "Multi-modal affect induction for affective brain-computer interfaces",

abstract = "Reliable applications of affective brain-computer interfaces (aBCI) in realistic, multi-modal environments require a detailed understanding of the processes involved in emotions. To explore the modality-specific nature of affective responses, we studied neurophysiological responses (i.e., EEG) of 24 participants during visual, auditory, and audiovisual affect stimulation. The affect induction protocols were validated by participants{\textquoteright} subjective ratings and physiological responses (i.e., ECG). Coherent with literature, we found modality-specific responses in the EEG: posterior alpha power decreases during visual stimulation and increases during auditory stimulation, anterior alpha power tends to decrease during auditory stimulation and to increase during visual stimulation. We discuss the implications of these results for multi-modal aBCI.",

keywords = "METIS-281551, Auditory, Affective brain-computer interfaces, BCI, IR-78513, ECG, HMI-CI: Computational Intelligence, Visual, Emotion, Multimodal, EWI-20762, HMI-MI: MULTIMODAL INTERACTIONS, HMI-HF: Human Factors, EEG",

author = "C. M{\"u}hl and {van den Broek}, Egon and Anne-Marie Brouwer and Femke Nijboer and {van Wouwe}, Nelleke and Heylen, {Dirk K.J.}",

note = "10.1007/978-3-642-24600-5_27 ; 4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011 ; Conference date: 09-10-2011 Through 12-10-2011",

year = "2011",

month = oct,

day = "9",

doi = "10.1007/978-3-642-24600-5_27",

language = "Undefined",

isbn = "978-3-642-24599-2",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "235--245",

editor = "Sidney D{\textquoteright}Mello and Arthur Graesser and Bj{\"o}rn Schuller and Jean-Claude Martin",

booktitle = "Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Part I",

address = "Germany",

}

Mühl, C, van den Broek, E, Brouwer, A-M, Nijboer, F, van Wouwe, N & Heylen, DKJ 2011, Multi-modal affect induction for affective brain-computer interfaces. in S D’Mello, A Graesser, B Schuller & J-C Martin (eds), Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Part I. Lecture Notes in Computer Science, vol. 6974, Springer, New York, pp. 235-245, 4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011, Memphis, Tennessee, United States, 9/10/11. https://doi.org/10.1007/978-3-642-24600-5_27

Multi-modal affect induction for affective brain-computer interfaces. / Mühl, C.; van den Broek, Egon; Brouwer, Anne-Marie et al.
Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Part I. ed. / Sidney D’Mello; Arthur Graesser; Björn Schuller; Jean-Claude Martin. New York: Springer, 2011. p. 235-245 (Lecture Notes in Computer Science; Vol. 6974).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Multi-modal affect induction for affective brain-computer interfaces

AU - Mühl, C.

AU - van den Broek, Egon

AU - Brouwer, Anne-Marie

AU - Nijboer, Femke

AU - van Wouwe, Nelleke

AU - Heylen, Dirk K.J.

N1 - Conference code: 4

PY - 2011/10/9

Y1 - 2011/10/9

N2 - Reliable applications of affective brain-computer interfaces (aBCI) in realistic, multi-modal environments require a detailed understanding of the processes involved in emotions. To explore the modality-specific nature of affective responses, we studied neurophysiological responses (i.e., EEG) of 24 participants during visual, auditory, and audiovisual affect stimulation. The affect induction protocols were validated by participants’ subjective ratings and physiological responses (i.e., ECG). Coherent with literature, we found modality-specific responses in the EEG: posterior alpha power decreases during visual stimulation and increases during auditory stimulation, anterior alpha power tends to decrease during auditory stimulation and to increase during visual stimulation. We discuss the implications of these results for multi-modal aBCI.

AB - Reliable applications of affective brain-computer interfaces (aBCI) in realistic, multi-modal environments require a detailed understanding of the processes involved in emotions. To explore the modality-specific nature of affective responses, we studied neurophysiological responses (i.e., EEG) of 24 participants during visual, auditory, and audiovisual affect stimulation. The affect induction protocols were validated by participants’ subjective ratings and physiological responses (i.e., ECG). Coherent with literature, we found modality-specific responses in the EEG: posterior alpha power decreases during visual stimulation and increases during auditory stimulation, anterior alpha power tends to decrease during auditory stimulation and to increase during visual stimulation. We discuss the implications of these results for multi-modal aBCI.

KW - METIS-281551

KW - Auditory

KW - Affective brain-computer interfaces

KW - BCI

KW - IR-78513

KW - ECG

KW - HMI-CI: Computational Intelligence

KW - Visual

KW - Emotion

KW - Multimodal

KW - EWI-20762

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - HMI-HF: Human Factors

KW - EEG

U2 - 10.1007/978-3-642-24600-5_27

DO - 10.1007/978-3-642-24600-5_27

M3 - Conference contribution

SN - 978-3-642-24599-2

T3 - Lecture Notes in Computer Science

SP - 235

EP - 245

BT - Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Part I

A2 - D’Mello, Sidney

A2 - Graesser, Arthur

A2 - Schuller, Björn

A2 - Martin, Jean-Claude

PB - Springer

CY - New York

T2 - 4th International Conference on Affective Computing and Intelligent Interaction, ASCII 2011

Y2 - 9 October 2011 through 12 October 2011

ER -

Mühl C, van den Broek E, Brouwer AM, Nijboer F, van Wouwe N, Heylen DKJ. Multi-modal affect induction for affective brain-computer interfaces. In D’Mello S, Graesser A, Schuller B, Martin JC, editors, Proceedings of the 4th International Conference on Affective Computing and Intelligent Interaction (ACII 2011), Part I. New York: Springer. 2011. p. 235-245. (Lecture Notes in Computer Science). doi: 10.1007/978-3-642-24600-5_27