Toward affective brain-computer interfaces : exploring the neurophysiology of affect during human media interaction

C. Mühl

Abstract

Affective Brain-Computer Interfaces (aBCI), the sensing of emotions from brain activity, seems a fantasy from the realm of science fiction. But unlike faster-than-light travel or teleportation, aBCI seems almost within reach due to novel sensor technologies, the advancement of neuroscience, and the refinement of machine learning techniques. However, as for so many novel technologies before, the challenges for aBCI become more obvious as we get closer to the seemingly tangible goal. One of the primary challenges on the road toward aBCI is the identification of neurophysiological signals that can reliably differentiate affective states in the complex, multimodal environments in which aBCIs are supposed to work. Specifically, we are concerned with the nature of affect during the interaction with media, such as computer games, music videos, pictures, and sounds. In this thesis we present three studies, in which we employ a variety of methods to shed light on the neurophysiology of affect in the context of human media interaction as measured by electroencephalography (EEG): we evaluate active affective human-computer interaction (HCI) using a neurophysiological indicator identified from the literature, we explore correlates of affect induced by natural, multimodal media stimuli, and we study the separability of complex affective responses into context-specific and general components.
Original languageEnglish
Awarding Institution
  • University of Twente
Supervisors/Advisors
  • Nijholt, Antinus , Supervisor
  • Heylen, Dirk K.J., Supervisor
Sponsors
Date of Award1 Jun 2012
Place of PublicationEnschede
Print ISBNs978-90365-3362-1
DOIs
StatePublished - 1 Jun 2012

Fingerprint

Brain computer interface
Neurophysiology
Computer games
Human computer interaction
Electroencephalography
Learning systems
Brain
Sensors

Keywords

  • HMI-HF: Human Factors
  • HMI-MI: MULTIMODAL INTERACTIONS
  • human-media interaction
  • EWI-22529
  • Emotion
  • HMI
  • HCI
  • Neurotechnology
  • Affect
  • Human computer interaction
  • Brain-Computer Interfaces
  • BCI
  • IR-82072
  • METIS-288750

Cite this

@misc{624f7d5b05384b44be5cb67d4e99da18,
title = "Toward affective brain-computer interfaces : exploring the neurophysiology of affect during human media interaction",
abstract = "Affective Brain-Computer Interfaces (aBCI), the sensing of emotions from brain activity, seems a fantasy from the realm of science fiction. But unlike faster-than-light travel or teleportation, aBCI seems almost within reach due to novel sensor technologies, the advancement of neuroscience, and the refinement of machine learning techniques. However, as for so many novel technologies before, the challenges for aBCI become more obvious as we get closer to the seemingly tangible goal. One of the primary challenges on the road toward aBCI is the identification of neurophysiological signals that can reliably differentiate affective states in the complex, multimodal environments in which aBCIs are supposed to work. Specifically, we are concerned with the nature of affect during the interaction with media, such as computer games, music videos, pictures, and sounds. In this thesis we present three studies, in which we employ a variety of methods to shed light on the neurophysiology of affect in the context of human media interaction as measured by electroencephalography (EEG): we evaluate active affective human-computer interaction (HCI) using a neurophysiological indicator identified from the literature, we explore correlates of affect induced by natural, multimodal media stimuli, and we study the separability of complex affective responses into context-specific and general components.",
keywords = "HMI-HF: Human Factors, HMI-MI: MULTIMODAL INTERACTIONS, human-media interaction, EWI-22529, Emotion, HMI, HCI, Neurotechnology, Affect, Human computer interaction, Brain-Computer Interfaces, BCI, IR-82072, METIS-288750",
author = "C. Mühl",
note = "SIKS Dissertation Series No. 2012-23",
year = "2012",
month = "6",
doi = "10.3990/1.9789036533621",
isbn = "978-90365-3362-1",
school = "University of Twente",

}

Toward affective brain-computer interfaces : exploring the neurophysiology of affect during human media interaction. / Mühl, C.

Enschede, 2012. 186 p.

Research output: ScientificPhD Thesis - Research UT, graduation UT

TY - THES

T1 - Toward affective brain-computer interfaces : exploring the neurophysiology of affect during human media interaction

AU - Mühl,C.

N1 - SIKS Dissertation Series No. 2012-23

PY - 2012/6/1

Y1 - 2012/6/1

N2 - Affective Brain-Computer Interfaces (aBCI), the sensing of emotions from brain activity, seems a fantasy from the realm of science fiction. But unlike faster-than-light travel or teleportation, aBCI seems almost within reach due to novel sensor technologies, the advancement of neuroscience, and the refinement of machine learning techniques. However, as for so many novel technologies before, the challenges for aBCI become more obvious as we get closer to the seemingly tangible goal. One of the primary challenges on the road toward aBCI is the identification of neurophysiological signals that can reliably differentiate affective states in the complex, multimodal environments in which aBCIs are supposed to work. Specifically, we are concerned with the nature of affect during the interaction with media, such as computer games, music videos, pictures, and sounds. In this thesis we present three studies, in which we employ a variety of methods to shed light on the neurophysiology of affect in the context of human media interaction as measured by electroencephalography (EEG): we evaluate active affective human-computer interaction (HCI) using a neurophysiological indicator identified from the literature, we explore correlates of affect induced by natural, multimodal media stimuli, and we study the separability of complex affective responses into context-specific and general components.

AB - Affective Brain-Computer Interfaces (aBCI), the sensing of emotions from brain activity, seems a fantasy from the realm of science fiction. But unlike faster-than-light travel or teleportation, aBCI seems almost within reach due to novel sensor technologies, the advancement of neuroscience, and the refinement of machine learning techniques. However, as for so many novel technologies before, the challenges for aBCI become more obvious as we get closer to the seemingly tangible goal. One of the primary challenges on the road toward aBCI is the identification of neurophysiological signals that can reliably differentiate affective states in the complex, multimodal environments in which aBCIs are supposed to work. Specifically, we are concerned with the nature of affect during the interaction with media, such as computer games, music videos, pictures, and sounds. In this thesis we present three studies, in which we employ a variety of methods to shed light on the neurophysiology of affect in the context of human media interaction as measured by electroencephalography (EEG): we evaluate active affective human-computer interaction (HCI) using a neurophysiological indicator identified from the literature, we explore correlates of affect induced by natural, multimodal media stimuli, and we study the separability of complex affective responses into context-specific and general components.

KW - HMI-HF: Human Factors

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - human-media interaction

KW - EWI-22529

KW - Emotion

KW - HMI

KW - HCI

KW - Neurotechnology

KW - Affect

KW - Human computer interaction

KW - Brain-Computer Interfaces

KW - BCI

KW - IR-82072

KW - METIS-288750

U2 - 10.3990/1.9789036533621

DO - 10.3990/1.9789036533621

M3 - PhD Thesis - Research UT, graduation UT

SN - 978-90365-3362-1

ER -