Toward affective brain-computer interfaces : exploring the neurophysiology of affect during human media interaction

C. Mühl

    Research output: ThesisPhD Thesis - Research UT, graduation UT

    33 Downloads (Pure)

    Abstract

    Affective Brain-Computer Interfaces (aBCI), the sensing of emotions from brain activity, seems a fantasy from the realm of science fiction. But unlike faster-than-light travel or teleportation, aBCI seems almost within reach due to novel sensor technologies, the advancement of neuroscience, and the refinement of machine learning techniques. However, as for so many novel technologies before, the challenges for aBCI become more obvious as we get closer to the seemingly tangible goal. One of the primary challenges on the road toward aBCI is the identification of neurophysiological signals that can reliably differentiate affective states in the complex, multimodal environments in which aBCIs are supposed to work. Specifically, we are concerned with the nature of affect during the interaction with media, such as computer games, music videos, pictures, and sounds. In this thesis we present three studies, in which we employ a variety of methods to shed light on the neurophysiology of affect in the context of human media interaction as measured by electroencephalography (EEG): we evaluate active affective human-computer interaction (HCI) using a neurophysiological indicator identified from the literature, we explore correlates of affect induced by natural, multimodal media stimuli, and we study the separability of complex affective responses into context-specific and general components.
    Original languageEnglish
    Awarding Institution
    • University of Twente
    Supervisors/Advisors
    • Nijholt, Antinus , Supervisor
    • Heylen, Dirk K.J., Supervisor
    Thesis sponsors
    Award date1 Jun 2012
    Place of PublicationEnschede
    Publisher
    Print ISBNs978-90365-3362-1
    DOIs
    Publication statusPublished - 1 Jun 2012

    Fingerprint

    Neurophysiology
    Brain computer interface
    Computer games
    Human computer interaction
    Electroencephalography
    Learning systems
    Brain
    Acoustic waves
    Sensors

    Keywords

    • HMI-HF: Human Factors
    • HMI-MI: MULTIMODAL INTERACTIONS
    • human-media interaction
    • EWI-22529
    • Emotion
    • HMI
    • HCI
    • Neurotechnology
    • Affect
    • Human computer interaction
    • Brain-Computer Interfaces
    • BCI
    • IR-82072
    • METIS-288750

    Cite this

    @phdthesis{624f7d5b05384b44be5cb67d4e99da18,
    title = "Toward affective brain-computer interfaces : exploring the neurophysiology of affect during human media interaction",
    abstract = "Affective Brain-Computer Interfaces (aBCI), the sensing of emotions from brain activity, seems a fantasy from the realm of science fiction. But unlike faster-than-light travel or teleportation, aBCI seems almost within reach due to novel sensor technologies, the advancement of neuroscience, and the refinement of machine learning techniques. However, as for so many novel technologies before, the challenges for aBCI become more obvious as we get closer to the seemingly tangible goal. One of the primary challenges on the road toward aBCI is the identification of neurophysiological signals that can reliably differentiate affective states in the complex, multimodal environments in which aBCIs are supposed to work. Specifically, we are concerned with the nature of affect during the interaction with media, such as computer games, music videos, pictures, and sounds. In this thesis we present three studies, in which we employ a variety of methods to shed light on the neurophysiology of affect in the context of human media interaction as measured by electroencephalography (EEG): we evaluate active affective human-computer interaction (HCI) using a neurophysiological indicator identified from the literature, we explore correlates of affect induced by natural, multimodal media stimuli, and we study the separability of complex affective responses into context-specific and general components.",
    keywords = "HMI-HF: Human Factors, HMI-MI: MULTIMODAL INTERACTIONS, human-media interaction, EWI-22529, Emotion, HMI, HCI, Neurotechnology, Affect, Human computer interaction, Brain-Computer Interfaces, BCI, IR-82072, METIS-288750",
    author = "C. M{\"u}hl",
    note = "SIKS Dissertation Series No. 2012-23",
    year = "2012",
    month = "6",
    day = "1",
    doi = "10.3990/1.9789036533621",
    language = "English",
    isbn = "978-90365-3362-1",
    publisher = "University of Twente",
    address = "Netherlands",
    school = "University of Twente",

    }

    Toward affective brain-computer interfaces : exploring the neurophysiology of affect during human media interaction. / Mühl, C.

    Enschede : University of Twente, 2012. 186 p.

    Research output: ThesisPhD Thesis - Research UT, graduation UT

    TY - THES

    T1 - Toward affective brain-computer interfaces : exploring the neurophysiology of affect during human media interaction

    AU - Mühl, C.

    N1 - SIKS Dissertation Series No. 2012-23

    PY - 2012/6/1

    Y1 - 2012/6/1

    N2 - Affective Brain-Computer Interfaces (aBCI), the sensing of emotions from brain activity, seems a fantasy from the realm of science fiction. But unlike faster-than-light travel or teleportation, aBCI seems almost within reach due to novel sensor technologies, the advancement of neuroscience, and the refinement of machine learning techniques. However, as for so many novel technologies before, the challenges for aBCI become more obvious as we get closer to the seemingly tangible goal. One of the primary challenges on the road toward aBCI is the identification of neurophysiological signals that can reliably differentiate affective states in the complex, multimodal environments in which aBCIs are supposed to work. Specifically, we are concerned with the nature of affect during the interaction with media, such as computer games, music videos, pictures, and sounds. In this thesis we present three studies, in which we employ a variety of methods to shed light on the neurophysiology of affect in the context of human media interaction as measured by electroencephalography (EEG): we evaluate active affective human-computer interaction (HCI) using a neurophysiological indicator identified from the literature, we explore correlates of affect induced by natural, multimodal media stimuli, and we study the separability of complex affective responses into context-specific and general components.

    AB - Affective Brain-Computer Interfaces (aBCI), the sensing of emotions from brain activity, seems a fantasy from the realm of science fiction. But unlike faster-than-light travel or teleportation, aBCI seems almost within reach due to novel sensor technologies, the advancement of neuroscience, and the refinement of machine learning techniques. However, as for so many novel technologies before, the challenges for aBCI become more obvious as we get closer to the seemingly tangible goal. One of the primary challenges on the road toward aBCI is the identification of neurophysiological signals that can reliably differentiate affective states in the complex, multimodal environments in which aBCIs are supposed to work. Specifically, we are concerned with the nature of affect during the interaction with media, such as computer games, music videos, pictures, and sounds. In this thesis we present three studies, in which we employ a variety of methods to shed light on the neurophysiology of affect in the context of human media interaction as measured by electroencephalography (EEG): we evaluate active affective human-computer interaction (HCI) using a neurophysiological indicator identified from the literature, we explore correlates of affect induced by natural, multimodal media stimuli, and we study the separability of complex affective responses into context-specific and general components.

    KW - HMI-HF: Human Factors

    KW - HMI-MI: MULTIMODAL INTERACTIONS

    KW - human-media interaction

    KW - EWI-22529

    KW - Emotion

    KW - HMI

    KW - HCI

    KW - Neurotechnology

    KW - Affect

    KW - Human computer interaction

    KW - Brain-Computer Interfaces

    KW - BCI

    KW - IR-82072

    KW - METIS-288750

    U2 - 10.3990/1.9789036533621

    DO - 10.3990/1.9789036533621

    M3 - PhD Thesis - Research UT, graduation UT

    SN - 978-90365-3362-1

    PB - University of Twente

    CY - Enschede

    ER -