Biometrics for Emotion Detection (BED): Exploring the combination of Speech and ECG

Marleen H. Schut, Kees Tuinenbreijer, Egon van den Broek, Joyce H.D.M. Westerink

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    175 Downloads (Pure)

    Abstract

    The paradigm Biometrics for Emotion Detection (BED) is introduced, which enables unobtrusive emotion recognition, taking into account varying environments. It uses the electrocardiogram (ECG) and speech, as a powerful but rarely used combination to unravel people’s emotions. BED was applied in two environments (i.e., office and home-like) in which 40 people watched 6 film scenes. It is shown that both heart rate variability (derived from the ECG) and, when people’s gender is taken into account, the standard deviation of the fundamental frequency of speech indicate people’s experienced emotions. As such, these measures validate each other. Moreover, it is found that people’s environment can indeed of influence experienced emotions. These results indicate that BED might become an important paradigm for unobtrusive emotion detection.
    Original languageUndefined
    Title of host publicationProceedings of the 1st International Workshop on Bio-inspired Human-Machine Interfaces and Healthcare Applications - B-Interface 2010
    EditorsJonghwa Kim, Pasi Karjalainen
    Place of PublicationPortugal
    PublisherINSTICC PRESS
    Pages51-58
    Number of pages8
    ISBN (Print)978-989-674-020-7
    Publication statusPublished - 21 Jan 2010

    Publication series

    Name
    PublisherINSTICC Press

    Keywords

    • IR-72490
    • METIS-270943
    • Biometrics
    • Context
    • ECG
    • Emotion
    • HMI-CI: Computational Intelligence
    • speech electrocardiogram
    • movies
    • environment
    • EWI-18220
    • HMI-MI: MULTIMODAL INTERACTIONS
    • HMI-HF: Human Factors
    • F0 / fundamental frequency

    Cite this