Computing emotion awareness through facial electromyography

Egon van den Broek, Marleen H. Schut, Joyce H.D.M. Westerink, Jan van Herk, Kees Tuinenbreijer

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    20 Citations (Scopus)
    72 Downloads (Pure)

    Abstract

    To improve human-computer interaction (HCI), computers need to recognize and respond properly to their user’s emotional state. This is a fundamental application of affective computing, which relates to, arises from, or deliberately influences emotion. As a first step to a system that recognizes emotions of individual users, this research focuses on how emotional experiences are expressed in six parameters (i.e., mean, absolute deviation, standard deviation, variance, skewness, and kurtosis) of physiological measurements of three electromyography signals: frontalis (EMG1), corrugator supercilii (EMG2), and zygomaticus major (EMG3). The 24 participants were asked to watch film scenes of 120 seconds, which they rated afterward. These ratings enabled us to distinguish four categories of emotions: negative, positive, mixed, and neutral. The skewness of the EMG2 and four parameters of EMG3, discriminate between the four emotion categories. This, despite the coarse time windows that were used. Moreover, rapid processing of the signals proved to be possible. This enables tailored HCI facilitated by an emotional awareness of systems.
    Original languageUndefined
    Title of host publicationComputer vision in human-computer interaction
    Subtitle of host publicationECCV 2006 Workshop on HCI, Graz, Austria, May 13, 2006. Proceedings
    EditorsThomas S. Huang, Nicu Sebe, Michael S. Lew, Vladimir Pavlovic, Mathias Kölsch, Aphrodite Galata, Branislav Kisacanin
    PublisherSpringer
    Pages52-63
    Number of pages12
    ISBN (Print)978-3-540-34202-1
    DOIs
    Publication statusPublished - 13 May 2006

    Publication series

    NameLecture notes in computer science
    PublisherSpringer
    Volume3979
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Keywords

    • kurtosis
    • EWI-20840
    • film scenes
    • METIS-235411
    • HMI-HF: Human Factors
    • Emotion
    • Human-Computer Interaction (HCI)
    • Affective Computing
    • IR-58732
    • electromyography (EMG)
    • skewness
    • HMI-MI: MULTIMODAL INTERACTIONS

    Cite this

    van den Broek, E., Schut, M. H., Westerink, J. H. D. M., van Herk, J., & Tuinenbreijer, K. (2006). Computing emotion awareness through facial electromyography. In T. S. Huang, N. Sebe, M. S. Lew, V. Pavlovic, M. Kölsch, A. Galata, & B. Kisacanin (Eds.), Computer vision in human-computer interaction: ECCV 2006 Workshop on HCI, Graz, Austria, May 13, 2006. Proceedings (pp. 52-63). (Lecture notes in computer science; Vol. 3979). Springer. https://doi.org/10.1007/11754336, https://doi.org/10.1007/11754336_6