Come and have an emotional workout with sensitive artificial listeners!

Marc Schröder, Sathish Pammi, Hatice Gunes, Maja Pantic, Michel F. Valstar, Roddy Cowie, Gary McKeown, Dirk K.J. Heylen, Mark ter Maat, Florian Eyben, Björn Schuller, Martin Wölmmer, Elisabetta Bevacqua, Catherine Pelachaud, Etienne de Sevin

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    3 Citations (Scopus)


    This demonstration aims to showcase the recently completed SEMAINE system. The SEMAINE system is a publicly available, fully autonomous Sensitive Artificial Listeners (SAL) system that consists of virtual dialog partners based on audiovisual analysis and synthesis (see The system runs in real-time, and combines incremental analysis of user behavior, dialog management, and synthesis of speaker and listener behavior of a SAL character, displayed as a virtual agent. The SAL characters intend to engage the user in a conversation by paying attention to the user's emotions and nonverbal expressions. The characters have their own emotionally defined personality. During an interaction, the characters attempt to create an emotional workout for the user by drawing her/him towards their dominant emotion, through a combination of verbal and nonverbal expressions.
    Original languageUndefined
    Title of host publicationIEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011)
    Place of PublicationUSA
    Number of pages1
    ISBN (Print)978-1-4244-9140-7
    Publication statusPublished - Mar 2011
    Event9th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2011 - Santa Barbara, United States
    Duration: 21 Mar 201125 Mar 2011
    Conference number: 9

    Publication series

    PublisherIEEE Computer Society


    Conference9th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2011
    Abbreviated titleFG
    Country/TerritoryUnited States
    CitySanta Barbara


    • METIS-285104
    • Buildings
    • IR-79613
    • Real time systems
    • Face
    • HMI-IA: Intelligent Agents
    • Europe
    • Adaptive Systems
    • EWI-21455
    • EC Grant Agreement nr.: FP7/211486
    • Operating systems
    • Humans

    Cite this