Social Signal Processing: The Research Agenda

Maja Pantic, Roderick Cowie, Francesca D'Errico, Dirk K.J. Heylen, Marc Mehu, Catherine Pelachaud, Isabella Poggi, Marc Schroeder, Alessandro Vinciarelli

    Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review


    The exploration of how we react to the world and interact with it and each other remains one of the greatest scientific challenges. Latest research trends in cognitive sciences argue that our common view of intelligence is too narrow, ignoring a crucial range of abilities that matter immensely for how people do in life. This range of abilities is called social intelligence and includes the ability to express and recognise social signals produced during social interactions like agreement, politeness, empathy, friendliness, conflict, etc., coupled with the ability to manage them in order to get along well with others while winning their cooperation. Social Signal Processing (SSP) is the new research domain that aims at understanding and modelling social interactions (human-science goals), and at providing computers with similar abilities in human-computer interaction scenarios (technological goals). SSP is in its infancy, and the journey towards artificial social intelligence and socially-aware computing is still long. This research agenda is a twofold, a discussion about how the field is understood by people who are currently active in it and a discussion about issues that the researchers in this formative field face.
    Original languageUndefined
    Title of host publicationVisual Analysis of Humans
    EditorsThomas B. Moeslund, Adrain Hilton, Volker Krüger, Leonid Sigal
    Place of PublicationLondon
    Number of pages28
    ISBN (Print)978-0-85729-996-3
    Publication statusPublished - 2011

    Publication series



    • METIS-284956
    • Human computer interaction
    • IR-79322
    • Social Signal Processing
    • human behaviour synthesis
    • EWI-21150
    • EC Grant Agreement nr.: FP7/231287
    • human behaviour analysis

    Cite this