Social Signal Processing: Survey of an Emerging Domain

Alessandro Vinciarelli, Maja Pantic, Hervé Bourlard

    Research output: Contribution to journalArticleAcademicpeer-review

    722 Citations (Scopus)


    The ability to understand and manage social signals of a person we are communicating with is the core of social intelligence. Social intelligence is a facet of human intelligence that has been argued to be indispensable and perhaps the most important for success in life. This paper argues that next-generation computing needs to include the essence of social intelligence – the ability to recognize human social signals and social behaviours like turn taking, politeness, and disagreement – in order to become more effective and more efficient. Although each one of us understands the importance of social signals in everyday life situations, and in spite of recent advances in machine analysis of relevant behavioural cues like blinks, smiles, crossed arms, laughter, and similar, design and development of automated systems for social signal processing (SSP) are rather difficult. This paper surveys the past efforts in solving these problems by a computer, it summarizes the relevant findings in social psychology, and it proposes a set of recommendations for enabling the development of the next generation of socially aware computing.
    Original languageUndefined
    Article number10.1016/j.imavis.2008.11.007
    Pages (from-to)1743-1759
    Number of pages17
    JournalImage and vision computing
    Issue number12
    Publication statusPublished - 2009


    • EWI-17123
    • HMI-HF: Human Factors
    • IR-69475
    • EC Grant Agreement nr.: FP7/211486
    • METIS-264460
    • EC Grant Agreement nr.: FP7/231287

    Cite this