Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing

Alessandro Vinciarelli, Maja Pantic, Dirk K.J. Heylen, Catherine Pelachaud, Isabella Poggi, Francesca D’Ericco, Marc Schröder

    Research output: Contribution to journalArticleAcademicpeer-review

    238 Citations (Scopus)

    Abstract

    Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.
    Original languageUndefined
    Pages (from-to)69-87
    Number of pages19
    JournalIEEE transactions on affective computing
    Volume3
    Issue number1
    DOIs
    Publication statusPublished - Jan 2012

    Keywords

    • Social Signal Processing
    • EWI-22959
    • social interactions understanding
    • IR-84219
    • nonverbal behavior analysis and synthesis
    • METIS-296251
    • HMI-MI: MULTIMODAL INTERACTIONS

    Cite this

    Vinciarelli, Alessandro ; Pantic, Maja ; Heylen, Dirk K.J. ; Pelachaud, Catherine ; Poggi, Isabella ; D’Ericco, Francesca ; Schröder, Marc. / Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing. In: IEEE transactions on affective computing. 2012 ; Vol. 3, No. 1. pp. 69-87.
    @article{50a9a022a0e14809b97f812e48050370,
    title = "Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing",
    abstract = "Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.",
    keywords = "Social Signal Processing, EWI-22959, social interactions understanding, IR-84219, nonverbal behavior analysis and synthesis, METIS-296251, HMI-MI: MULTIMODAL INTERACTIONS",
    author = "Alessandro Vinciarelli and Maja Pantic and Heylen, {Dirk K.J.} and Catherine Pelachaud and Isabella Poggi and Francesca D’Ericco and Marc Schr{\"o}der",
    note = "eemcs-eprint-22959",
    year = "2012",
    month = "1",
    doi = "10.1109/T-AFFC.2011.27",
    language = "Undefined",
    volume = "3",
    pages = "69--87",
    journal = "IEEE transactions on affective computing",
    issn = "1949-3045",
    publisher = "IEEE",
    number = "1",

    }

    Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing. / Vinciarelli, Alessandro; Pantic, Maja; Heylen, Dirk K.J.; Pelachaud, Catherine; Poggi, Isabella; D’Ericco, Francesca; Schröder, Marc.

    In: IEEE transactions on affective computing, Vol. 3, No. 1, 01.2012, p. 69-87.

    Research output: Contribution to journalArticleAcademicpeer-review

    TY - JOUR

    T1 - Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing

    AU - Vinciarelli, Alessandro

    AU - Pantic, Maja

    AU - Heylen, Dirk K.J.

    AU - Pelachaud, Catherine

    AU - Poggi, Isabella

    AU - D’Ericco, Francesca

    AU - Schröder, Marc

    N1 - eemcs-eprint-22959

    PY - 2012/1

    Y1 - 2012/1

    N2 - Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.

    AB - Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.

    KW - Social Signal Processing

    KW - EWI-22959

    KW - social interactions understanding

    KW - IR-84219

    KW - nonverbal behavior analysis and synthesis

    KW - METIS-296251

    KW - HMI-MI: MULTIMODAL INTERACTIONS

    U2 - 10.1109/T-AFFC.2011.27

    DO - 10.1109/T-AFFC.2011.27

    M3 - Article

    VL - 3

    SP - 69

    EP - 87

    JO - IEEE transactions on affective computing

    JF - IEEE transactions on affective computing

    SN - 1949-3045

    IS - 1

    ER -