Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing

Alessandro Vinciarelli, Maja Pantic, Dirk K.J. Heylen, Catherine Pelachaud, Isabella Poggi, Francesca D’Ericco, Marc Schröder

Research output: Contribution to journalArticleAcademicpeer-review

231 Citations (Scopus)

Abstract

Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.
Original languageUndefined
Pages (from-to)69-87
Number of pages19
JournalIEEE transactions on affective computing
Volume3
Issue number1
DOIs
Publication statusPublished - Jan 2012

Keywords

  • Social Signal Processing
  • EWI-22959
  • social interactions understanding
  • IR-84219
  • nonverbal behavior analysis and synthesis
  • METIS-296251
  • HMI-MI: MULTIMODAL INTERACTIONS

Cite this

Vinciarelli, Alessandro ; Pantic, Maja ; Heylen, Dirk K.J. ; Pelachaud, Catherine ; Poggi, Isabella ; D’Ericco, Francesca ; Schröder, Marc. / Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing. In: IEEE transactions on affective computing. 2012 ; Vol. 3, No. 1. pp. 69-87.
@article{50a9a022a0e14809b97f812e48050370,
title = "Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing",
abstract = "Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.",
keywords = "Social Signal Processing, EWI-22959, social interactions understanding, IR-84219, nonverbal behavior analysis and synthesis, METIS-296251, HMI-MI: MULTIMODAL INTERACTIONS",
author = "Alessandro Vinciarelli and Maja Pantic and Heylen, {Dirk K.J.} and Catherine Pelachaud and Isabella Poggi and Francesca D’Ericco and Marc Schr{\"o}der",
note = "eemcs-eprint-22959",
year = "2012",
month = "1",
doi = "10.1109/T-AFFC.2011.27",
language = "Undefined",
volume = "3",
pages = "69--87",
journal = "IEEE transactions on affective computing",
issn = "1949-3045",
publisher = "IEEE",
number = "1",

}

Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing. / Vinciarelli, Alessandro; Pantic, Maja; Heylen, Dirk K.J.; Pelachaud, Catherine; Poggi, Isabella; D’Ericco, Francesca; Schröder, Marc.

In: IEEE transactions on affective computing, Vol. 3, No. 1, 01.2012, p. 69-87.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing

AU - Vinciarelli, Alessandro

AU - Pantic, Maja

AU - Heylen, Dirk K.J.

AU - Pelachaud, Catherine

AU - Poggi, Isabella

AU - D’Ericco, Francesca

AU - Schröder, Marc

N1 - eemcs-eprint-22959

PY - 2012/1

Y1 - 2012/1

N2 - Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.

AB - Social Signal Processing is the research domain aimed at bridging the social intelligence gap between humans and machines. This paper is the first survey of the domain that jointly considers its three major aspects, namely, modeling, analysis, and synthesis of social behavior. Modeling investigates laws and principles underlying social interaction, analysis explores approaches for automatic understanding of social exchanges recorded with different sensors, and synthesis studies techniques for the generation of social behavior via various forms of embodiment. For each of the above aspects, the paper includes an extensive survey of the literature, points to the most important publicly available resources, and outlines the most fundamental challenges ahead.

KW - Social Signal Processing

KW - EWI-22959

KW - social interactions understanding

KW - IR-84219

KW - nonverbal behavior analysis and synthesis

KW - METIS-296251

KW - HMI-MI: MULTIMODAL INTERACTIONS

U2 - 10.1109/T-AFFC.2011.27

DO - 10.1109/T-AFFC.2011.27

M3 - Article

VL - 3

SP - 69

EP - 87

JO - IEEE transactions on affective computing

JF - IEEE transactions on affective computing

SN - 1949-3045

IS - 1

ER -