More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech

Alessandro Vinciarelli; Hugues Salamin; Gelareh Mohammadi; Khiet Phuong Truong

doi:10.1007/978-3-642-18184-9_3

More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech

Alessandro Vinciarelli, Hugues Salamin, Gelareh Mohammadi, Khiet Phuong Truong

Research output: Chapter in Book/Report/Conference proceeding › Chapter › Academic

1 Citation (Scopus)

4 Downloads (Pure)

Abstract

This paper presents two examples of how nonverbal communication can be automatically detected and interpreted in terms of social phenomena. In particular, the presented approaches use simple prosodic features to distinguish between journalists and non-journalists in media, and extract social networks from turn-taking to recognize roles in different interaction settings (broadcast data and meetings). Furthermore, the article outlines some of the most interesting perspectives in this line of research.

Original language	Undefined
Title of host publication	Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues
Editors	Anna Esposito, Antoinetta M. Esposito, Raffaele Martone, Vincent C. Müller, Gaetano Scarpetta
Place of Publication	Berlin
Publisher	Springer
Pages	23-33
Number of pages	11
ISBN (Print)	978-3-642-18183-2
DOIs	https://doi.org/10.1007/978-3-642-18184-9_3 https://doi.org/10.1007/978-3-642-18184-9
Publication status	Published - 2011
Event	Third COST 2102 International Training School 2010 - Caserta, Italy Duration: 15 Mar 2010 → 19 Mar 2010 Conference number: 3

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Verlag
Number	6456
Volume	6456

Conference

Conference	Third COST 2102 International Training School 2010
Country/Territory	Italy
City	Caserta
Period	15/03/10 → 19/03/10

Keywords

METIS-277555
Nonverbal Behavior
Turn Taking
Prosody
EWI-19654
IR-76057
Social Signal Processing
Personality
Speaking Style
Roles

Access to Document

Cite this

Vinciarelli, A., Salamin, H., Mohammadi, G., & Truong, K. P. (2011). More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech. In A. Esposito, A. M. Esposito, R. Martone, V. C. Müller, & G. Scarpetta (Eds.), Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues (pp. 23-33). (Lecture Notes in Computer Science; Vol. 6456, No. 6456). Springer. https://doi.org/10.1007/978-3-642-18184-9_3, https://doi.org/10.1007/978-3-642-18184-9

Vinciarelli, Alessandro ; Salamin, Hugues ; Mohammadi, Gelareh et al. / More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech. Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues. editor / Anna Esposito ; Antoinetta M. Esposito ; Raffaele Martone ; Vincent C. Müller ; Gaetano Scarpetta. Berlin : Springer, 2011. pp. 23-33 (Lecture Notes in Computer Science; 6456).

@inbook{0d567b135aa34214920556031c2aa163,

title = "More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech",

abstract = "This paper presents two examples of how nonverbal communication can be automatically detected and interpreted in terms of social phenomena. In particular, the presented approaches use simple prosodic features to distinguish between journalists and non-journalists in media, and extract social networks from turn-taking to recognize roles in different interaction settings (broadcast data and meetings). Furthermore, the article outlines some of the most interesting perspectives in this line of research.",

keywords = "METIS-277555, Nonverbal Behavior, Turn Taking, Prosody, EWI-19654, IR-76057, Social Signal Processing, Personality, Speaking Style, Roles",

author = "Alessandro Vinciarelli and Hugues Salamin and Gelareh Mohammadi and Truong, {Khiet Phuong}",

note = "10.1007/978-3-642-18184-9_3 ; Third COST 2102 International Training School 2010 ; Conference date: 15-03-2010 Through 19-03-2010",

year = "2011",

doi = "10.1007/978-3-642-18184-9_3",

language = "Undefined",

isbn = "978-3-642-18183-2",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

number = "6456",

pages = "23--33",

editor = "Anna Esposito and Esposito, {Antoinetta M.} and Raffaele Martone and M{\"u}ller, {Vincent C.} and Gaetano Scarpetta",

booktitle = "Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues",

address = "Germany",

}

Vinciarelli, A, Salamin, H, Mohammadi, G & Truong, KP 2011, More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech. in A Esposito, AM Esposito, R Martone, VC Müller & G Scarpetta (eds), Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues. Lecture Notes in Computer Science, no. 6456, vol. 6456, Springer, Berlin, pp. 23-33, Third COST 2102 International Training School 2010, Caserta, Italy, 15/03/10. https://doi.org/10.1007/978-3-642-18184-9_3, https://doi.org/10.1007/978-3-642-18184-9

More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech. / Vinciarelli, Alessandro; Salamin, Hugues; Mohammadi, Gelareh et al.
Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues. ed. / Anna Esposito; Antoinetta M. Esposito; Raffaele Martone; Vincent C. Müller; Gaetano Scarpetta. Berlin: Springer, 2011. p. 23-33 (Lecture Notes in Computer Science; Vol. 6456, No. 6456).

Research output: Chapter in Book/Report/Conference proceeding › Chapter › Academic

TY - CHAP

T1 - More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech

AU - Vinciarelli, Alessandro

AU - Salamin, Hugues

AU - Mohammadi, Gelareh

AU - Truong, Khiet Phuong

N1 - Conference code: 3

PY - 2011

Y1 - 2011

N2 - This paper presents two examples of how nonverbal communication can be automatically detected and interpreted in terms of social phenomena. In particular, the presented approaches use simple prosodic features to distinguish between journalists and non-journalists in media, and extract social networks from turn-taking to recognize roles in different interaction settings (broadcast data and meetings). Furthermore, the article outlines some of the most interesting perspectives in this line of research.

AB - This paper presents two examples of how nonverbal communication can be automatically detected and interpreted in terms of social phenomena. In particular, the presented approaches use simple prosodic features to distinguish between journalists and non-journalists in media, and extract social networks from turn-taking to recognize roles in different interaction settings (broadcast data and meetings). Furthermore, the article outlines some of the most interesting perspectives in this line of research.

KW - METIS-277555

KW - Nonverbal Behavior

KW - Turn Taking

KW - Prosody

KW - EWI-19654

KW - IR-76057

KW - Social Signal Processing

KW - Personality

KW - Speaking Style

KW - Roles

U2 - 10.1007/978-3-642-18184-9_3

DO - 10.1007/978-3-642-18184-9_3

M3 - Chapter

SN - 978-3-642-18183-2

T3 - Lecture Notes in Computer Science

SP - 23

EP - 33

BT - Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues

A2 - Esposito, Anna

A2 - Esposito, Antoinetta M.

A2 - Martone, Raffaele

A2 - Müller, Vincent C.

A2 - Scarpetta, Gaetano

PB - Springer

CY - Berlin

T2 - Third COST 2102 International Training School 2010

Y2 - 15 March 2010 through 19 March 2010

ER -

Vinciarelli A, Salamin H, Mohammadi G, Truong KP. More Than Words: Inference of Socially Relevant Information from Nonverbal Vocal Cues in Speech. In Esposito A, Esposito AM, Martone R, Müller VC, Scarpetta G, editors, Toward Autonomous, Adaptive, and Context-Aware Multimodal Interfaces. Theoretical and Practical Issues. Berlin: Springer. 2011. p. 23-33. (Lecture Notes in Computer Science; 6456). doi: 10.1007/978-3-642-18184-9_3, 10.1007/978-3-642-18184-9