Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee

Khiet Phuong Truong

Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee

Khiet Phuong Truong

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

20 Citations (Scopus)

649 Downloads (Pure)

Abstract

One of the major properties of overlapping speech is that it can be perceived as competitive or cooperative. For the development of real-time spoken dialog systems and the analysis of affective and social human behavior in conversations, it is important to (automatically) distinguish between these two types of overlap. We investigate acoustic characteristics of cooperative and competitive overlaps with the aim to develop automatic classifiers for the classification of overlaps. In addition to acoustic features, we also use information from gaze and head movement annotations. Contexts preceding and during the overlap are taken into account, as well as the behaviors of both the overlapper and the overlappee. We compare various feature sets in classification experiments that are performed on the AMI corpus. The best performances obtained lie around 27%–30% EER.

Original language	Undefined
Title of host publication	Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013
Place of Publication	Baixas, France
Publisher	International Speech Communication Association (ISCA)
Pages	1404-1408
Number of pages	5
ISBN (Print)	2308-457X
Publication status	Published - Aug 2013
Event	14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013 - Lyon, France Duration: 25 Aug 2013 → 29 Aug 2013 Conference number: 14 http://www.interspeech2013.org/

Publication series

Name
Publisher	International Speech Communication Association
ISSN (Print)	2308-457X

Conference

Conference	14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013
Abbreviated title	INTERSPEECH
Country/Territory	France
City	Lyon
Period	25/08/13 → 29/08/13
Internet address	http://www.interspeech2013.org/

Keywords

Speech overlap
Social Signal Processing
IR-89699
EWI-24529
METIS-302881
interruptions

Access to Document

http://www.isca-speech.org/archive/interspeech_2013/i13_1404.html

Cite this

Truong, K. P. (2013). Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee. In Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013 (pp. 1404-1408). International Speech Communication Association (ISCA). http://www.isca-speech.org/archive/interspeech_2013/i13_1404.html

@inproceedings{0b631c3ce32643439db273dfe01aa22c,

title = "Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee",

abstract = "One of the major properties of overlapping speech is that it can be perceived as competitive or cooperative. For the development of real-time spoken dialog systems and the analysis of affective and social human behavior in conversations, it is important to (automatically) distinguish between these two types of overlap. We investigate acoustic characteristics of cooperative and competitive overlaps with the aim to develop automatic classifiers for the classification of overlaps. In addition to acoustic features, we also use information from gaze and head movement annotations. Contexts preceding and during the overlap are taken into account, as well as the behaviors of both the overlapper and the overlappee. We compare various feature sets in classification experiments that are performed on the AMI corpus. The best performances obtained lie around 27%–30% EER.",

keywords = "Speech overlap, Social Signal Processing, IR-89699, EWI-24529, METIS-302881, interruptions",

author = "Truong, {Khiet Phuong}",

year = "2013",

month = aug,

language = "Undefined",

isbn = "2308-457X",

publisher = "International Speech Communication Association (ISCA)",

pages = "1404--1408",

booktitle = "Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013",

note = "14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013 ; Conference date: 25-08-2013 Through 29-08-2013",

url = "http://www.interspeech2013.org/",

}

Truong, KP 2013, Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee. in Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013. International Speech Communication Association (ISCA), Baixas, France, pp. 1404-1408, 14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013, Lyon, France, 25/08/13. <http://www.isca-speech.org/archive/interspeech_2013/i13_1404.html>

Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee. / Truong, Khiet Phuong.
Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013. Baixas, France: International Speech Communication Association (ISCA), 2013. p. 1404-1408.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee

AU - Truong, Khiet Phuong

N1 - Conference code: 14

PY - 2013/8

Y1 - 2013/8

N2 - One of the major properties of overlapping speech is that it can be perceived as competitive or cooperative. For the development of real-time spoken dialog systems and the analysis of affective and social human behavior in conversations, it is important to (automatically) distinguish between these two types of overlap. We investigate acoustic characteristics of cooperative and competitive overlaps with the aim to develop automatic classifiers for the classification of overlaps. In addition to acoustic features, we also use information from gaze and head movement annotations. Contexts preceding and during the overlap are taken into account, as well as the behaviors of both the overlapper and the overlappee. We compare various feature sets in classification experiments that are performed on the AMI corpus. The best performances obtained lie around 27%–30% EER.

AB - One of the major properties of overlapping speech is that it can be perceived as competitive or cooperative. For the development of real-time spoken dialog systems and the analysis of affective and social human behavior in conversations, it is important to (automatically) distinguish between these two types of overlap. We investigate acoustic characteristics of cooperative and competitive overlaps with the aim to develop automatic classifiers for the classification of overlaps. In addition to acoustic features, we also use information from gaze and head movement annotations. Contexts preceding and during the overlap are taken into account, as well as the behaviors of both the overlapper and the overlappee. We compare various feature sets in classification experiments that are performed on the AMI corpus. The best performances obtained lie around 27%–30% EER.

KW - Speech overlap

KW - Social Signal Processing

KW - IR-89699

KW - EWI-24529

KW - METIS-302881

KW - interruptions

M3 - Conference contribution

SN - 2308-457X

SP - 1404

EP - 1408

BT - Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013

PB - International Speech Communication Association (ISCA)

CY - Baixas, France

T2 - 14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013

Y2 - 25 August 2013 through 29 August 2013

ER -