One of the major properties of overlapping speech is that it can be perceived as competitive or cooperative. For the development of real-time spoken dialog systems and the analysis of affective and social human behavior in conversations, it is important to (automatically) distinguish between these two types of overlap. We investigate acoustic characteristics of cooperative and competitive overlaps with the aim to develop automatic classifiers for the classification of overlaps. In addition to acoustic features, we also use information from gaze and head movement annotations. Contexts preceding and during the overlap are taken into account, as well as the behaviors of both the overlapper and the overlappee. We compare various feature sets in classification experiments that are performed on the AMI corpus. The best performances obtained lie around 27%–30% EER.
|Title of host publication||Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013|
|Place of Publication||Baixas, France|
|Publisher||International Speech Communication Association (ISCA)|
|Number of pages||5|
|Publication status||Published - Aug 2013|
|Event||14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013 - Lyon, France|
Duration: 25 Aug 2013 → 29 Aug 2013
Conference number: 14
|Publisher||International Speech Communication Association|
|Conference||14th Annual Conference of the International Speech Communication Association, INTERSPEECH 2013|
|Period||25/08/13 → 29/08/13|
- Speech overlap
- Social Signal Processing
Truong, K. P. (2013). Classification of cooperative and competitive overlaps in speech using cues from the context, overlapper, and overlappee. In Proceedings of the 14th Annual Conference of the International Speech Communication Association, Interspeech 2013 (pp. 1404-1408). Baixas, France: International Speech Communication Association (ISCA).