On the Contextual Analysis of Agreement Scores

Dennis Reidsma; Hendrikus J.A. op den Akker

On the Contextual Analysis of Agreement Scores

Dennis Reidsma, Hendrikus J.A. op den Akker

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

155 Downloads (Pure)

Abstract

Annotators of multimodal corpora rely on a combination of audio and video features to assign labels to the events observed. The reliability of annotations may be influenced by the presences or absence of certain key features. For practical applications it can be useful to know what circumstances determined fluctuations in the interannotator agreement. In this paper we consider the case of annotations of addressing on the AMI corpus.

Original language	Undefined
Title of host publication	Proceedings of the LREC Workshop on Multimodal Corpora
Editors	J-C. Martin, P. Paggio, M. Kipp, Dirk K.J. Heylen
Place of Publication	Paris, France
Publisher	ELRA
Pages	52-55
Number of pages	4
ISBN (Print)	2-9517408-4-0
Publication status	Published - May 2008
Event	LREC Workshop on Multimodal Corpora, Marrakech, Morrocco: Proceedings of the LREC Workshop on Multimodal Corpora - Paris, France Duration: 1 May 2008 → …

Publication series

Name
Publisher	ELRA
Number	DTR08-9

Conference

Conference	LREC Workshop on Multimodal Corpora, Marrakech, Morrocco
City	Paris, France
Period	1/05/08 → …

Keywords

EWI-13047
HMI-MI: MULTIMODAL INTERACTIONS
IR-64869
METIS-251070
EC Grant Agreement nr.: FP6/033812

Access to Document

http://www.lrec-conf.org/proceedings/lrec2008/

Cite this

@inproceedings{199cd8f944d74c37a1ad062e8a4b7e2a,

title = "On the Contextual Analysis of Agreement Scores",

abstract = "Annotators of multimodal corpora rely on a combination of audio and video features to assign labels to the events observed. The reliability of annotations may be influenced by the presences or absence of certain key features. For practical applications it can be useful to know what circumstances determined fluctuations in the interannotator agreement. In this paper we consider the case of annotations of addressing on the AMI corpus.",

keywords = "EWI-13047, HMI-MI: MULTIMODAL INTERACTIONS, IR-64869, METIS-251070, EC Grant Agreement nr.: FP6/033812",

author = "Dennis Reidsma and {op den Akker}, {Hendrikus J.A.}",

year = "2008",

month = may,

language = "Undefined",

isbn = "2-9517408-4-0",

publisher = "ELRA",

number = "DTR08-9",

pages = "52--55",

editor = "J-C. Martin and P. Paggio and M. Kipp and Heylen, {Dirk K.J.}",

booktitle = "Proceedings of the LREC Workshop on Multimodal Corpora",

note = "LREC Workshop on Multimodal Corpora, Marrakech, Morrocco ; Conference date: 01-05-2008",

}

TY - GEN

T1 - On the Contextual Analysis of Agreement Scores

AU - Reidsma, Dennis

AU - op den Akker, Hendrikus J.A.

PY - 2008/5

Y1 - 2008/5

N2 - Annotators of multimodal corpora rely on a combination of audio and video features to assign labels to the events observed. The reliability of annotations may be influenced by the presences or absence of certain key features. For practical applications it can be useful to know what circumstances determined fluctuations in the interannotator agreement. In this paper we consider the case of annotations of addressing on the AMI corpus.

AB - Annotators of multimodal corpora rely on a combination of audio and video features to assign labels to the events observed. The reliability of annotations may be influenced by the presences or absence of certain key features. For practical applications it can be useful to know what circumstances determined fluctuations in the interannotator agreement. In this paper we consider the case of annotations of addressing on the AMI corpus.

KW - EWI-13047

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - IR-64869

KW - METIS-251070

KW - EC Grant Agreement nr.: FP6/033812

M3 - Conference contribution

SN - 2-9517408-4-0

SP - 52

EP - 55

BT - Proceedings of the LREC Workshop on Multimodal Corpora

A2 - Martin, J-C.

A2 - Paggio, P.

A2 - Kipp, M.

A2 - Heylen, Dirk K.J.

PB - ELRA

CY - Paris, France

T2 - LREC Workshop on Multimodal Corpora, Marrakech, Morrocco

Y2 - 1 May 2008

ER -