Abstract

Annotators of multimodal corpora rely on a combination of audio and video features to assign labels to the events observed. The reliability of annotations may be influenced by the presences or absence of certain key features. For practical applications it can be useful to know what circumstances determined fluctuations in the interannotator agreement. In this paper we consider the case of annotations of addressing on the AMI corpus.
Original languageUndefined
Title of host publicationProceedings of the LREC Workshop on Multimodal Corpora
EditorsJ-C. Martin, P. Paggio, M. Kipp, Dirk K.J. Heylen
Place of PublicationParis, France
PublisherELRA
Pages52-55
Number of pages4
ISBN (Print)2-9517408-4-0
StatePublished - May 2008

Publication series

Name
PublisherELRA
NumberDTR08-9

Fingerprint

fluctuation
video
reliability

Keywords

  • EWI-13047
  • HMI-MI: MULTIMODAL INTERACTIONS
  • IR-64869
  • METIS-251070
  • EC Grant Agreement nr.: FP6/033812

Cite this

Reidsma, D., & op den Akker, H. J. A. (2008). On the Contextual Analysis of Agreement Scores. In J-C. Martin, P. Paggio, M. Kipp, & D. K. J. Heylen (Eds.), Proceedings of the LREC Workshop on Multimodal Corpora (pp. 52-55). Paris, France: ELRA.

Reidsma, Dennis; op den Akker, Hendrikus J.A. / On the Contextual Analysis of Agreement Scores.

Proceedings of the LREC Workshop on Multimodal Corpora. ed. / J-C. Martin; P. Paggio; M. Kipp; Dirk K.J. Heylen. Paris, France : ELRA, 2008. p. 52-55.

Research output: Scientific - peer-reviewConference contribution

@inbook{199cd8f944d74c37a1ad062e8a4b7e2a,
title = "On the Contextual Analysis of Agreement Scores",
abstract = "Annotators of multimodal corpora rely on a combination of audio and video features to assign labels to the events observed. The reliability of annotations may be influenced by the presences or absence of certain key features. For practical applications it can be useful to know what circumstances determined fluctuations in the interannotator agreement. In this paper we consider the case of annotations of addressing on the AMI corpus.",
keywords = "EWI-13047, HMI-MI: MULTIMODAL INTERACTIONS, IR-64869, METIS-251070, EC Grant Agreement nr.: FP6/033812",
author = "Dennis Reidsma and {op den Akker}, {Hendrikus J.A.}",
year = "2008",
month = "5",
isbn = "2-9517408-4-0",
publisher = "ELRA",
number = "DTR08-9",
pages = "52--55",
editor = "J-C. Martin and P. Paggio and M. Kipp and Heylen, {Dirk K.J.}",
booktitle = "Proceedings of the LREC Workshop on Multimodal Corpora",

}

Reidsma, D & op den Akker, HJA 2008, On the Contextual Analysis of Agreement Scores. in J-C Martin, P Paggio, M Kipp & DKJ Heylen (eds), Proceedings of the LREC Workshop on Multimodal Corpora. ELRA, Paris, France, pp. 52-55.

On the Contextual Analysis of Agreement Scores. / Reidsma, Dennis; op den Akker, Hendrikus J.A.

Proceedings of the LREC Workshop on Multimodal Corpora. ed. / J-C. Martin; P. Paggio; M. Kipp; Dirk K.J. Heylen. Paris, France : ELRA, 2008. p. 52-55.

Research output: Scientific - peer-reviewConference contribution

TY - CHAP

T1 - On the Contextual Analysis of Agreement Scores

AU - Reidsma,Dennis

AU - op den Akker,Hendrikus J.A.

PY - 2008/5

Y1 - 2008/5

N2 - Annotators of multimodal corpora rely on a combination of audio and video features to assign labels to the events observed. The reliability of annotations may be influenced by the presences or absence of certain key features. For practical applications it can be useful to know what circumstances determined fluctuations in the interannotator agreement. In this paper we consider the case of annotations of addressing on the AMI corpus.

AB - Annotators of multimodal corpora rely on a combination of audio and video features to assign labels to the events observed. The reliability of annotations may be influenced by the presences or absence of certain key features. For practical applications it can be useful to know what circumstances determined fluctuations in the interannotator agreement. In this paper we consider the case of annotations of addressing on the AMI corpus.

KW - EWI-13047

KW - HMI-MI: MULTIMODAL INTERACTIONS

KW - IR-64869

KW - METIS-251070

KW - EC Grant Agreement nr.: FP6/033812

M3 - Conference contribution

SN - 2-9517408-4-0

SP - 52

EP - 55

BT - Proceedings of the LREC Workshop on Multimodal Corpora

PB - ELRA

ER -

Reidsma D, op den Akker HJA. On the Contextual Analysis of Agreement Scores. In Martin J-C, Paggio P, Kipp M, Heylen DKJ, editors, Proceedings of the LREC Workshop on Multimodal Corpora. Paris, France: ELRA. 2008. p. 52-55.