On the Contextual Analysis of Agreement Scores

Dennis Reidsma, Hendrikus J.A. op den Akker

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

4 Citations (Scopus)

Abstract

This paper explores the relation between agreement, data quality and machine learning, using the AMI corpus. The paper describes a novel approach that uses contextual information from other modalities to determine a more reliable subset of data, for annotations that have a low overall agreement.
Original languageUndefined
Title of host publicationMultimodal Corpora -- From Models of Natural Interaction to Systems and Applications
EditorsJ-C. Martin, P. Paggio, M. Kipp, Dirk K.J. Heylen, D. Heylen
Place of PublicationBerlin
PublisherSpringer
Pages122-137
Number of pages16
ISBN (Print)978-3-642-04792-3
DOIs
Publication statusPublished - Sep 2009

Publication series

NameLecture Notes in Computer Science
PublisherSpringer Verlag
Volume5509
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Keywords

  • IR-68094
  • EC Grant Agreement nr.: FP6/033812
  • EWI-16082
  • METIS-266453

Cite this

Reidsma, D., & op den Akker, H. J. A. (2009). On the Contextual Analysis of Agreement Scores. In J-C. Martin, P. Paggio, M. Kipp, D. K. J. Heylen, & D. Heylen (Eds.), Multimodal Corpora -- From Models of Natural Interaction to Systems and Applications (pp. 122-137). [10.1007/978-3-642-04793-0_8] (Lecture Notes in Computer Science; Vol. 5509). Berlin: Springer. https://doi.org/10.1007/978-3-642-04793-0_8
Reidsma, Dennis ; op den Akker, Hendrikus J.A. / On the Contextual Analysis of Agreement Scores. Multimodal Corpora -- From Models of Natural Interaction to Systems and Applications. editor / J-C. Martin ; P. Paggio ; M. Kipp ; Dirk K.J. Heylen ; D. Heylen. Berlin : Springer, 2009. pp. 122-137 (Lecture Notes in Computer Science).
@inproceedings{14b1d3db88924b8f8abdc32453b14d5e,
title = "On the Contextual Analysis of Agreement Scores",
abstract = "This paper explores the relation between agreement, data quality and machine learning, using the AMI corpus. The paper describes a novel approach that uses contextual information from other modalities to determine a more reliable subset of data, for annotations that have a low overall agreement.",
keywords = "IR-68094, EC Grant Agreement nr.: FP6/033812, EWI-16082, METIS-266453",
author = "Dennis Reidsma and {op den Akker}, {Hendrikus J.A.}",
year = "2009",
month = "9",
doi = "10.1007/978-3-642-04793-0_8",
language = "Undefined",
isbn = "978-3-642-04792-3",
series = "Lecture Notes in Computer Science",
publisher = "Springer",
pages = "122--137",
editor = "J-C. Martin and P. Paggio and M. Kipp and Heylen, {Dirk K.J.} and D. Heylen",
booktitle = "Multimodal Corpora -- From Models of Natural Interaction to Systems and Applications",

}

Reidsma, D & op den Akker, HJA 2009, On the Contextual Analysis of Agreement Scores. in J-C Martin, P Paggio, M Kipp, DKJ Heylen & D Heylen (eds), Multimodal Corpora -- From Models of Natural Interaction to Systems and Applications., 10.1007/978-3-642-04793-0_8, Lecture Notes in Computer Science, vol. 5509, Springer, Berlin, pp. 122-137. https://doi.org/10.1007/978-3-642-04793-0_8

On the Contextual Analysis of Agreement Scores. / Reidsma, Dennis; op den Akker, Hendrikus J.A.

Multimodal Corpora -- From Models of Natural Interaction to Systems and Applications. ed. / J-C. Martin; P. Paggio; M. Kipp; Dirk K.J. Heylen; D. Heylen. Berlin : Springer, 2009. p. 122-137 10.1007/978-3-642-04793-0_8 (Lecture Notes in Computer Science; Vol. 5509).

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - On the Contextual Analysis of Agreement Scores

AU - Reidsma, Dennis

AU - op den Akker, Hendrikus J.A.

PY - 2009/9

Y1 - 2009/9

N2 - This paper explores the relation between agreement, data quality and machine learning, using the AMI corpus. The paper describes a novel approach that uses contextual information from other modalities to determine a more reliable subset of data, for annotations that have a low overall agreement.

AB - This paper explores the relation between agreement, data quality and machine learning, using the AMI corpus. The paper describes a novel approach that uses contextual information from other modalities to determine a more reliable subset of data, for annotations that have a low overall agreement.

KW - IR-68094

KW - EC Grant Agreement nr.: FP6/033812

KW - EWI-16082

KW - METIS-266453

U2 - 10.1007/978-3-642-04793-0_8

DO - 10.1007/978-3-642-04793-0_8

M3 - Conference contribution

SN - 978-3-642-04792-3

T3 - Lecture Notes in Computer Science

SP - 122

EP - 137

BT - Multimodal Corpora -- From Models of Natural Interaction to Systems and Applications

A2 - Martin, J-C.

A2 - Paggio, P.

A2 - Kipp, M.

A2 - Heylen, Dirk K.J.

A2 - Heylen, D.

PB - Springer

CY - Berlin

ER -

Reidsma D, op den Akker HJA. On the Contextual Analysis of Agreement Scores. In Martin J-C, Paggio P, Kipp M, Heylen DKJ, Heylen D, editors, Multimodal Corpora -- From Models of Natural Interaction to Systems and Applications. Berlin: Springer. 2009. p. 122-137. 10.1007/978-3-642-04793-0_8. (Lecture Notes in Computer Science). https://doi.org/10.1007/978-3-642-04793-0_8