On the Contextual Analysis of Agreement Scores

Dennis Reidsma, Hendrikus J.A. op den Akker

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    4 Citations (Scopus)

    Abstract

    This paper explores the relation between agreement, data quality and machine learning, using the AMI corpus. The paper describes a novel approach that uses contextual information from other modalities to determine a more reliable subset of data, for annotations that have a low overall agreement.
    Original languageUndefined
    Title of host publicationMultimodal Corpora -- From Models of Natural Interaction to Systems and Applications
    EditorsJ-C. Martin, P. Paggio, M. Kipp, Dirk K.J. Heylen, D. Heylen
    Place of PublicationBerlin
    PublisherSpringer
    Pages122-137
    Number of pages16
    ISBN (Print)978-3-642-04792-3
    DOIs
    Publication statusPublished - Sep 2009

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer Verlag
    Volume5509
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

    Keywords

    • IR-68094
    • EC Grant Agreement nr.: FP6/033812
    • EWI-16082
    • METIS-266453

    Cite this

    Reidsma, D., & op den Akker, H. J. A. (2009). On the Contextual Analysis of Agreement Scores. In J-C. Martin, P. Paggio, M. Kipp, D. K. J. Heylen, & D. Heylen (Eds.), Multimodal Corpora -- From Models of Natural Interaction to Systems and Applications (pp. 122-137). [10.1007/978-3-642-04793-0_8] (Lecture Notes in Computer Science; Vol. 5509). Berlin: Springer. https://doi.org/10.1007/978-3-642-04793-0_8