Abstract

Many interesting phenomena in conversations require interpretative judgements by the annotators. This leads to data which is annotated with lower levels of agreement due to the differences in how annotators interpret conversations. Instead of throwing away this data we show how and when we can exploit it. We analyse the (dis)agreements between annotators for two different cases in a multimodal annotated corpus and explicitly relate the results to the way machine-learning algorithms perform on the annotated data.
Original languageUndefined
Title of host publicationBNAIC 2008, Proceedings 20th Belgian-Netherlands Conference on Artificial Intelligence, Boekelo, Netherlands
EditorsA. Nijholt, Antinus Nijholt, Maja Pantic, M. Pantic, Mannes Poel, M. Poel, G.H.W. Hondorp
Place of PublicationEnschede, the Netherlands
Pages359-360
Number of pages2
StatePublished - Oct 2008
Event20th Benelux Conference on Artificial Intelligence, BNAIC 2008 - Boekelo, Netherlands

Publication series

Name
PublisherUniversity of Twente
NumberCFP08545-D
ISSN (Print)1568-7805

Conference

Conference20th Benelux Conference on Artificial Intelligence, BNAIC 2008
Abbreviated titleBNAIC
CountryNetherlands
CityBoekelo
Period30/10/0831/10/08

Fingerprint

Machine learning

Keywords

  • EWI-14666
  • HMI-IA: Intelligent Agents
  • METIS-255031
  • IR-62631
  • HMI-MI: MULTIMODAL INTERACTIONS

Cite this

Reidsma, D., & op den Akker, H. J. A. (2008). Subjective Machine Classifiers. In A. Nijholt, A. Nijholt, M. Pantic, M. Pantic, M. Poel, M. Poel, & G. H. W. Hondorp (Eds.), BNAIC 2008, Proceedings 20th Belgian-Netherlands Conference on Artificial Intelligence, Boekelo, Netherlands (pp. 359-360). Enschede, the Netherlands.

Reidsma, Dennis; op den Akker, Hendrikus J.A. / Subjective Machine Classifiers.

BNAIC 2008, Proceedings 20th Belgian-Netherlands Conference on Artificial Intelligence, Boekelo, Netherlands. ed. / A. Nijholt; Antinus Nijholt; Maja Pantic; M. Pantic; Mannes Poel; M. Poel; G.H.W. Hondorp. Enschede, the Netherlands, 2008. p. 359-360.

Research output: Scientific - peer-reviewConference contribution

@inbook{4085244930444a0c8fc57656429d4bea,
title = "Subjective Machine Classifiers",
abstract = "Many interesting phenomena in conversations require interpretative judgements by the annotators. This leads to data which is annotated with lower levels of agreement due to the differences in how annotators interpret conversations. Instead of throwing away this data we show how and when we can exploit it. We analyse the (dis)agreements between annotators for two different cases in a multimodal annotated corpus and explicitly relate the results to the way machine-learning algorithms perform on the annotated data.",
keywords = "EWI-14666, HMI-IA: Intelligent Agents, METIS-255031, IR-62631, HMI-MI: MULTIMODAL INTERACTIONS",
author = "Dennis Reidsma and {op den Akker}, {Hendrikus J.A.}",
note = "http://eprints.ewi.utwente.nl/14666",
year = "2008",
month = "10",
publisher = "University of Twente",
number = "CFP08545-D",
pages = "359--360",
editor = "A. Nijholt and Antinus Nijholt and Maja Pantic and M. Pantic and Mannes Poel and M. Poel and G.H.W. Hondorp",
booktitle = "BNAIC 2008, Proceedings 20th Belgian-Netherlands Conference on Artificial Intelligence, Boekelo, Netherlands",

}

Reidsma, D & op den Akker, HJA 2008, Subjective Machine Classifiers. in A Nijholt, A Nijholt, M Pantic, M Pantic, M Poel, M Poel & GHW Hondorp (eds), BNAIC 2008, Proceedings 20th Belgian-Netherlands Conference on Artificial Intelligence, Boekelo, Netherlands. Enschede, the Netherlands, pp. 359-360, 20th Benelux Conference on Artificial Intelligence, BNAIC 2008, Boekelo, Netherlands, 30-31 October.

Subjective Machine Classifiers. / Reidsma, Dennis; op den Akker, Hendrikus J.A.

BNAIC 2008, Proceedings 20th Belgian-Netherlands Conference on Artificial Intelligence, Boekelo, Netherlands. ed. / A. Nijholt; Antinus Nijholt; Maja Pantic; M. Pantic; Mannes Poel; M. Poel; G.H.W. Hondorp. Enschede, the Netherlands, 2008. p. 359-360.

Research output: Scientific - peer-reviewConference contribution

TY - CHAP

T1 - Subjective Machine Classifiers

AU - Reidsma,Dennis

AU - op den Akker,Hendrikus J.A.

N1 - http://eprints.ewi.utwente.nl/14666

PY - 2008/10

Y1 - 2008/10

N2 - Many interesting phenomena in conversations require interpretative judgements by the annotators. This leads to data which is annotated with lower levels of agreement due to the differences in how annotators interpret conversations. Instead of throwing away this data we show how and when we can exploit it. We analyse the (dis)agreements between annotators for two different cases in a multimodal annotated corpus and explicitly relate the results to the way machine-learning algorithms perform on the annotated data.

AB - Many interesting phenomena in conversations require interpretative judgements by the annotators. This leads to data which is annotated with lower levels of agreement due to the differences in how annotators interpret conversations. Instead of throwing away this data we show how and when we can exploit it. We analyse the (dis)agreements between annotators for two different cases in a multimodal annotated corpus and explicitly relate the results to the way machine-learning algorithms perform on the annotated data.

KW - EWI-14666

KW - HMI-IA: Intelligent Agents

KW - METIS-255031

KW - IR-62631

KW - HMI-MI: MULTIMODAL INTERACTIONS

M3 - Conference contribution

SP - 359

EP - 360

BT - BNAIC 2008, Proceedings 20th Belgian-Netherlands Conference on Artificial Intelligence, Boekelo, Netherlands

ER -

Reidsma D, op den Akker HJA. Subjective Machine Classifiers. In Nijholt A, Nijholt A, Pantic M, Pantic M, Poel M, Poel M, Hondorp GHW, editors, BNAIC 2008, Proceedings 20th Belgian-Netherlands Conference on Artificial Intelligence, Boekelo, Netherlands. Enschede, the Netherlands. 2008. p. 359-360.