A Survey on Evaluation Metrics for Backchannel Prediction Models

I.A. de Kok, Dirk K.J. Heylen

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    62 Downloads (Pure)

    Abstract

    In this paper we give an overview of the evaluation metrics used to measure the performance of backchannel prediction models. Both objective and subjective evaluation metrics are discussed. The survey shows that almost every backchannel prediction model is evaluated with a different evaluation metric. This makes comparison between developed models unreliable, even beside the other variables in play, such as different corpora, language, conversational setting, amount of data and/or de﬿nition of the term backchannel.
    Original languageUndefined
    Title of host publicationProceedings of the Interdisciplinary Workshop on Feedback Behaviors in Dialog
    Place of PublicationEl Paso
    PublisherUniversity of Texas
    Pages15-18
    Number of pages4
    ISBN (Print)not assigned
    Publication statusPublished - 7 Sep 2012
    EventInterdisciplinary Workshop on Feedback Behaviors in Dialog, Stevenson, Washington, USA: Proceedings of the Interdisciplinary Workshop on Feedback Behaviors in Dialog - El Paso
    Duration: 7 Sep 2012 → …

    Publication series

    Name
    PublisherUniversity of Texas

    Conference

    ConferenceInterdisciplinary Workshop on Feedback Behaviors in Dialog, Stevenson, Washington, USA
    CityEl Paso
    Period7/09/12 → …

    Keywords

    • HMI-IA: Intelligent Agents
    • EWI-22780
    • METIS-296190
    • IR-84178

    Cite this