Twente Debate Corpus - A Multimodal Corpus for Head Movement Analysis

Bayu Rahayudi, Bayu Rahayudi, Ronald Walter Poppe, Dirk K.J. Heylen

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    2 Citations (Scopus)
    42 Downloads (Pure)


    This paper introduces a multimodal discussion corpus for the study into head movement and turn-taking patterns in debates. Given that participants either acted alone or in a pair, cooperation and competition and their nonverbal correlates can be analyzed. In addition to the video and audio of the recordings, the corpus contains automatically estimated head movements, and manual annotations of who is speaking and who is looking where. The corpus consists of over 2 hours of debates, in 6 groups with 18 participants in total. We describe the recording setup and present initial analyses of the recorded data. We found that the person who acted as single debater speaks more and also receives more attention compared to the other debaters, also when corrected for the time speaking.We also found that a single debater was more likely to speak after a team debater. Future work will be aimed at further analysis of the relation between speaking and looking patterns, the outcome of the debate and perceived dominance of the debaters.
    Original languageUndefined
    Title of host publicationProceedings of the International Conference on Language Resources and Evaluation (LREC 2014)
    Place of PublicationLuxembourg
    PublisherEuropean Language Resources Association (ELRA)
    Number of pages6
    ISBN (Print)978-2-9517408-8-4
    Publication statusPublished - May 2014
    Event9th International Conference on Language Resources and Evaluation 2014 - Harpa Concert Hall and Conference Center, Reykjavik, Iceland
    Duration: 26 May 201431 May 2014
    Conference number: 9

    Publication series

    PublisherEuropean Language Resources Association (ELRA)


    Conference9th International Conference on Language Resources and Evaluation 2014
    Abbreviated titleLREC 2014
    Internet address


    • EWI-24842
    • Debates
    • METIS-305913
    • Corpus
    • Visual focus of attention
    • IR-91611
    • Head movement

    Cite this