Audiovisual laughter detection based on temporal features

Stavros Petridis, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    83 Downloads (Pure)

    Abstract

    Previous research on automatic laughter detection has mainly been focused on audio-based detection. In this study we present an audiovisual approach to distinguishing laughter from speech based on temporal features and we show that the integration of audio and visual information leads to improved performance over single-modal approaches. Static features are extracted on an audio/video frame basis and then combined with temporal features extracted over a temporal window, describing the evolution of static features over time. When tested on 96 audiovisual sequences, depicting spontaneously displayed (as opposed to posed) laughter and speech episodes, in a person independent way the proposed audiovisual approach achieves an F1 rate of over 89%.
    Original languageEnglish
    Title of host publicationBNAIC 2008
    Subtitle of host publicationProceedings of BNAIC 2008, the twentieth Belgian-Dutch Artificial Intelligence Conference, Enschede/Bad Boekelo, October 30-31, 2008
    EditorsAnton Nijholt, Maja Pantic, Mannes Poel, Hendri Hondorp
    PublisherUniversity of Twente
    Pages351-352
    Number of pages2
    Publication statusPublished - 30 Oct 2008
    Event20th Benelux Conference on Artificial Intelligence, BNAIC 2008 - Boekelo, Netherlands
    Duration: 30 Oct 200831 Oct 2008
    Conference number: 20

    Publication series

    NameBNAIC: proceedings of the ... Belgium/Netherlands Artificial Intelligence Conference
    PublisherUniversity of Twente
    Number20
    ISSN (Print)1568-7805

    Conference

    Conference20th Benelux Conference on Artificial Intelligence, BNAIC 2008
    Abbreviated titleBNAIC
    Country/TerritoryNetherlands
    CityBoekelo
    Period30/10/0831/10/08

    Keywords

    • HMI-MI: MULTIMODAL INTERACTIONS
    • EC Grant Agreement nr.: FP7/211486
    • EC Grant Agreement nr.: FP6/0027787

    Fingerprint

    Dive into the research topics of 'Audiovisual laughter detection based on temporal features'. Together they form a unique fingerprint.
    • Audiovisual laughter detection based on temporal features

      Petridis, S. & Pantic, M., Oct 2008, ICMI '08: Proceedings of the 10th International Conference on Multimodal Interfaces. New York: Association for Computing Machinery, p. 37-44 8 p.

      Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

      30 Citations (Scopus)
      6 Downloads (Pure)

    Cite this