Non-rigid registration using free-form deformations for recognition of facial actions and their temporal dynamics

Sander Koelstra, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    42 Citations (Scopus)

    Abstract

    In this paper we propose an appearance-based approach to recognition of facial Action Units (AUs) and their temporal segments in frontal-view face videos. Non-rigid registration using free-form deformations is used to determine motion in the face region of an input video. The extracted motion fields are then used to derive motion histogram descriptors. Per AU, a combination of ensemble learners and Hidden Markov Models detects the presence of the AU in question and its temporal segment in each frame of an input sequence. When tested for recognition of all 27 lower and upper face AUs, occurring alone or in combination in 264 sequences from the MMI facial expression database, an average sequence classification rate of 94.3% was achieved.
    Original languageUndefined
    Title of host publicationProceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG'08)
    Place of PublicationWashington, DC, USA
    PublisherIEEE Computer Society Press
    Pages1-8
    Number of pages8
    ISBN (Print)978-1-4244-2154-1
    DOIs
    Publication statusPublished - Sep 2008
    Event8th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2008 - Amsterdam, Netherlands
    Duration: 17 Sep 200819 Sep 2008
    Conference number: 8

    Publication series

    Name
    PublisherIEEE Computer Society Press
    Number2008/16200

    Conference

    Conference8th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2008
    Abbreviated titleFG
    CountryNetherlands
    CityAmsterdam
    Period17/09/0819/09/08

    Keywords

    • HMI-MI: MULTIMODAL INTERACTIONS
    • EC Grant Agreement nr.: FP6/0027787
    • METIS-255098
    • EWI-14829
    • IR-62680
    • EC Grant Agreement nr.: FP7/211486

    Cite this

    Koelstra, S., & Pantic, M. (2008). Non-rigid registration using free-form deformations for recognition of facial actions and their temporal dynamics. In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition (FG'08) (pp. 1-8). Washington, DC, USA: IEEE Computer Society Press. https://doi.org/10.1109/AFGR.2008.4813361