Action Unit detection using sparse appearance descriptors in space-time video volumes

Bihan Jiang, Michel F. Valstar, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    167 Citations (Scopus)

    Abstract

    Recently developed appearance descriptors offer the opportunity for efficient and robust facial expression recognition. In this paper we investigate the merits of the family of local binary pattern descriptors for FACS Action-Unit (AU) detection. We compare Local Binary Patterns (LBP) and Local Phase Quantisation (LPQ) for static AU analysis. To encode facial expression dynamics, we extend the purely spatial representation LPQ to a dynamic texture descriptor which we call Local Phase Quantisation from Three Orthogonal Planes (LPQ-TOP), and compare this with the Local Binary Patterns from Three Orthogonal Planes (LBP-TOP). The efficiency of these descriptors is evaluated by a fully automatic AU detection system and tested on posed and spontaneous expression data collected from the MMI and SEMAINE databases. Results show that the systems based on LPQ achieve higher accuracy rate than those using LBP, and that the systems that utilise dynamic appearance descriptors outperform those that use static appearance descriptors. Overall, our proposed LPQ-TOP method outperformed all other tested methods.
    Original languageUndefined
    Title of host publicationIEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011)
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages314-321
    Number of pages8
    ISBN (Print)978-1-4244-9140-7
    DOIs
    Publication statusPublished - Mar 2011
    Event9th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2011 - Santa Barbara, United States
    Duration: 21 Mar 201125 Mar 2011
    Conference number: 9

    Publication series

    Name
    PublisherIEEE Computer Society

    Conference

    Conference9th IEEE International Conference on Automatic Face and Gesture Recognition, FG 2011
    Abbreviated titleFG
    CountryUnited States
    CitySanta Barbara
    Period21/03/1125/03/11

    Keywords

    • METIS-285030
    • IR-79434
    • Face Recognition
    • Gold
    • Image sequences
    • Feature extraction
    • HMI-MI: MULTIMODAL INTERACTIONS
    • Face
    • Pixel
    • EWI-21329
    • EC Grant Agreement nr.: FP7/231287
    • EC Grant Agreement nr.: FP7/211486
    • Histograms

    Cite this

    Jiang, B., Valstar, M. F., & Pantic, M. (2011). Action Unit detection using sparse appearance descriptors in space-time video volumes. In IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011) (pp. 314-321). USA: IEEE Computer Society. https://doi.org/10.1109/FG.2011.5771416