Local normal binary patterns for 3D facial action unit detection

Georgia Sandbach, Stefanos Zafeiriou, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    46 Citations (Scopus)

    Abstract

    This paper proposes a new feature descriptor, local normal binary patterns (LNBPs), which is exploited for detection of facial action units (AUs). After LNBPs have been employed to form descriptor vectors, which capture the detailed shape of the action, feature selection is performed via a Gentle- Boost (GB) algorithm, and support vector machines (SVMs) are trained to detect each AU. This process was tested on the Bosphorus database, alongside the same test using 3D local binary pattern (3DLBP) descriptors which apply the LBP operator to the depth map of the face. LNBP descriptors were demonstrated to outperform 3DLBPs in detection of many individual AUs. Finally, feature fusion was used to combine the benefits of the 3DLBPs and each of the LNBP descriptors, with the best result achieving a mean ROC AuC of 96.35.
    Original languageUndefined
    Title of host publicationProceedings of the IEEE International Conference on Image Processing, ICIP 2012
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages1813-1816
    Number of pages4
    ISBN (Print)978-1-4673-2533-2
    DOIs
    Publication statusPublished - 30 Sep 2012
    EventIEEE International Conference on Image Processing, ICIP 2012 - Orlando, FL, USA
    Duration: 30 Sep 20123 Oct 2012

    Publication series

    Name
    PublisherIEEE Computer Society

    Conference

    ConferenceIEEE International Conference on Image Processing, ICIP 2012
    Period30/09/123/10/12
    Other30 September - 3 October 2012

    Keywords

    • EWI-22974
    • IR-84324
    • METIS-296262
    • HMI-MI: MULTIMODAL INTERACTIONS

    Cite this