Local normal binary patterns for 3D facial action unit detection

Georgia Sandbach, Stefanos Zafeiriou, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    49 Citations (Scopus)


    This paper proposes a new feature descriptor, local normal binary patterns (LNBPs), which is exploited for detection of facial action units (AUs). After LNBPs have been employed to form descriptor vectors, which capture the detailed shape of the action, feature selection is performed via a Gentle- Boost (GB) algorithm, and support vector machines (SVMs) are trained to detect each AU. This process was tested on the Bosphorus database, alongside the same test using 3D local binary pattern (3DLBP) descriptors which apply the LBP operator to the depth map of the face. LNBP descriptors were demonstrated to outperform 3DLBPs in detection of many individual AUs. Finally, feature fusion was used to combine the benefits of the 3DLBPs and each of the LNBP descriptors, with the best result achieving a mean ROC AuC of 96.35.
    Original languageUndefined
    Title of host publicationProceedings of the IEEE International Conference on Image Processing, ICIP 2012
    Place of PublicationUSA
    Number of pages4
    ISBN (Print)978-1-4673-2533-2
    Publication statusPublished - 30 Sept 2012
    EventIEEE International Conference on Image Processing, ICIP 2012 - Orlando, FL, USA
    Duration: 30 Sept 20123 Oct 2012

    Publication series

    PublisherIEEE Computer Society


    ConferenceIEEE International Conference on Image Processing, ICIP 2012
    Other30 September - 3 October 2012


    • EWI-22974
    • IR-84324
    • METIS-296262

    Cite this