Robust 3D Face Recognition in the Presence of Realistic Occlusions

Nese Alyuz, B. Gökberk, Lieuwe Jan Spreeuwers, Raymond N.J. Veldhuis, Lale Akarun

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    19 Citations (Scopus)

    Abstract

    Facial occlusions pose significant problems for automatic face recognition systems. In this work, we propose a novel occlusion-resistant three-dimensional (3D) facial identification system. We show that, under extreme occlusions due to hair, hands, and eyeglasses, typical 3D face recognition systems exhibit poor performance. In order to deal with occlusions, our proposed system employs occlusion-resistant registration, occlusion detection, and regional classifiers. A two-step registration module first detects the nose region on the curvedness-weighted convex shape index map, and then performs fine alignment using nose-based Iterative Closest Point (ICP) algorithm. Occluded areas are determined automatically via a generic face model. After non-facial parts introduced by occlusions are removed, a variant of Gappy Principal Component Analysis (Gappy PCA) is used to restore the full face from occlusion-free facial surfaces. Experimental results obtained on realistically occluded facial images from the Bosphorus 3D face database shows that, with the use of score-level fusion of regional Linear Discriminant Analysis (LDA) classifiers, the proposed method improves rank-1 identification accuracy significantly: from 76.12% to 94.23%.
    Original languageUndefined
    Title of host publication5th IAPR International Conference on Biometrics, ICB 2012
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages111-118
    Number of pages8
    ISBN (Print)978-1-4673-0396-5
    DOIs
    Publication statusPublished - 1 Apr 2012
    Event5th IAPR International Conference on Biometrics, ICB 2012 - ITC Sheraton, New Delhi, India
    Duration: 29 Mar 20121 Apr 2012
    http://icb12.iiitd.ac.in/

    Publication series

    Name
    PublisherIEEE Computer Society

    Conference

    Conference5th IAPR International Conference on Biometrics, ICB 2012
    Abbreviated titleICB
    CountryIndia
    CityNew Delhi
    Period29/03/121/04/12
    Internet address

    Keywords

    • METIS-287860
    • Biometrics
    • IR-81247
    • Pattern Recognition
    • EWI-21548
    • Computer Vision
    • SCS-Safety
    • CR-I.5
    • Face Recognition

    Cite this

    Alyuz, N., Gökberk, B., Spreeuwers, L. J., Veldhuis, R. N. J., & Akarun, L. (2012). Robust 3D Face Recognition in the Presence of Realistic Occlusions. In 5th IAPR International Conference on Biometrics, ICB 2012 (pp. 111-118). USA: IEEE Computer Society. https://doi.org/10.1109/ICB.2012.6199767