Robust partial face recognition using multi-label attributes

Gaoli Sang*, Dan Zeng, Chao Yan, Raymond Veldhuis, Luuk Spreeuwers

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Partial face recognition (PFR) is challenging as the appearance of the face changes significantly with occlusion. In particular, these occlusions can be due to any item and may appear in any position that seriously hinders the extraction of discriminative features. Existing methods deal with PFR either by training a deep model with existing face databases containing limited occlusion types or by extracting un-occluded features directly from face regions without occlusions. Limited training data (i.e., occlusion type and diversity) can not cover the real-occlusion situations, and thus training-based methods can not learn occlusion robust discriminative features. The performance of occlusion region-based method is bounded by occlusion detection. Different from limited training data and occlusion region-based methods, we propose to use multi-label attributes for Partial Face Recognition (Attr4PFR). A novel data augmentation is proposed to solve limited training data and generate occlusion attributes. Apart from occlusion attributes, we also include soft biometric attributes and semantic attributes to explore more rich attributes to combat the loss caused by occlusions. To train our Attr4PFR, we propose an implicit attributes loss combined with a softmax loss to enforce Attr4PFR to learn discriminative features. As multi-label attributes are our auxiliary signal in the training phase, we do not need them in the inference. Extensive experiments on public benchmark AR and IJB-C databases show our method is 3% and 2.3% improvement compared to the state-of-the-art.

Original languageEnglish
Pages (from-to)377-392
Number of pages16
JournalIntelligent Data Analysis
Volume28
Issue number1
DOIs
Publication statusPublished - 3 Feb 2024

Keywords

  • Discriminative feature learning
  • Multi-label attributes
  • Partial face recognition
  • 2024 OA procedure

Fingerprint

Dive into the research topics of 'Robust partial face recognition using multi-label attributes'. Together they form a unique fingerprint.

Cite this