Morphed Face Detection Based on Deep Color Residual Noise

Sushma Venkatesh, Raghavendra Ramachandra, Kiran Raja, Luuk Spreeuwers, Raymond Veldhuis, Christoph Busch

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Secure access control applications like border control rely on the face based verification system by considering its reliability, usability and accuracy in-person verification. However, face recognition systems are vulnerable to morphed face attacks, in which, the morphing process combines two different facial images into a single facial image. The features extracted from the morphed face image will match to those extracted from probe images of both faces. Thus, it is essential to reliably detect the morphed face image attacks on the face recognition systems. In this work, we propose a novel approach to detect morphed face images using residual color noise. The proposed method is designed to capture the noise patterns that are a result of the morphing process. Thus, the proposed method performs first denoising using Deep Convolutional Neural Network (CNN) independently on the Hue Saturation Value (HSV) color space, and then computes the residual noise. The extracted residual noise is further processed using Pyramid Local Binary Patterns (P-LBP), which is further classified using the Spectral Regression Kernel Discriminant Analysis (SRKDA). Extensive experiments are carried out on three different morphed face image datasets. The Morphed Attack Detection (MAD) performance of the proposed method is benchmarked with 13 different state-of-the-art techniques using the ISO IEC 30107-3 evaluation metrics. Based on the obtained quantitative results, the proposed method has indicated the best performance.

Original languageEnglish
Title of host publication2019 9th International Conference on Image Processing Theory, Tools and Applications, IPTA 2019
Place of PublicationPiscataway, NJ
PublisherIEEE
ISBN (Electronic)978-1-7281-3975-3, 978-1-7281-3974-6
ISBN (Print)978-1-7281-3976-0
DOIs
Publication statusPublished - Nov 2019

Publication series

NameInternational Conference on Image Processing Theory, Tools and Applications (IPTA)
PublisherIEEE
Volume2019
ISSN (Print)2154-5111
ISSN (Electronic)2154-512X

    Fingerprint

Keywords

  • Biometrics
  • Face recognition
  • Morphing attack detection
  • Morphing attacks

Cite this

Venkatesh, S., Ramachandra, R., Raja, K., Spreeuwers, L., Veldhuis, R., & Busch, C. (2019). Morphed Face Detection Based on Deep Color Residual Noise. In 2019 9th International Conference on Image Processing Theory, Tools and Applications, IPTA 2019 [8936088] (International Conference on Image Processing Theory, Tools and Applications (IPTA); Vol. 2019). Piscataway, NJ: IEEE. https://doi.org/10.1109/IPTA.2019.8936088