Facial Expression Invariant Head Pose Normalization using Gaussian Process Regression

Ognjen Rudovic, Ioannis Patras, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    8 Citations (Scopus)
    21 Downloads (Pure)

    Abstract

    We present a regression-based scheme for facialexpression-invariant head pose normalization. We address the problem by mapping the locations of 2D facial points (e.g. mouth corners) from non-frontal poses to the frontal pose. This is done in two steps. First, we propose a head pose estimator that maps the input 2D facial point locations into a head-pose space defined by a low dimensional manifold attained by means of multi-class LDA. Then, to learn the mappings between a discrete set of non-frontal head poses and the frontal pose, we propose using a Gaussian Process Regression (GPR) model for each pair of target poses (i.e. a non-frontal and the frontal pose). During testing, the head pose estimator is used to activate the most relevant GPR model which is later applied to project the locations of 2D facial landmarks from an arbitrary pose (that does not have to be one of the training poses) to the frontal pose. In our experiments we show that the proposed scheme (i) performs accurately for continuous head pose in the range from 0° to 45° pan rotation and from 0° to 30° tilt rotation despite the fact that the training was conducted only on a set of discrete poses, (ii) handles successfully both expressive and expressionless faces (even in cases when some of the expression categories were missing in certain poses during the training), and (iii) outperforms both 3D Point Distribution Model (3D-PDM) and Linear Regression (LR) model that are used as baseline methods for pose normalization. The proposed method is experimentally evaluated on data from the BU蚠3DFE facial expression database.
    Original languageUndefined
    Title of host publicationIEEE Conference on Computer Vision and Pattern Recognition (CVPR '10), Workshop CVPR for Human Communicative Behaviour Analysis (CVPR4HB)
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages28-33
    Number of pages6
    ISBN (Print)978-1-4244-7029-7
    DOIs
    Publication statusPublished - 18 Jun 2010
    Event23rd IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010 - San Francisco, United States
    Duration: 13 Jun 201018 Jun 2010
    Conference number: 23

    Publication series

    Name
    PublisherIEEE Computer Society
    Volume3

    Workshop

    Workshop23rd IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2010
    Abbreviated titleCVPR 2010
    CountryUnited States
    CitySan Francisco
    Period13/06/1018/06/10

    Keywords

    • IR-75976
    • METIS-276363
    • EC Grant Agreement nr.: FP7/211486
    • HMI-MI: MULTIMODAL INTERACTIONS
    • EWI-19550

    Cite this

    Rudovic, O., Patras, I., & Pantic, M. (2010). Facial Expression Invariant Head Pose Normalization using Gaussian Process Regression. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR '10), Workshop CVPR for Human Communicative Behaviour Analysis (CVPR4HB) (pp. 28-33). USA: IEEE Computer Society. https://doi.org/10.1109/CVPRW.2010.5543269