Merging SVMs with Linear Discriminant Analysis: A Combined Model

S. Nikitidis, S. Zafeiriou, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    5 Citations (Scopus)
    13 Downloads (Pure)

    Abstract

    A key problem often encountered by many learning algorithms in computer vision dealing with high dimensional data is the so called "curse of dimensionality" which arises when the available training samples are less than the input feature space dimensionality. To remedy this problem, we propose a joint dimensionality reduction and classification framework by formulating an optimization problem within the maximum margin class separation task. The proposed optimization problem is solved using alternative optimization where we jointly compute the low dimensional maximum margin projections and the separating hyperplanes in the projection subspace. Moreover, in order to reduce the computational cost of the developed optimization algorithm we incorporate orthogonality constraints on the derived projection bases and show that the resulting combined model is an alternation between identifying the optimal separating hyperplanes and performing a linear discriminant analysis on the support vectors. Experiments on face, facial expression and object recognition validate the effectiveness of the proposed method against state-of-the-art dimensionality reduction algorithms.
    Original languageUndefined
    Title of host publicationProceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages1067-1074
    Number of pages8
    ISBN (Print)978-1-4799-5117-8
    DOIs
    Publication statusPublished - Jun 2014
    Event27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014 - Columbus, OH, USA, Columbus, United States
    Duration: 23 Jun 201428 Jun 2014
    Conference number: 27

    Publication series

    Name
    PublisherIEEE Computer Society
    ISSN (Print)1063-6919

    Conference

    Conference27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014
    Abbreviated titleCVPR 2014
    CountryUnited States
    CityColumbus
    Period23/06/1428/06/14
    Other23-28 June 2014

    Keywords

    • HMI-HF: Human Factors
    • IR-95224
    • METIS-309943
    • EWI-25817

    Cite this