Merging SVMs with Linear Discriminant Analysis: A Combined Model

S. Nikitidis, S. Zafeiriou, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    6 Citations (Scopus)
    41 Downloads (Pure)


    A key problem often encountered by many learning algorithms in computer vision dealing with high dimensional data is the so called "curse of dimensionality" which arises when the available training samples are less than the input feature space dimensionality. To remedy this problem, we propose a joint dimensionality reduction and classification framework by formulating an optimization problem within the maximum margin class separation task. The proposed optimization problem is solved using alternative optimization where we jointly compute the low dimensional maximum margin projections and the separating hyperplanes in the projection subspace. Moreover, in order to reduce the computational cost of the developed optimization algorithm we incorporate orthogonality constraints on the derived projection bases and show that the resulting combined model is an alternation between identifying the optimal separating hyperplanes and performing a linear discriminant analysis on the support vectors. Experiments on face, facial expression and object recognition validate the effectiveness of the proposed method against state-of-the-art dimensionality reduction algorithms.
    Original languageUndefined
    Title of host publicationProceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014
    Place of PublicationUSA
    Number of pages8
    ISBN (Print)978-1-4799-5117-8
    Publication statusPublished - Jun 2014
    Event27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014 - Columbus, OH, USA, Columbus, United States
    Duration: 23 Jun 201428 Jun 2014
    Conference number: 27

    Publication series

    PublisherIEEE Computer Society
    ISSN (Print)1063-6919


    Conference27th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014
    Abbreviated titleCVPR 2014
    Country/TerritoryUnited States
    Other23-28 June 2014


    • HMI-HF: Human Factors
    • IR-95224
    • METIS-309943
    • EWI-25817

    Cite this