Merging SVMs with Linear Discriminant Analysis: A Combined Model

S. Nikitidis, S. Zafeiriou, Maja Pantic

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    4 Citations (Scopus)
    12 Downloads (Pure)

    Abstract

    A key problem often encountered by many learning algorithms in computer vision dealing with high dimensional data is the so called "curse of dimensionality" which arises when the available training samples are less than the input feature space dimensionality. To remedy this problem, we propose a joint dimensionality reduction and classification framework by formulating an optimization problem within the maximum margin class separation task. The proposed optimization problem is solved using alternative optimization where we jointly compute the low dimensional maximum margin projections and the separating hyperplanes in the projection subspace. Moreover, in order to reduce the computational cost of the developed optimization algorithm we incorporate orthogonality constraints on the derived projection bases and show that the resulting combined model is an alternation between identifying the optimal separating hyperplanes and performing a linear discriminant analysis on the support vectors. Experiments on face, facial expression and object recognition validate the effectiveness of the proposed method against state-of-the-art dimensionality reduction algorithms.
    Original languageUndefined
    Title of host publicationProceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014
    Place of PublicationUSA
    PublisherIEEE Computer Society
    Pages1067-1074
    Number of pages8
    ISBN (Print)978-1-4799-5117-8
    DOIs
    Publication statusPublished - Jun 2014

    Publication series

    Name
    PublisherIEEE Computer Society
    ISSN (Print)1063-6919

    Keywords

    • HMI-HF: Human Factors
    • IR-95224
    • METIS-309943
    • EWI-25817

    Cite this

    Nikitidis, S., Zafeiriou, S., & Pantic, M. (2014). Merging SVMs with Linear Discriminant Analysis: A Combined Model. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014 (pp. 1067-1074). USA: IEEE Computer Society. https://doi.org/10.1109/CVPR.2014.140