Variational Hidden Conditional Random Fields with Coupled Dirichlet Process Mixtures

Konstantinos Bousmalis, Stefanos Zafeiriou, Louis-Philippe Morency, Maja Pantic, Zoubin Ghahramani

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    5 Citations (Scopus)
    19 Downloads (Pure)

    Abstract

    Hidden Conditional Random Fields (HCRFs) are discriminative latent variable models which have been shown to successfully learn the hidden structure of a given classification problem. An infinite HCRF is an HCRF with a countably infinite number of hidden states, which rids us not only of the necessity to specify a priori a fixed number of hidden states available but also of the problem of overfitting. Markov chain Monte Carlo (MCMC) sampling algorithms are often employed for inference in such models. However, convergence of such algorithms is rather difficult to verify, and as the complexity of the task at hand increases, the computational cost of such algorithms often becomes prohibitive. These limitations can be overcome by variational techniques. In this paper, we present a generalized framework for infinite HCRF models, and a novel variational inference approach on a model based on coupled Dirichlet Process Mixtures, the HCRF–DPM. We show that the variational HCRF–DPM is able to converge to a correct number of represented hidden states, and performs as well as the best parametric HCRFs —chosen via cross–validation— for the difficult tasks of recognizing instances of agreement, disagreement, and pain in audiovisual sequences.
    Original languageEnglish
    Title of host publicationMachine learning and knowledge discovery in databases
    Subtitle of host publicationEuropean Conference, ECML PKDD 2013, Prague, Czech Republic, September 23-27, 2013, Proceedings
    Place of PublicationBerlin
    PublisherSpringer
    Pages531-547
    Number of pages17
    ISBN (Print)978-3-642-40990-5
    DOIs
    Publication statusPublished - Sep 2013

    Publication series

    NameLecture Notes in Computer Science
    PublisherSpringer Verlag
    Volume8189
    ISSN (Print)0302-9743
    ISSN (Electronic)1611-3349

      Fingerprint

    Keywords

    • HMI-HF: Human Factors
    • METIS-302662
    • IR-89373
    • EWI-24343

    Cite this

    Bousmalis, K., Zafeiriou, S., Morency, L-P., Pantic, M., & Ghahramani, Z. (2013). Variational Hidden Conditional Random Fields with Coupled Dirichlet Process Mixtures. In Machine learning and knowledge discovery in databases: European Conference, ECML PKDD 2013, Prague, Czech Republic, September 23-27, 2013, Proceedings (pp. 531-547). (Lecture Notes in Computer Science; Vol. 8189). Berlin: Springer. https://doi.org/10.1007/978-3-642-40991-2_34