Estimating 3D trajectories from 2D projections via disjunctive factored four-way conditional restricted Boltzmann machines

Decebal Constantin Mocanu*, Haitham Bou Ammar, Luis Puig, Eric Eaton, Antonio Liotta

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

7 Citations (Scopus)

Abstract

Estimation, recognition, and near-future prediction of 3D trajectories based on their two dimensional projections available from one camera source is an exceptionally difficult problem due to uncertainty in the trajectories and environment, high dimensionality of the specific trajectory states, lack of enough labeled data and so on. In this article, we propose a solution to solve this problem based on a novel deep learning model dubbed disjunctive factored four-way conditional restricted Boltzmann machine (DFFW-CRBM). Our method improves state-of-the-art deep learning techniques for high dimensional time-series modeling by introducing a novel tensor factorization capable of driving forth order Boltzmann machines to considerably lower energy levels, at no computational costs. DFFW-CRBMs are capable of accurately estimating, recognizing, and performing near-future prediction of three-dimensional trajectories from their 2D projections while requiring limited amount of labeled data. We evaluate our method on both simulated and real-world data, showing its effectiveness in predicting and classifying complex ball trajectories and human activities.

Original languageEnglish
Pages (from-to)325-335
Number of pages11
JournalPattern recognition
Volume69
DOIs
Publication statusPublished - Sep 2017
Externally publishedYes

Keywords

  • 3D trajectories estimation
  • Activity recognition
  • Deep learning
  • Restricted Boltzmann machines

Fingerprint Dive into the research topics of 'Estimating 3D trajectories from 2D projections via disjunctive factored four-way conditional restricted Boltzmann machines'. Together they form a unique fingerprint.

Cite this