Extending a DBMS to Support Content-Based Video Retrieval: A Formula 1 Case Study

M. Petkovic, Willem Jonker, V. Mihajlovic

Research output: Contribution to conferencePaper

Abstract

Content-based retrieval has been identified as one of the most challenging problems, requiring a multidisciplinary research among computer vision, information retrieval, artificial intelligence, database, and other fields. In this paper, we address the specific aspect of inferring semantics automatically from raw video data. In particular, we present the Cobra video database management system that supports the integrated use of different knowledge-based methods for mapping low-level features to high-level concepts. We focus on dynamic Bayesian networks and demonstrate how they can be effectively used for fusing the evidence obtained from different media information sources. The approach is validated in the particular domain of Formula 1 race videos. For that specific domain we introduce a robust audio-visual feature extraction scheme and a text recognition and detection method. Based on numerous experiments performed with DBNs, we give some recommendations with respect to the modeling of temporal dependences and different learning algorithms. Finally, we present the experimental results for the detection of excited speech and the extraction of highlights, as well as the advantageous query capabilities of our system.
Original languageEnglish
Pages318-341
Number of pages24
DOIs
Publication statusPublished - Mar 2002
EventWorkshop on Multimedia Data Document Engineering, MDDE 2002 - Prague, Czech Republic
Duration: 24 Mar 200228 Mar 2002

Workshop

WorkshopWorkshop on Multimedia Data Document Engineering, MDDE 2002
Abbreviated titleMDDE
CountryCzech Republic
CityPrague
Period24/03/0228/03/02

Keywords

  • EWI-7304
  • IR-63519
  • DB-MMR: MULTIMEDIA RETRIEVAL

Fingerprint Dive into the research topics of 'Extending a DBMS to Support Content-Based Video Retrieval: A Formula 1 Case Study'. Together they form a unique fingerprint.

  • Cite this

    Petkovic, M., Jonker, W., & Mihajlovic, V. (2002). Extending a DBMS to Support Content-Based Video Retrieval: A Formula 1 Case Study. 318-341. Paper presented at Workshop on Multimedia Data Document Engineering, MDDE 2002, Prague, Czech Republic. https://doi.org/10.1007/3-540-36128-6_18