A Probabilistic Ranking Framework using Unobservable Binary Events for Video Search

Robin Aly, Djoerd Hiemstra, A.P. de Vries, Franciska M.G. de Jong

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

14 Citations (Scopus)
11 Downloads (Pure)


Recent content-based video retrieval systems combine output of concept detectors (also known as high-level features) with text obtained through automatic speech recognition. This paper concerns the problem of search using the noisy concept detector output only. Unlike term occurrence in text documents, the event of the occurrence of an audiovisual concept is only indirectly observable. We develop a probabilistic ranking framework for unobservable binary events to search in videos, called PR-FUBE. The framework explicitly models the probability of relevance of a video shot through the presence and absence of concepts. From our framework, we derive a ranking formula and show its relationship to previously proposed formulas. We evaluate our framework against two other retrieval approaches using the TRECVID 2005 and 2007 datasets. Especially using large numbers of concepts in retrieval results in good performance. We attribute the observed robustness against the noise introduced by less related concepts to the effective combination of concept presence and absence in our method. The experiments show that an accurate estimate for the probability of occurrence of a particular concept in relevant shots is crucial to obtain effective retrieval results.
Original languageUndefined
Title of host publicationProceedings of the 7th ACM International Conference on Content-based Image and Video Retrieval
Place of PublicationNew York, NY, USA
PublisherAssociation for Computing Machinery
Number of pages10
ISBN (Print)978-1-60558-070-8
Publication statusPublished - Jul 2008
Event7th ACM International Conference on Content-based Image and Video Retrieval, CIVR 2008 - Niagara Falls, Ontario, Canada
Duration: 7 Jul 20089 Jul 2008

Publication series



Conference7th ACM International Conference on Content-based Image and Video Retrieval, CIVR 2008
Other7-9 July 2008


  • EWI-12167
  • IR-62230
  • METIS-250925

Cite this