Language-based multimedia information retrieval

Franciska de Jong, Jean-Luc Gauvain, Djoerd Hiemstra, Klaus Netter

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

54 Downloads (Pure)


This paper describes various methods and approaches for language-based multimedia information retrieval, which have been developed in the projects POP-EYE and OLIVE and which will be developed further in the MUMIS project. All of these project aim at supporting automated indexing of video material by use of human language technologies. Thus, in contrast to image or sound-based retrieval methods, where both the query language and the indexing methods build on non-linguistic data, these methods attempt to exploit advanced text retrieval technologies for the retrieval of non-textual material. While POP-EYE was building on subtitles or captions as the prime language key for disclosing video fragments, OLIVE is making use of speech recognition to automatically derive transcriptions of the sound tracks, generating time-coded linguistic elements which then serve as the basis for text-based retrieval functionality.
Original languageEnglish
Title of host publicationRIAO 2000
Subtitle of host publication6th International Conference on Computer-Assisted Information Retrieval, College de France, France, April 12-14, 2000
EditorsJoseph-Jean Mariani, Donna Harman
Place of PublicationParis
PublisherCentre de Hautes Etudes Internationales d'Informatique Documentaire (CID)
Number of pages10
ISBN (Print)2-905450-07-X
Publication statusPublished - 2000
Event6th International Conference on Computer-Assisted Information Retrieval, RIAO 2000: (Recherche d'Information et ses Applications) - Paris, France
Duration: 12 Apr 200014 Apr 2000
Conference number: 6


Conference6th International Conference on Computer-Assisted Information Retrieval, RIAO 2000
Abbreviated titleRIAO


  • EWI-9319
  • IR-66961
  • METIS-119715


Dive into the research topics of 'Language-based multimedia information retrieval'. Together they form a unique fingerprint.

Cite this