Experiences with IR Top N Optimization in a Main Memory DBMS: Applying 'The Database Approach' in New Domains

B. Read (Editor), H.E. Blok, A.P. de Vries, Henk Blanken, Peter M.G. Apers

Research output: Contribution to conferencePaperAcademicpeer-review

2 Citations (Scopus)

Abstract

Data abstraction and query processing techniques are usually studied in the domain of administrative applications. We present a case-study in the non-standard domain of (multimedia) information retrieval, mainly intended as a feasibility study in favor of the `database approach' to data management. Top-N queries form a natural query class when dealing with content retrieval. In the IR field, a lot of research has been done on processing top-N queries efficiently. Unfortunately, these results cannot directly be ported to the database environment, because their tuple-oriented nature would seriously limit the freedom of the query optimizer to select appropriate query plans. By horizontally fragmenting our database containing document statistics, we are able to combine some of the best of the IR and database optimization principles, providing good retrieval quality as well as database `goodies' like flexibility, scalability, efficiency, and generality. Key issues we address in this paper concern the effects of our fragmentation approach on speed and quality of the answers, opportunities for scalability, supported by experimental results.
Original languageUndefined
Pages126-151
Number of pages26
Publication statusPublished - Jul 2001
Event18th British National Conference on Databases, BNCOD 2001: Advances in Databases - Chilton, United Kingdom
Duration: 9 Jul 200111 Jul 2001
Conference number: 18

Conference

Conference18th British National Conference on Databases, BNCOD 2001
Abbreviated titleBNCOD 2001
CountryUnited Kingdom
CityChilton
Period9/07/0111/07/01

Keywords

  • IR-63489
  • EWI-7168
  • DB-IR: INFORMATION RETRIEVAL

Cite this