Database Optimization Aspects for Information Retrieval

H.E. Blok

Research output: ThesisPhD Thesis - Research UT, graduation UT

184 Downloads (Pure)

Abstract

There is a growing need for systems that can process queries, combining both structured data and text. One way to provide such functionality is to integrate information retrieval (IR) techniques in a database management system (DBMS). However, both IR and database research have been separate research fields for decades, resulting in different - even conflicting - approaches to data management. Each DBMS has a component called a "query optimizer", which plays a crucial role in the efficiency and flexibility of the system. So, for successful integration the IR techniques and data structures, as well as the DBMS query optimizer, should be adapted to enable mutual cooperation. The author concentrates on top-N queries - a common class of IR queries. An IR top-N query asks for the N best documents given a set of keywords. The author proposes processing the data in batches as a compromise between IR and DBMS query processing. Experiments with this technique show that porting IR optimization techniques is (still) not a promising option due to the additional administrative overhead. Two new mathematical models are introduced to eliminate this overhead: a model that predicts selectivity, which is a crucial factor in the execution costs, and a model that predicts the quality of the top-N.
Original languageUndefined
Supervisors/Advisors
  • Apers, Peter Maria Gerardus, Supervisor
  • Blanken, Henk, Advisor
Award date12 Apr 2002
Place of PublicationEnschede, The Netherlands
Publisher
Print ISBNs903651732X
Publication statusPublished - 12 Apr 2002

Keywords

  • EWI-6341
  • IR-66250
  • METIS-207567
  • DB-IR: INFORMATION RETRIEVAL

Cite this