A Selectivity Model for Fragmented Relations: Applied in Information Retrieval

H.E. Blok, R.S. Choenni, Henk Blanken, Peter M.G. Apers

Research output: Contribution to journalArticleAcademicpeer-review

1 Citation (Scopus)
81 Downloads (Pure)

Abstract

New application domains cause today's database sizes to grow rapidly, posing great demands on technology. Data fragmentation facilitates techniques (like distribution, parallelization, and main-memory computing) meeting these demands. Also, fragmentation might help to improve efficient processing of query types such as top {\rm{N}}. Database design and query optimization require a good notion of the costs resulting from a certain fragmentation. Our mathematically derived selectivity model facilitates this. Once its two parameters have been computed based on the fragmentation, after each (though usually infrequent) update, our model can forget the data distribution, resulting in fast and quite good selectivity estimation. We show experimental verification for Zipfian distributed IR databases.
Original languageUndefined
Pages (from-to)635-639
Number of pages5
JournalIEEE transactions on knowledge and data engineering
Volume16
Issue number5
DOIs
Publication statusPublished - May 2004

Keywords

  • METIS-221591
  • EWI-6257
  • IR-49347

Cite this