Abstract
Query performance prediction aims to predict whether a query will have a high average precision given retrieval from a particular collection, or low average precision. An accurate estimator of the quality of search engine results can allow the search engine to decide to which queries to apply query expansion, for which queries to suggest alternative search terms, to adjust the sponsored results, or to return results from specialized collections. In this paper we present an evaluation of state of the art query prediction algorithms, both post-retrieval and pre-retrieval and we analyze their sensitivity towards the retrieval algorithm. We evaluate query difficulty predictors over three widely different collections and query sets and present an analysis of why prediction algorithms perform significantly worse on Web data. Finally we introduce Improved Clarity, and demonstrate that it outperforms state-of-the-art predictors on three standard collections, including two large Web collections.
Original language | Undefined |
---|---|
Title of host publication | CIKM '08: Proceeding of the 17th ACM conference on Information and knowledge mining |
Place of Publication | New York, NY, USA |
Publisher | Association for Computing Machinery |
Pages | 439-448 |
Number of pages | 10 |
ISBN (Print) | 978-1-59593-991-3 |
DOIs | |
Publication status | Published - 2008 |
Event | 17th ACM Conference on Information and Knowledge Management, CIKM 2008 - Napa Valley, United States Duration: 26 Oct 2008 → 30 Oct 2008 Conference number: 17 |
Publication series
Name | |
---|---|
Publisher | ACM |
Number | 08332 |
Conference
Conference | 17th ACM Conference on Information and Knowledge Management, CIKM 2008 |
---|---|
Abbreviated title | CIKM |
Country/Territory | United States |
City | Napa Valley |
Period | 26/10/08 → 30/10/08 |
Keywords
- IR-62541
- METIS-252112
- EWI-14111
- HMI-IE: Information Engineering
- CR-H.3