The Simplest Evaluation Measures for XML Information Retrieval that Could Possibly Work

Djoerd Hiemstra, Vojkan Mihajlovic

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

155 Downloads (Pure)

Abstract

This paper reviews several evaluation measures developed for evaluating XML information retrieval (IR) systems. We argue that these measures, some of which are currently in use by the INitiative for the Evaluation of XML Retrieval (INEX), are complicated, hard to understand, and hard to explain to users of XML IR systems. To show the value of keeping things simple, we report alternative evaluation results of official evaluation runs submitted to INEX 2004 using simple metrics, and show its value for INEX.
Original languageEnglish
Title of host publicationProceedings of the INEX 2005 Workshop on Element Retrieval Methodology
Subtitle of host publicationHeld at the University of Glasgow, 30 July 2005
EditorsAndrew Trotman, Mounia Lalmas, Norbert Fuhr
Place of PublicationOtago, New Zealand
PublisherUniversity of Otaga
Pages6-13
Number of pages8
ISBN (Print)0-473-10228-5
Publication statusPublished - 30 Jul 2005
Event4th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2005 - University of Glasgow, Glasgow, Scotland, United Kingdom
Duration: 30 Jul 200530 Jul 2005

Workshop

Workshop4th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2005
Abbreviated titleINEX
Country/TerritoryUnited Kingdom
CityGlasgow, Scotland
Period30/07/0530/07/05

Keywords

  • IR-66444
  • DB-XMLIR: XML INFORMATION RETRIEVAL
  • EWI-7257
  • METIS-225877

Cite this