Abstract
| Original language | Undefined |
|---|---|
| Place of Publication | Enschede |
| Publisher | Centre for Telematics and Information Technology (CTIT) |
| Number of pages | 10 |
| Publication status | Published - 8 Mar 2012 |
Publication series
| Name | CTIT Technical Report Series |
|---|---|
| Publisher | University of Twente, Centre for Telematics and Information Technology |
| No. | TR-CTIT-12-08 |
| ISSN (Print) | 1381-3625 |
Keywords
- DB-DM: DATA MINING
- EWI-21640
- IR-79917
- DB-IR: INFORMATION RETRIEVAL
- Scraper
- Wrapper
- Web extraction
- Search result extraction
- METIS-285252
Cite this
}
Ranking XPaths for extracting search result records. / Trieschnigg, Rudolf Berend; Tjin-Kam-Jet, Kien; Hiemstra, Djoerd.
Enschede : Centre for Telematics and Information Technology (CTIT), 2012. 10 p. (CTIT Technical Report Series; No. TR-CTIT-12-08).Research output: Book/Report › Report › Professional
TY - BOOK
T1 - Ranking XPaths for extracting search result records
AU - Trieschnigg, Rudolf Berend
AU - Tjin-Kam-Jet, Kien
AU - Hiemstra, Djoerd
PY - 2012/3/8
Y1 - 2012/3/8
N2 - Extracting search result records (SRRs) from webpages is useful for building an aggregated search engine which combines search results from a variety of search engines. Most automatic approaches to search result extraction are not portable: the complete process has to be rerun on a new search result page. In this paper we describe an algorithm to automatically determine XPath expressions to extract SRRs from webpages. Based on a single search result page, an XPath expression is determined which can be reused to extract SRRs from pages based on the same template. The algorithm is evaluated on a six datasets, including two new datasets containing a variety of web, image, video, shopping and news search results. The evaluation shows that for 85% of the tested search result pages, a useful XPath is determined. The algorithm is implemented as a browser plugin and as a standalone application which are available as open source software.
AB - Extracting search result records (SRRs) from webpages is useful for building an aggregated search engine which combines search results from a variety of search engines. Most automatic approaches to search result extraction are not portable: the complete process has to be rerun on a new search result page. In this paper we describe an algorithm to automatically determine XPath expressions to extract SRRs from webpages. Based on a single search result page, an XPath expression is determined which can be reused to extract SRRs from pages based on the same template. The algorithm is evaluated on a six datasets, including two new datasets containing a variety of web, image, video, shopping and news search results. The evaluation shows that for 85% of the tested search result pages, a useful XPath is determined. The algorithm is implemented as a browser plugin and as a standalone application which are available as open source software.
KW - DB-DM: DATA MINING
KW - EWI-21640
KW - IR-79917
KW - DB-IR: INFORMATION RETRIEVAL
KW - Scraper
KW - Wrapper
KW - Web extraction
KW - Search result extraction
KW - METIS-285252
M3 - Report
T3 - CTIT Technical Report Series
BT - Ranking XPaths for extracting search result records
PB - Centre for Telematics and Information Technology (CTIT)
CY - Enschede
ER -