Traitor: associating concepts using the world wide web

Wanno Drijfhout; Oliver Jundt; Lesley Wevers; Djoerd Hiemstra

Traitor: associating concepts using the world wide web

Wanno Drijfhout
, Oliver Jundt
, Lesley Wevers
, Djoerd Hiemstra

Databases (Former)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

107 Downloads (Pure)

Abstract

We use Common Crawl's 25TB data set of web pages to construct a database of associated concepts using Hadoop. The database can be queried through a web application with two query interfaces. A textual interface allows searching for similarities and differences between multiple concepts using a query language similar to set notation, and a graphical interface allows users to visualize similarity relationships of concepts in a force directed graph.

Original language	English
Title of host publication	Proceedings of the 13th Dutch-Belgian Workshop on Information Retrieval, DIR 2013
Subtitle of host publication	Delft, The Netherlands, April 26th, 2013
Editors	Carsten Eickhoff, Arjen P. de Vries
Place of Publication	Aachen, Germany
Publisher	CEUR
Pages	56-57
Number of pages	2
Publication status	Published - Apr 2013
Event	13th Dutch-Belgian Information Retrieval Workshop, DIR 2013 - Delft, Netherlands Duration: 26 Apr 2013 → 26 Apr 2013 Conference number: 13

Publication series

Name	CEUR Workshop Proceedings
Publisher	CEUR
Volume	986
ISSN (Print)	1613-0073

Workshop

Workshop	13th Dutch-Belgian Information Retrieval Workshop, DIR 2013
Abbreviated title	DIR
Country/Territory	Netherlands
City	Delft
Period	26/04/13 → 26/04/13

Keywords

CR-H.3.1
CR-H.3.3
Question answering
MapReduce
Information extraction

Access to Document

ArticleFinal published version, 175 KB

http://ceur-ws.org/Vol-986/

Cite this

@inproceedings{c3c92b1ccde44879b14e6b7f3ae15155,

title = "Traitor: associating concepts using the world wide web",

abstract = "We use Common Crawl's 25TB data set of web pages to construct a database of associated concepts using Hadoop. The database can be queried through a web application with two query interfaces. A textual interface allows searching for similarities and differences between multiple concepts using a query language similar to set notation, and a graphical interface allows users to visualize similarity relationships of concepts in a force directed graph.",

keywords = "CR-H.3.1, CR-H.3.3, Question answering, MapReduce, Information extraction",

author = "Wanno Drijfhout and Oliver Jundt and Lesley Wevers and Djoerd Hiemstra",

year = "2013",

month = apr,

language = "English",

series = "CEUR Workshop Proceedings",

publisher = "CEUR",

pages = "56--57",

editor = "Carsten Eickhoff and Vries, \{Arjen P. de\}",

booktitle = "Proceedings of the 13th Dutch-Belgian Workshop on Information Retrieval, DIR 2013",

address = "Germany",

note = "13th Dutch-Belgian Information Retrieval Workshop, DIR 2013, DIR ; Conference date: 26-04-2013 Through 26-04-2013",

}

Drijfhout, W, Jundt, O, Wevers, L & Hiemstra, D 2013, Traitor: associating concepts using the world wide web. in C Eickhoff & APD Vries (eds), Proceedings of the 13th Dutch-Belgian Workshop on Information Retrieval, DIR 2013: Delft, The Netherlands, April 26th, 2013. CEUR Workshop Proceedings, vol. 986, CEUR, Aachen, Germany, pp. 56-57, 13th Dutch-Belgian Information Retrieval Workshop, DIR 2013, Delft, Netherlands, 26/04/13. <http://ceur-ws.org/Vol-986/>

Traitor: associating concepts using the world wide web. / Drijfhout, Wanno; Jundt, Oliver; Wevers, Lesley et al.
Proceedings of the 13th Dutch-Belgian Workshop on Information Retrieval, DIR 2013: Delft, The Netherlands, April 26th, 2013. ed. / Carsten Eickhoff; Arjen P. de Vries. Aachen, Germany: CEUR, 2013. p. 56-57 (CEUR Workshop Proceedings; Vol. 986).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Traitor: associating concepts using the world wide web

AU - Drijfhout, Wanno

AU - Jundt, Oliver

AU - Wevers, Lesley

AU - Hiemstra, Djoerd

N1 - Conference code: 13

PY - 2013/4

Y1 - 2013/4

N2 - We use Common Crawl's 25TB data set of web pages to construct a database of associated concepts using Hadoop. The database can be queried through a web application with two query interfaces. A textual interface allows searching for similarities and differences between multiple concepts using a query language similar to set notation, and a graphical interface allows users to visualize similarity relationships of concepts in a force directed graph.

AB - We use Common Crawl's 25TB data set of web pages to construct a database of associated concepts using Hadoop. The database can be queried through a web application with two query interfaces. A textual interface allows searching for similarities and differences between multiple concepts using a query language similar to set notation, and a graphical interface allows users to visualize similarity relationships of concepts in a force directed graph.

KW - CR-H.3.1

KW - CR-H.3.3

KW - Question answering

KW - MapReduce

KW - Information extraction

M3 - Conference contribution

T3 - CEUR Workshop Proceedings

SP - 56

EP - 57

BT - Proceedings of the 13th Dutch-Belgian Workshop on Information Retrieval, DIR 2013

A2 - Eickhoff, Carsten

A2 - Vries, Arjen P. de

PB - CEUR

CY - Aachen, Germany

T2 - 13th Dutch-Belgian Information Retrieval Workshop, DIR 2013

Y2 - 26 April 2013 through 26 April 2013

ER -

Traitor: associating concepts using the world wide web

Abstract

Publication series

Workshop

Keywords

Access to Document

Fingerprint

Cite this