A generic open world named entity disambiguation approach for tweets

Mena Badieh Habib, Maurice van Keulen

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

10 Citations (Scopus)
264 Downloads (Pure)

Abstract

Social media is a rich source of information. To make use of this information, it is sometimes required to extract and disambiguate named entities. In this paper we focus on named entity disambiguation (NED) in twitter messages. NED in tweets is challenging in two ways. First, the limited length of Tweet makes it hard to have enough context while many disambiguation techniques depend on it. The second is that many named entities in tweets do not exist in a knowledge base (KB). In this paper we share ideas from information retrieval (IR) and NED to propose solutions for both challenges. For the first problem we make use of the gregarious nature of tweets to get enough context needed for disambiguation. For the second problem we look for an alternative home page if there is no Wikipedia page represents the entity. Given a mention, we obtain a list of Wikipedia candidates from YAGO KB in addition to top ranked pages from Google search engine. We use Support Vector Machine (SVM) to rank the candidate pages to find the best representative entities. Experiments conducted on two data sets show better disambiguation results compared with the baselines and a competitor.
Original languageUndefined
Title of host publicationProceedings of the 5th International Conference on Knowledge Discovery and Information Retrieval, KDIR 2013
Place of PublicationPortugal
PublisherSCITEPRESS
Pages-
Number of pages10
ISBN (Print)not assigned
DOIs
Publication statusPublished - Sept 2013
Event5th International Conference on Knowledge Discovery and Information Retrieval, KDIR 2013 - Vilamoura, Portugal
Duration: 19 Sept 201322 Sept 2013

Publication series

Name
PublisherSciTePress

Conference

Conference5th International Conference on Knowledge Discovery and Information Retrieval, KDIR 2013
Period19/09/1322/09/13
Other19-22 September 2013

Keywords

  • EWI-23365
  • Named Entity RecognitionNamed Entity LinkingNamed Entity ExtractionNamed Entity DisambiguationSocial MediaTwitterTweetsMicroblogs
  • Social Media
  • IR-86471
  • Twitter
  • METIS-297649
  • Named Entity Disambiguation

Cite this