Clustering articles based on semantic similarity

Shenghui Wang*, Rob Koopman

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

62 Citations (Scopus)

Abstract

Document clustering is generally the first step for topic identification. Since many clustering methods operate on the similarities between documents, it is important to build representations of these documents which keep their semantics as much as possible and are also suitable for efficient similarity calculation. As we describe in Koopman et al. (Proceedings of ISSI 2015 Istanbul: 15th International Society of Scientometrics and Informetrics Conference, Istanbul, Turkey, 29 June to 3 July, 2015. Bogaziçi University Printhouse. http://www.issi2015.org/files/downloads/all-papers/1042.pdf, 2015), the metadata of articles in the Astro dataset contribute to a semantic matrix, which uses a vector space to capture the semantics of entities derived from these articles and consequently supports the contextual exploration of these entities in LittleAriadne. However, this semantic matrix does not allow to calculate similarities between articles directly. In this paper, we will describe in detail how we build a semantic representation for an article from the entities that are associated with it. Base on such semantic representations of articles, we apply two standard clustering methods, K-Means and the Louvain community detection algorithm, which leads to our two clustering solutions labelled as OCLC-31 (standing for K-Means) and OCLC-Louvain (standing for Louvain). In this paper, we will give the implementation details and a basic comparison with other clustering solutions that are reported in this special issue.

Original languageEnglish
Pages (from-to)1017-1031
Number of pages15
JournalScientometrics
Volume111
Issue number2
DOIs
Publication statusPublished - 1 May 2017
Externally publishedYes

Keywords

  • Clustering
  • K-Means
  • Louvain community detection
  • Semantic indexing
  • Visualisation

Fingerprint

Dive into the research topics of 'Clustering articles based on semantic similarity'. Together they form a unique fingerprint.

Cite this