Study concept drift in 150-year english literature

Ruiyuan Li, Pin Tian, Shenghui Wang

Research output: Contribution to journalConference articleAcademicpeer-review

5 Downloads (Pure)

Abstract

The meaning of a concept or a word changes over time. Such concept drift reects the change of the social consensus as well. Studying concept drift over time is valuable for researchers who are interested in language or culture evolution. Recent word embedding technologies inspire us to automatically detect concept drift in large-scale corpora. However, comparing embeddings generated from different corpora is a complex task. In this paper, we propose to use a simple approach for detecting concept drift based on the change in word contexts from different time periods and apply it to subsequent time periods so that the detailed drift could be detected and visualised. We dive into certain words to track how the meaning of a word changes gradually over a long time span with relevant historical events which demonstrates the effect of our method.

Original languageEnglish
Pages (from-to)153-163
Number of pages11
JournalCEUR workshop proceedings
Volume2871
Publication statusPublished - 2021
Event1st Workshop on AI + Informetrics, AII 2021 - Virtual, Online
Duration: 17 Mar 2021 → …

Keywords

  • Concept drifting
  • Historical event
  • Word context
  • Word embedding

Cite this