GDCluster: A General Decentralized Clustering Algorithm

Hoda Mashayekhi, Jafar Habibi, Tania Khalafbeigi, Spyros Voulgaris, Martinus Richardus van Steen

    Research output: Contribution to journalArticleAcademicpeer-review

    19 Citations (Scopus)
    72 Downloads (Pure)

    Abstract

    In many popular applications like peer-to-peer systems, large amounts of data are distributed among multiple sources. Analysis of this data and identifying clusters is challenging due to processing, storage, and transmission costs. In this paper, we propose GDCluster, a general fully decentralized clustering method, which is capable of clustering dynamic and distributed data sets. Nodes continuously cooperate through decentralized gossip-based communication to maintain summarized views of the data set. We customize GDCluster for execution of the partition-based and density-based clustering methods on the summarized views, and also offer enhancements to the basic algorithm. Coping with dynamic data is made possible by gradually adapting the clustering model. Our experimental evaluations show that GDCluster can discover the clusters efficiently with scalable transmission cost, and also expose its supremacy in comparison to the popular method LSP2P.
    Original languageUndefined
    Pages (from-to)1892-1905
    Number of pages14
    JournalIEEE transactions on knowledge and data engineering
    Volume27
    Issue number7
    DOIs
    Publication statusPublished - Jul 2015

    Keywords

    • EWI-26879
    • Clustering
    • Distributed systems
    • IR-100081
    • partition-based clustering
    • density-based clustering
    • METIS-316851
    • dynamic system

    Cite this