PolderCast: Fast, robust, and scalable architecture for P2P topic-based Pub/Sub

Vinay Setty*, Maarten van Steen, Roman Vitenberg, Spyros Voulgaris

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

45 Citations (Scopus)

Abstract

We propose PolderCast, a P2P topic-based Pub/Sub system that is (a) fault-tolerant and robust, (b) scalable w.r.t the number of nodes interested in a topic and number of topics that nodes are interested in, and (c) fast in terms of dissemination latency while (d) attaining a low communication overhead. This combination of properties is provided by an implementation that blends deterministic propagation over maintained rings with probabilistic dissemination following a limited number of random shortcuts. The rings are constructed and maintained using gossiping techniques. The random shortcuts are provided by two distinct peer-sampling services: Cyclon generates purely random links while Vicinity produces interest-induced random links. We analyze PolderCast and survey it in the context of existing approaches. We evaluate PolderCast experimentally using real-world workloads from Twitter and Facebook traces. We use widely renowned Scribe [5] as a baseline in a number of experiments. Robustness with respect to node churn is evaluated through traces from the Skype super-peer network. We show that the experimental results corroborate all of the above properties in settings of up to 10K nodes, 10K topics, and 5K topics per-node.

Original languageEnglish
Title of host publicationMiddleware 2012
Subtitle of host publicationACM/IFIP/USENIX 13th International Middleware Conference, Montreal, QC, Canada, December 3-7, 2012. Proceedings
EditorsPriya Narasimhan, Peter Triantafillou
Place of PublicationBerlin, Heidelberg
PublisherSpringer
Pages271-291
Number of pages21
ISBN (Electronic)978-3-642-35170-9
ISBN (Print)978-3-642-35169-3
DOIs
Publication statusPublished - 28 Nov 2012
Externally publishedYes
Event13th ACM/IFIP/USENIX International Middleware Conference, Middleware 2012 - Montreal, Canada
Duration: 3 Dec 20127 Dec 2012

Publication series

NameLecture Notes in Computer Science
PublisherSpringer
Volume7662
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference13th ACM/IFIP/USENIX International Middleware Conference, Middleware 2012
CountryCanada
CityMontreal
Period3/12/127/12/12

Keywords

  • Gossiping
  • Peer-to-Peer
  • Publish/Subscribe

Fingerprint

Dive into the research topics of 'PolderCast: Fast, robust, and scalable architecture for P2P topic-based Pub/Sub'. Together they form a unique fingerprint.

Cite this