The hidden pub/sub of spotify (Industry Article)

Vinay Setty; Gunnar Kreitz; Roman Vitenberg; Maarten van Steen; Guido Urdaneta; Staffan Gimåker

doi:10.1145/2488222.2488273

The hidden pub/sub of spotify (Industry Article)

Vinay Setty, Gunnar Kreitz, Roman Vitenberg, Maarten van Steen, Guido Urdaneta, Staffan Gimåker

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

26 Citations (Scopus)

Abstract

Spotify is a peer-assisted music streaming service that has gained worldwide popularity. Apart from providing instant access to over 20 million music tracks, Spotify also enhances its users' music experience by providing various features for social interaction. These are realized by a system using the widely-adopted pub/sub paradigm. In this paper we provide an interesting case study of a hybrid pub/sub system designed for real-time as well as offline notifications for Spo-tify users. We firstly describe a multitude of use cases where pub/sub is applied. Secondly, we study the design of its pub/sub system used for matching, disseminating and persisting billions of publications every day. Finally, we study pub/sub traffic collected from the production system, derive characterizations of the pub/sub workload, and show some interesting findings and trends.

Original language	English
Title of host publication	DEBS 2013
Subtitle of host publication	Proceedings of the 7th ACM International Conference on Distributed Event-Based Systems
Place of Publication	New York, NY
Publisher	ACM Press
Pages	231-240
Number of pages	10
ISBN (Print)	978-1-4503-1758-0
DOIs	https://doi.org/10.1145/2488222.2488273
Publication status	Published - 12 Aug 2013
Externally published	Yes
Event	7th ACM International Conference on Distributed Event-Based Systems, DEBS 2013 - Arlington, United States Duration: 29 Jun 2013 → 3 Jul 2013 Conference number: 7

Conference

Conference	7th ACM International Conference on Distributed Event-Based Systems, DEBS 2013
Abbreviated title	DEBS 2013
Country/Territory	United States
City	Arlington
Period	29/06/13 → 3/07/13

Keywords

Event notifications
Pub/sub systems
Workload analysis

Access to Document

10.1145/2488222.2488273

Cite this

@inproceedings{0fe86fca2b0e4001a7e221b3d662c560,

title = "The hidden pub/sub of spotify (Industry Article)",

abstract = "Spotify is a peer-assisted music streaming service that has gained worldwide popularity. Apart from providing instant access to over 20 million music tracks, Spotify also enhances its users' music experience by providing various features for social interaction. These are realized by a system using the widely-adopted pub/sub paradigm. In this paper we provide an interesting case study of a hybrid pub/sub system designed for real-time as well as offline notifications for Spo-tify users. We firstly describe a multitude of use cases where pub/sub is applied. Secondly, we study the design of its pub/sub system used for matching, disseminating and persisting billions of publications every day. Finally, we study pub/sub traffic collected from the production system, derive characterizations of the pub/sub workload, and show some interesting findings and trends.",

keywords = "Event notifications, Pub/sub systems, Workload analysis",

author = "Vinay Setty and Gunnar Kreitz and Roman Vitenberg and {van Steen}, Maarten and Guido Urdaneta and Staffan Gim{\aa}ker",

year = "2013",

month = aug,

day = "12",

doi = "10.1145/2488222.2488273",

language = "English",

isbn = "978-1-4503-1758-0",

pages = "231--240",

booktitle = "DEBS 2013",

publisher = "ACM Press",

note = "7th ACM International Conference on Distributed Event-Based Systems, DEBS 2013, DEBS 2013 ; Conference date: 29-06-2013 Through 03-07-2013",

}

Setty, V, Kreitz, G, Vitenberg, R, van Steen, M, Urdaneta, G & Gimåker, S 2013, The hidden pub/sub of spotify (Industry Article). in DEBS 2013: Proceedings of the 7th ACM International Conference on Distributed Event-Based Systems. ACM Press, New York, NY, pp. 231-240, 7th ACM International Conference on Distributed Event-Based Systems, DEBS 2013, Arlington, Texas, United States, 29/06/13. https://doi.org/10.1145/2488222.2488273

TY - GEN

T1 - The hidden pub/sub of spotify (Industry Article)

AU - Setty, Vinay

AU - Kreitz, Gunnar

AU - Vitenberg, Roman

AU - van Steen, Maarten

AU - Urdaneta, Guido

AU - Gimåker, Staffan

N1 - Conference code: 7

PY - 2013/8/12

Y1 - 2013/8/12

N2 - Spotify is a peer-assisted music streaming service that has gained worldwide popularity. Apart from providing instant access to over 20 million music tracks, Spotify also enhances its users' music experience by providing various features for social interaction. These are realized by a system using the widely-adopted pub/sub paradigm. In this paper we provide an interesting case study of a hybrid pub/sub system designed for real-time as well as offline notifications for Spo-tify users. We firstly describe a multitude of use cases where pub/sub is applied. Secondly, we study the design of its pub/sub system used for matching, disseminating and persisting billions of publications every day. Finally, we study pub/sub traffic collected from the production system, derive characterizations of the pub/sub workload, and show some interesting findings and trends.

AB - Spotify is a peer-assisted music streaming service that has gained worldwide popularity. Apart from providing instant access to over 20 million music tracks, Spotify also enhances its users' music experience by providing various features for social interaction. These are realized by a system using the widely-adopted pub/sub paradigm. In this paper we provide an interesting case study of a hybrid pub/sub system designed for real-time as well as offline notifications for Spo-tify users. We firstly describe a multitude of use cases where pub/sub is applied. Secondly, we study the design of its pub/sub system used for matching, disseminating and persisting billions of publications every day. Finally, we study pub/sub traffic collected from the production system, derive characterizations of the pub/sub workload, and show some interesting findings and trends.

KW - Event notifications

KW - Pub/sub systems

KW - Workload analysis

UR - http://www.scopus.com/inward/record.url?scp=84881155523&partnerID=8YFLogxK

U2 - 10.1145/2488222.2488273

DO - 10.1145/2488222.2488273

M3 - Conference contribution

AN - SCOPUS:84881155523

SN - 978-1-4503-1758-0

SP - 231

EP - 240

BT - DEBS 2013

PB - ACM Press

CY - New York, NY

T2 - 7th ACM International Conference on Distributed Event-Based Systems, DEBS 2013

Y2 - 29 June 2013 through 3 July 2013

ER -

The hidden pub/sub of spotify (Industry Article)

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this