Fitting realistic data centre workloads a data science approach

Björn F. Postema; Niels J. Geuze; Boudewijn R. Haverkort

doi:10.1145/3208903.3213520

Fitting realistic data centre workloads a data science approach

Björn F. Postema, Niels J. Geuze, Boudewijn R. Haverkort

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

2 Citations (Scopus)

7 Downloads (Pure)

Abstract

Data centres are playing a pivotal role in all cloud-based services (e-commerce, social networks, financial services, e-government, etc.). The performance of data centres is crucial for the acceptance of all these services by end-users. It is important to carefully design data centres with both performance and energy considerations in mind, as data centres are also known to use large amounts of electrical energy. For that purpose we have developed a modular simulation model (based on Anylogic) that can be used to study performance-energy trade-offs in data centre design. Key to such studies is the availability of a workload model. In this paper we present a workload characterisation model and algorithm using modern-day data science techniques, building on top of Jupyter Notebook and the ProFiDo platform. We present the method and show its versatility on a case study with real-world traces of 20 million entries, provided by the Dutch company better.be.

Original language	English
Title of host publication	e-Energy 2018 - Proceedings of the 9th ACM International Conference on Future Energy Systems
Publisher	Association for Computing Machinery
Pages	486-491
Number of pages	6
ISBN (Electronic)	9781450357678
DOIs	https://doi.org/10.1145/3208903.3213520
Publication status	Published - 12 Jun 2018
Event	9th ACM International Conference on Future Energy Systems 2018 - Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany Duration: 12 Jun 2018 → 15 Jun 2018 Conference number: 9 https://conferences.sigcomm.org/eenergy/2018/

Conference

Conference	9th ACM International Conference on Future Energy Systems 2018
Abbreviated title	ACM e-Energy 2018
Country/Territory	Germany
City	Karlsruhe
Period	12/06/18 → 15/06/18
Internet address	https://conferences.sigcomm.org/eenergy/2018/

Keywords

Data centre
Data science
Distribution fitting
Mixture normal distribution
Workload modelling

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1145/3208903.3213520

Cite this

@inproceedings{50a169c542ec4dfaa43e8e4b2a8ee6ab,

title = "Fitting realistic data centre workloads a data science approach",

abstract = "Data centres are playing a pivotal role in all cloud-based services (e-commerce, social networks, financial services, e-government, etc.). The performance of data centres is crucial for the acceptance of all these services by end-users. It is important to carefully design data centres with both performance and energy considerations in mind, as data centres are also known to use large amounts of electrical energy. For that purpose we have developed a modular simulation model (based on Anylogic) that can be used to study performance-energy trade-offs in data centre design. Key to such studies is the availability of a workload model. In this paper we present a workload characterisation model and algorithm using modern-day data science techniques, building on top of Jupyter Notebook and the ProFiDo platform. We present the method and show its versatility on a case study with real-world traces of 20 million entries, provided by the Dutch company better.be.",

keywords = "Data centre, Data science, Distribution fitting, Mixture normal distribution, Workload modelling",

author = "Postema, {Bj{\"o}rn F.} and Geuze, {Niels J.} and Haverkort, {Boudewijn R.}",

note = "Funding Information: The work in this paper has been supported by the Dutch national NWO project Cooperative Networked Systems (CNS), as part of the program “Robust Design of Cyber-Physical Systems” (CPS), including the industrial partners Target Holding B.V. and Better.be. Publisher Copyright: {\textcopyright} 2018 Copyright held by the owner/author(s).; 9th ACM International Conference on Future Energy Systems 2018, ACM e-Energy 2018 ; Conference date: 12-06-2018 Through 15-06-2018",

year = "2018",

month = jun,

day = "12",

doi = "10.1145/3208903.3213520",

language = "English",

pages = "486--491",

booktitle = "e-Energy 2018 - Proceedings of the 9th ACM International Conference on Future Energy Systems",

publisher = "Association for Computing Machinery",

address = "United States",

url = "https://conferences.sigcomm.org/eenergy/2018/",

}

Postema, BF, Geuze, NJ & Haverkort, BR 2018, Fitting realistic data centre workloads a data science approach. in e-Energy 2018 - Proceedings of the 9th ACM International Conference on Future Energy Systems. Association for Computing Machinery, pp. 486-491, 9th ACM International Conference on Future Energy Systems 2018, Karlsruhe, Germany, 12/06/18. https://doi.org/10.1145/3208903.3213520

Fitting realistic data centre workloads a data science approach. / Postema, Björn F.; Geuze, Niels J.; Haverkort, Boudewijn R.
e-Energy 2018 - Proceedings of the 9th ACM International Conference on Future Energy Systems. Association for Computing Machinery, 2018. p. 486-491.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Fitting realistic data centre workloads a data science approach

AU - Postema, Björn F.

AU - Geuze, Niels J.

AU - Haverkort, Boudewijn R.

N1 - Conference code: 9

PY - 2018/6/12

Y1 - 2018/6/12

N2 - Data centres are playing a pivotal role in all cloud-based services (e-commerce, social networks, financial services, e-government, etc.). The performance of data centres is crucial for the acceptance of all these services by end-users. It is important to carefully design data centres with both performance and energy considerations in mind, as data centres are also known to use large amounts of electrical energy. For that purpose we have developed a modular simulation model (based on Anylogic) that can be used to study performance-energy trade-offs in data centre design. Key to such studies is the availability of a workload model. In this paper we present a workload characterisation model and algorithm using modern-day data science techniques, building on top of Jupyter Notebook and the ProFiDo platform. We present the method and show its versatility on a case study with real-world traces of 20 million entries, provided by the Dutch company better.be.

AB - Data centres are playing a pivotal role in all cloud-based services (e-commerce, social networks, financial services, e-government, etc.). The performance of data centres is crucial for the acceptance of all these services by end-users. It is important to carefully design data centres with both performance and energy considerations in mind, as data centres are also known to use large amounts of electrical energy. For that purpose we have developed a modular simulation model (based on Anylogic) that can be used to study performance-energy trade-offs in data centre design. Key to such studies is the availability of a workload model. In this paper we present a workload characterisation model and algorithm using modern-day data science techniques, building on top of Jupyter Notebook and the ProFiDo platform. We present the method and show its versatility on a case study with real-world traces of 20 million entries, provided by the Dutch company better.be.

KW - Data centre

KW - Data science

KW - Distribution fitting

KW - Mixture normal distribution

KW - Workload modelling

UR - http://www.scopus.com/inward/record.url?scp=85050194379&partnerID=8YFLogxK

U2 - 10.1145/3208903.3213520

DO - 10.1145/3208903.3213520

M3 - Conference contribution

AN - SCOPUS:85050194379

SP - 486

EP - 491

BT - e-Energy 2018 - Proceedings of the 9th ACM International Conference on Future Energy Systems

PB - Association for Computing Machinery

T2 - 9th ACM International Conference on Future Energy Systems 2018

Y2 - 12 June 2018 through 15 June 2018

ER -

Fitting realistic data centre workloads a data science approach

Abstract

Conference

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this