The Network Data Handling War: MySQL vs. NfDump

Rick Hofstede; R.J. Hofstede; Anna Sperotto; Tiago Fioreze; Aiko Pras

doi:10.1007/978-3-642-13971-0_16

The Network Data Handling War: MySQL vs. NfDump

Rick Hofstede, R.J. Hofstede, Anna Sperotto, Tiago Fioreze, Aiko Pras

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

12 Citations (Scopus)

22 Downloads (Pure)

Abstract

Network monitoring plays a crucial role in any network management environment. Especially nowadays, with network speed and load constantly increasing, more and more data needs to be collected and efficiently processed. In highly interactive network monitoring systems, a quick response time from information sources turns out to be a crucial requirement. However, for data sets in the order of several GBs, this goal becomes difficult to achieve. In this paper, we present our operational experience in dealing with large amounts of network data. In particular, we focus on MySQL and NfDump, testing their capabilities under different usage scenarios and increasing data set sizes.

Original language	Undefined
Title of host publication	16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management
Place of Publication	Berlin
Publisher	Springer
Pages	167-176
Number of pages	10
ISBN (Print)	978-3-642-13970-3
DOIs	https://doi.org/10.1007/978-3-642-13971-0_16
Publication status	Published - Jun 2010
Event	16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management - Trondheim, Norway Duration: 28 Jun 2010 → 30 Jun 2010 Conference number: 16th

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer Verlag
Volume	6164
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Workshop

Workshop	16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management
Abbreviated title	EUNICE 2010
Country	Norway
City	Trondheim
Period	28/06/10 → 30/06/10

Keywords

METIS-270870
EWI-18060
IR-72162

Access to Document

10.1007/978-3-642-13971-0_16

fulltext-1
open

Cite this

Hofstede, R., Hofstede, R. J., Sperotto, A., Fioreze, T., & Pras, A. (2010). The Network Data Handling War: MySQL vs. NfDump. In 16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management (pp. 167-176). [10.1007/978-3-642-13971-0_16] (Lecture Notes in Computer Science; Vol. 6164). Springer. https://doi.org/10.1007/978-3-642-13971-0_16

@inproceedings{0e6e9221351341c6bbacb61745ada423,

title = "The Network Data Handling War: MySQL vs. NfDump",

abstract = "Network monitoring plays a crucial role in any network management environment. Especially nowadays, with network speed and load constantly increasing, more and more data needs to be collected and efficiently processed. In highly interactive network monitoring systems, a quick response time from information sources turns out to be a crucial requirement. However, for data sets in the order of several GBs, this goal becomes difficult to achieve. In this paper, we present our operational experience in dealing with large amounts of network data. In particular, we focus on MySQL and NfDump, testing their capabilities under different usage scenarios and increasing data set sizes.",

keywords = "METIS-270870, EWI-18060, IR-72162",

author = "Rick Hofstede and R.J. Hofstede and Anna Sperotto and Tiago Fioreze and Aiko Pras",

note = "10.1007/978-3-642-13971-0_16 ; null ; Conference date: 28-06-2010 Through 30-06-2010",

year = "2010",

month = jun,

doi = "10.1007/978-3-642-13971-0_16",

language = "Undefined",

isbn = "978-3-642-13970-3",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "167--176",

booktitle = "16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management",

address = "Netherlands",

}

Hofstede, R, Hofstede, RJ, Sperotto, A, Fioreze, T & Pras, A 2010, The Network Data Handling War: MySQL vs. NfDump. in 16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management., 10.1007/978-3-642-13971-0_16, Lecture Notes in Computer Science, vol. 6164, Springer, Berlin, pp. 167-176, 16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management, Trondheim, Norway, 28/06/10. https://doi.org/10.1007/978-3-642-13971-0_16

The Network Data Handling War: MySQL vs. NfDump. / Hofstede, Rick; Hofstede, R.J.; Sperotto, Anna; Fioreze, Tiago; Pras, Aiko.

16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management. Berlin : Springer, 2010. p. 167-176 10.1007/978-3-642-13971-0_16 (Lecture Notes in Computer Science; Vol. 6164).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - The Network Data Handling War: MySQL vs. NfDump

AU - Hofstede, Rick

AU - Hofstede, R.J.

AU - Sperotto, Anna

AU - Fioreze, Tiago

AU - Pras, Aiko

N1 - Conference code: 16th

PY - 2010/6

Y1 - 2010/6

N2 - Network monitoring plays a crucial role in any network management environment. Especially nowadays, with network speed and load constantly increasing, more and more data needs to be collected and efficiently processed. In highly interactive network monitoring systems, a quick response time from information sources turns out to be a crucial requirement. However, for data sets in the order of several GBs, this goal becomes difficult to achieve. In this paper, we present our operational experience in dealing with large amounts of network data. In particular, we focus on MySQL and NfDump, testing their capabilities under different usage scenarios and increasing data set sizes.

AB - Network monitoring plays a crucial role in any network management environment. Especially nowadays, with network speed and load constantly increasing, more and more data needs to be collected and efficiently processed. In highly interactive network monitoring systems, a quick response time from information sources turns out to be a crucial requirement. However, for data sets in the order of several GBs, this goal becomes difficult to achieve. In this paper, we present our operational experience in dealing with large amounts of network data. In particular, we focus on MySQL and NfDump, testing their capabilities under different usage scenarios and increasing data set sizes.

KW - METIS-270870

KW - EWI-18060

KW - IR-72162

U2 - 10.1007/978-3-642-13971-0_16

DO - 10.1007/978-3-642-13971-0_16

M3 - Conference contribution

SN - 978-3-642-13970-3

T3 - Lecture Notes in Computer Science

SP - 167

EP - 176

BT - 16th EUNICE/IFIP WG 6.6 Workshop on Networked Services and Applications - Engineering, Control and Management

PB - Springer

CY - Berlin

Y2 - 28 June 2010 through 30 June 2010

ER -