Quantitative Testing

H.C. Bohnenkamp; Mariëlle Ida Antoinette Stoelinga

doi:10.1145/1450058.1450089

Quantitative Testing

H.C. Bohnenkamp, Mariëlle Ida Antoinette Stoelinga

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

9 Citations (Scopus)

181 Downloads (Pure)

Abstract

We investigate the problem of specification based testing with dense sets of inputs and outputs, in particular with imprecision as they might occur due to errors in measurements, numerical instability or noisy channels. Using quantitative transition systems to describe implementations and specifications, we introduce implementation relations that capture a notion of correctness “up to ε��?, allowing deviations of implementation from the specification of at most ε. These quantitative implementation relations are described as Hausdorff distances between certain sets of traces. They are conservative extensions of the well-known ioco relation. We develop an on-line and an off-line algorithm to generate test cases from a requirement specification, modeled as a quantitative transition system. Both algorithms are shown to be sound and complete with respect to the quantitative implementation relations introduced.

Original language	Undefined
Title of host publication	Proceedings of the 7th ACM International conference on Embedded software
Editors	Luca de Alfaro, Jens Palsberg
Place of Publication	New York
Publisher	Association for Computing Machinery
Pages	227-236
Number of pages	10
ISBN (Print)	978-1-60558-468-3
DOIs	https://doi.org/10.1145/1450058.1450089
Publication status	Published - 2008
Event	8th ACM International Conference on Embedded Software, EMSOFT 2008 - Atlanta, United States Duration: 19 Oct 2008 → 24 Oct 2008 Conference number: 8

Publication series

Name
Publisher	ACM

Conference

Conference	8th ACM International Conference on Embedded Software, EMSOFT 2008
Abbreviated title	EMSOFT
Country/Territory	United States
City	Atlanta
Period	19/10/08 → 24/10/08

Keywords

EC Grant Agreement nr.: FP7/214755
EC Grant Agreement nr.: FP7-ICT-2007-1
IR-65420
EWI-15202
METIS-256469
EC Grant Agreement nr.: IST-004527

Access to Document

10.1145/1450058.1450089

Cite this

@inproceedings{305997e385b2483e9635900e3d049268,

title = "Quantitative Testing",

abstract = "We investigate the problem of specification based testing with dense sets of inputs and outputs, in particular with imprecision as they might occur due to errors in measurements, numerical instability or noisy channels. Using quantitative transition systems to describe implementations and specifications, we introduce implementation relations that capture a notion of correctness “up to ε��?, allowing deviations of implementation from the specification of at most ε. These quantitative implementation relations are described as Hausdorff distances between certain sets of traces. They are conservative extensions of the well-known ioco relation. We develop an on-line and an off-line algorithm to generate test cases from a requirement specification, modeled as a quantitative transition system. Both algorithms are shown to be sound and complete with respect to the quantitative implementation relations introduced.",

keywords = "EC Grant Agreement nr.: FP7/214755, EC Grant Agreement nr.: FP7-ICT-2007-1, IR-65420, EWI-15202, METIS-256469, EC Grant Agreement nr.: IST-004527",

author = "H.C. Bohnenkamp and Stoelinga, {Mari{\"e}lle Ida Antoinette}",

note = "eemcs-eprint-15202 ; 8th ACM International Conference on Embedded Software, EMSOFT 2008 ; Conference date: 19-10-2008 Through 24-10-2008",

year = "2008",

doi = "10.1145/1450058.1450089",

language = "Undefined",

isbn = "978-1-60558-468-3",

publisher = "Association for Computing Machinery",

pages = "227--236",

editor = "{de Alfaro}, Luca and Jens Palsberg",

booktitle = "Proceedings of the 7th ACM International conference on Embedded software",

address = "United States",

}

Bohnenkamp, HC & Stoelinga, MIA 2008, Quantitative Testing. in L de Alfaro & J Palsberg (eds), Proceedings of the 7th ACM International conference on Embedded software., 10.1145/1450058.1450089, Association for Computing Machinery, New York, pp. 227-236, 8th ACM International Conference on Embedded Software, EMSOFT 2008, Atlanta, Georgia, United States, 19/10/08. https://doi.org/10.1145/1450058.1450089

Quantitative Testing. / Bohnenkamp, H.C.; Stoelinga, Mariëlle Ida Antoinette.
Proceedings of the 7th ACM International conference on Embedded software. ed. / Luca de Alfaro; Jens Palsberg. New York: Association for Computing Machinery, 2008. p. 227-236 10.1145/1450058.1450089.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Quantitative Testing

AU - Bohnenkamp, H.C.

AU - Stoelinga, Mariëlle Ida Antoinette

N1 - Conference code: 8

PY - 2008

Y1 - 2008

N2 - We investigate the problem of specification based testing with dense sets of inputs and outputs, in particular with imprecision as they might occur due to errors in measurements, numerical instability or noisy channels. Using quantitative transition systems to describe implementations and specifications, we introduce implementation relations that capture a notion of correctness “up to ε��?, allowing deviations of implementation from the specification of at most ε. These quantitative implementation relations are described as Hausdorff distances between certain sets of traces. They are conservative extensions of the well-known ioco relation. We develop an on-line and an off-line algorithm to generate test cases from a requirement specification, modeled as a quantitative transition system. Both algorithms are shown to be sound and complete with respect to the quantitative implementation relations introduced.

AB - We investigate the problem of specification based testing with dense sets of inputs and outputs, in particular with imprecision as they might occur due to errors in measurements, numerical instability or noisy channels. Using quantitative transition systems to describe implementations and specifications, we introduce implementation relations that capture a notion of correctness “up to ε��?, allowing deviations of implementation from the specification of at most ε. These quantitative implementation relations are described as Hausdorff distances between certain sets of traces. They are conservative extensions of the well-known ioco relation. We develop an on-line and an off-line algorithm to generate test cases from a requirement specification, modeled as a quantitative transition system. Both algorithms are shown to be sound and complete with respect to the quantitative implementation relations introduced.

KW - EC Grant Agreement nr.: FP7/214755

KW - EC Grant Agreement nr.: FP7-ICT-2007-1

KW - IR-65420

KW - EWI-15202

KW - METIS-256469

KW - EC Grant Agreement nr.: IST-004527

U2 - 10.1145/1450058.1450089

DO - 10.1145/1450058.1450089

M3 - Conference contribution

SN - 978-1-60558-468-3

SP - 227

EP - 236

BT - Proceedings of the 7th ACM International conference on Embedded software

A2 - de Alfaro, Luca

A2 - Palsberg, Jens

PB - Association for Computing Machinery

CY - New York

T2 - 8th ACM International Conference on Embedded Software, EMSOFT 2008

Y2 - 19 October 2008 through 24 October 2008

ER -