Abstract
We propose a novel framework for model-based testing against specifications from EULYNX, a SysML-based standard from the railway industry for the controllers of systems such as points, signals, sensors, and crossings. The main challenge here is the sheer complexity: with state spaces exceeding 10e+10 states, it is hard to derive test suites that achieve a meaningful type of coverage.
We tackle this problem by moving away from the traditional interleaving semantics for SysML. Instead, we propose a synchronous semantics in terms of Finite State Machines (FSMs), leveraging the fact that EULYNX is implemented on Programmable Logic Controllers (PLCs). Then, we deploy Single-Input-Change Deterministic Finite State Machines (SIC-DFSMs), which ensures fully deterministic tests thus minimizing scalability issues.
Our focus lies on the EULYNX specification for point controllers. The generated test suite achieves maximal transition coverage, but test execution time remains substantial. We introduce an additional test suite that achieves maximal transition label coverage. Remarkably, this smaller suite successfully identifies the same four faults as the larger suite.
We tackle this problem by moving away from the traditional interleaving semantics for SysML. Instead, we propose a synchronous semantics in terms of Finite State Machines (FSMs), leveraging the fact that EULYNX is implemented on Programmable Logic Controllers (PLCs). Then, we deploy Single-Input-Change Deterministic Finite State Machines (SIC-DFSMs), which ensures fully deterministic tests thus minimizing scalability issues.
Our focus lies on the EULYNX specification for point controllers. The generated test suite achieves maximal transition coverage, but test execution time remains substantial. We introduce an additional test suite that achieves maximal transition label coverage. Remarkably, this smaller suite successfully identifies the same four faults as the larger suite.
Original language | English |
---|---|
Title of host publication | Formal Methods for Industrial Critical Systems |
Subtitle of host publication | 28th International Conference, FMICS 2023, Antwerp, Belgium, September 20–22, 2023, Proceedings |
Editors | Alessandro Cimatti, Laura Titolo |
Pages | 242-258 |
Number of pages | 17 |
ISBN (Electronic) | 978-3-031-43681-9 |
DOIs | |
Publication status | Published - 17 Sept 2023 |
Event | 28th International Conference on Formal Methods for Industrial Critical Systems, FMICS 2023 - Antwerp, Belgium Duration: 20 Sept 2023 → 22 Sept 2023 Conference number: 28 |
Publication series
Name | Lecture Notes in Computer Science book series |
---|---|
Volume | 14290 |
Conference
Conference | 28th International Conference on Formal Methods for Industrial Critical Systems, FMICS 2023 |
---|---|
Abbreviated title | FMICS 2023 |
Country/Territory | Belgium |
City | Antwerp |
Period | 20/09/23 → 22/09/23 |
Keywords
- Conformance testing
- Model-based testing
- Programmable logic controllers
- Railways
- Safety-critical systems
- Single-Input-Change
- 2023 OA procedure
Fingerprint
Dive into the research topics of 'Conformance in the Railway Industry: Single-Input-Change Testing a EULYNX Controller'. Together they form a unique fingerprint.Prizes
-
FMICS'23 Best Paper Award
van der Wal, D. (Recipient), Stoelinga, M. I. A. (Recipient) & Gerhold, M. (Recipient), 20 Jul 2023
Prize