Testing the eSTV program for the Scottish Local Government Elections

P. Koopman, E.M.G.M. Hubbers, Wolter Pieters, E. Poll, R. de Vries

Research output: Book/ReportReportProfessional

9 Downloads (Pure)

Abstract

This report deals with the testing of eSTV software from ERS, Electoral Reform Services. The purpose of the test is to determine the conformance of eSTV to the WIG-rule [1]. In order to determine conformance we have created a new implementation of the rule in the functional programming language Clean [4]. Since this language uses a different programming paradigm and the implementation is made completely independent from the software to be tested it is extremely unlikely that both implementations contain the same error. Testing is done by computing the election result for a given set of votes with both programs. The results of both programs are compared to the level of votes numbers after each selection and elimination step in the algorithm. This has shown to be a very sensitive test for very small variations in the algorithm used in the programs. These tests are executed for 808 standard test cases. These test cases are partly handcrafted or the vote distributions in real elections for similar voting rules. Each of these sets is computed with 4 different elimination orders. In addition the results of 5000 generated data sets and a number of hand crafted data sets covering border situations in the algorithm are compared. Both test sets have shown to be very effective to identify even the smallest changes in the algorithm to compute the result of the election. Testing of preliminary versions of eSTV showed some small inaccuracies in the program as well as some small space for different interpretation of the rules. The Scottish Executive provided the final interpretation of the rules (as detailed in section 7.1) and all test where repeated for eSTV version 2.0.16. In these final tests there was an exact match for each of the 4 × 808 + 5000 = 8232 test cases.
Original languageUndefined
Place of PublicationNijmegen
PublisherDistributed and Embedded Security (DIES)
Number of pages19
Publication statusPublished - 30 Mar 2007

Publication series

Name
PublisherRadboud University Nijmegen
No.WoTUG-31/not assigned

Keywords

  • SCS-Cybersecurity
  • IR-65175
  • METIS-254948
  • EWI-14305

Cite this

Koopman, P., Hubbers, E. M. G. M., Pieters, W., Poll, E., & de Vries, R. (2007). Testing the eSTV program for the Scottish Local Government Elections. Nijmegen: Distributed and Embedded Security (DIES).
Koopman, P. ; Hubbers, E.M.G.M. ; Pieters, Wolter ; Poll, E. ; de Vries, R. / Testing the eSTV program for the Scottish Local Government Elections. Nijmegen : Distributed and Embedded Security (DIES), 2007. 19 p.
@book{b177b02b703242968d69ef6c6e70b572,
title = "Testing the eSTV program for the Scottish Local Government Elections",
abstract = "This report deals with the testing of eSTV software from ERS, Electoral Reform Services. The purpose of the test is to determine the conformance of eSTV to the WIG-rule [1]. In order to determine conformance we have created a new implementation of the rule in the functional programming language Clean [4]. Since this language uses a different programming paradigm and the implementation is made completely independent from the software to be tested it is extremely unlikely that both implementations contain the same error. Testing is done by computing the election result for a given set of votes with both programs. The results of both programs are compared to the level of votes numbers after each selection and elimination step in the algorithm. This has shown to be a very sensitive test for very small variations in the algorithm used in the programs. These tests are executed for 808 standard test cases. These test cases are partly handcrafted or the vote distributions in real elections for similar voting rules. Each of these sets is computed with 4 different elimination orders. In addition the results of 5000 generated data sets and a number of hand crafted data sets covering border situations in the algorithm are compared. Both test sets have shown to be very effective to identify even the smallest changes in the algorithm to compute the result of the election. Testing of preliminary versions of eSTV showed some small inaccuracies in the program as well as some small space for different interpretation of the rules. The Scottish Executive provided the final interpretation of the rules (as detailed in section 7.1) and all test where repeated for eSTV version 2.0.16. In these final tests there was an exact match for each of the 4 × 808 + 5000 = 8232 test cases.",
keywords = "SCS-Cybersecurity, IR-65175, METIS-254948, EWI-14305",
author = "P. Koopman and E.M.G.M. Hubbers and Wolter Pieters and E. Poll and {de Vries}, R.",
year = "2007",
month = "3",
day = "30",
language = "Undefined",
publisher = "Distributed and Embedded Security (DIES)",
number = "WoTUG-31/not assigned",

}

Koopman, P, Hubbers, EMGM, Pieters, W, Poll, E & de Vries, R 2007, Testing the eSTV program for the Scottish Local Government Elections. Distributed and Embedded Security (DIES), Nijmegen.

Testing the eSTV program for the Scottish Local Government Elections. / Koopman, P.; Hubbers, E.M.G.M.; Pieters, Wolter; Poll, E.; de Vries, R.

Nijmegen : Distributed and Embedded Security (DIES), 2007. 19 p.

Research output: Book/ReportReportProfessional

TY - BOOK

T1 - Testing the eSTV program for the Scottish Local Government Elections

AU - Koopman, P.

AU - Hubbers, E.M.G.M.

AU - Pieters, Wolter

AU - Poll, E.

AU - de Vries, R.

PY - 2007/3/30

Y1 - 2007/3/30

N2 - This report deals with the testing of eSTV software from ERS, Electoral Reform Services. The purpose of the test is to determine the conformance of eSTV to the WIG-rule [1]. In order to determine conformance we have created a new implementation of the rule in the functional programming language Clean [4]. Since this language uses a different programming paradigm and the implementation is made completely independent from the software to be tested it is extremely unlikely that both implementations contain the same error. Testing is done by computing the election result for a given set of votes with both programs. The results of both programs are compared to the level of votes numbers after each selection and elimination step in the algorithm. This has shown to be a very sensitive test for very small variations in the algorithm used in the programs. These tests are executed for 808 standard test cases. These test cases are partly handcrafted or the vote distributions in real elections for similar voting rules. Each of these sets is computed with 4 different elimination orders. In addition the results of 5000 generated data sets and a number of hand crafted data sets covering border situations in the algorithm are compared. Both test sets have shown to be very effective to identify even the smallest changes in the algorithm to compute the result of the election. Testing of preliminary versions of eSTV showed some small inaccuracies in the program as well as some small space for different interpretation of the rules. The Scottish Executive provided the final interpretation of the rules (as detailed in section 7.1) and all test where repeated for eSTV version 2.0.16. In these final tests there was an exact match for each of the 4 × 808 + 5000 = 8232 test cases.

AB - This report deals with the testing of eSTV software from ERS, Electoral Reform Services. The purpose of the test is to determine the conformance of eSTV to the WIG-rule [1]. In order to determine conformance we have created a new implementation of the rule in the functional programming language Clean [4]. Since this language uses a different programming paradigm and the implementation is made completely independent from the software to be tested it is extremely unlikely that both implementations contain the same error. Testing is done by computing the election result for a given set of votes with both programs. The results of both programs are compared to the level of votes numbers after each selection and elimination step in the algorithm. This has shown to be a very sensitive test for very small variations in the algorithm used in the programs. These tests are executed for 808 standard test cases. These test cases are partly handcrafted or the vote distributions in real elections for similar voting rules. Each of these sets is computed with 4 different elimination orders. In addition the results of 5000 generated data sets and a number of hand crafted data sets covering border situations in the algorithm are compared. Both test sets have shown to be very effective to identify even the smallest changes in the algorithm to compute the result of the election. Testing of preliminary versions of eSTV showed some small inaccuracies in the program as well as some small space for different interpretation of the rules. The Scottish Executive provided the final interpretation of the rules (as detailed in section 7.1) and all test where repeated for eSTV version 2.0.16. In these final tests there was an exact match for each of the 4 × 808 + 5000 = 8232 test cases.

KW - SCS-Cybersecurity

KW - IR-65175

KW - METIS-254948

KW - EWI-14305

M3 - Report

BT - Testing the eSTV program for the Scottish Local Government Elections

PB - Distributed and Embedded Security (DIES)

CY - Nijmegen

ER -

Koopman P, Hubbers EMGM, Pieters W, Poll E, de Vries R. Testing the eSTV program for the Scottish Local Government Elections. Nijmegen: Distributed and Embedded Security (DIES), 2007. 19 p.