Framework for assessing ethical aspects of algorithms and their encompassing socio-technical system

Xadya van Bruxvoort, Maurice van Keulen*

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

4 Citations (Scopus)
179 Downloads (Pure)

Abstract

In the transition to a data-driven society, organizations have introduced data-driven algorithms that often apply artificial intelligence. In this research, an ethical framework was developed to ensure robustness and completeness and to avoid and mitigate potential public uproar. We take a socio-technical perspective, i.e., view the algorithm embedded in an organization with infrastructure, rules, and procedures as one to-be-designed system. The framework consists of five ethical principles: beneficence, non-maleficence, autonomy, justice, and explicability. It can be used during the design for identification of relevant concerns. The framework has been validated by applying it to real-world fraud detection cases: Systeem Risico Indicatie (SyRI) of the Dutch government and the algorithm of the municipality of Amersfoort. The former is a controversial country-wide algorithm that was ultimately prohibited by court. The latter is an algorithm in development. In both cases, it proved effective in identifying all ethical risks. For SyRI, all concerns found in the media were also identified by the framework, mainly focused on transparency of the entire socio-technical system. For the municipality of Amersfoort, the framework highlighted risks regarding the amount of sensitive data and communication to and with the public, presenting a more thorough overview compared to the risks the media raised.

Original languageEnglish
Article number11187
JournalApplied Sciences (Switzerland)
Volume11
Issue number23
DOIs
Publication statusPublished - 25 Nov 2021

Keywords

  • Algorithms
  • Artificial intelligence
  • Ethical framework
  • Ethics
  • Fairness
  • Fraud detection
  • Responsible AI
  • UT-Gold-D

Fingerprint

Dive into the research topics of 'Framework for assessing ethical aspects of algorithms and their encompassing socio-technical system'. Together they form a unique fingerprint.

Cite this