Explanation and trust: what to tell the user in security and AI?

Wolter Pieters

    Research output: Contribution to journalArticleAcademicpeer-review

    36 Citations (Scopus)
    142 Downloads (Pure)

    Abstract

    There is a common problem in artificial intelligence (AI) and information security. In AI, an expert system needs to be able to justify and explain a decision to the user. In information security, experts need to be able to explain to the public why a system is secure. In both cases, an important goal of explanation is to acquire or maintain the users’ trust. In this paper, I investigate the relation between explanation and trust in the context of computing science. This analysis draws on literature study and concept analysis, using elements from system theory as well as actor-network theory. I apply the conceptual framework to both AI and information security, and show the benefit of the framework for both fields by means of examples. The main focus is on expert systems (AI) and electronic voting systems (security). Finally, I discuss consequences of the analysis for ethics in terms of (un)informed consent and dissent, and the associated division of responsibilities.
    Original languageUndefined
    Pages (from-to)53-64
    Number of pages12
    JournalEthics and information technology
    Volumeonline pre
    Issue number1
    DOIs
    Publication statusPublished - Mar 2011

    Keywords

    • EWI-18815
    • SCS-Cybersecurity
    • Trust
    • explanation
    • Systems theory
    • Information Security
    • confidence
    • METIS-271135
    • Actor-Network Theory
    • Expert Systems
    • IR-74620
    • informed consent

    Cite this