Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy

Esther S. Kox; Beatrice Beretta

doi:10.3233/FAIA240194

Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy

Esther S. Kox^*
, Beatrice Beretta

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

3 Citations (Scopus)

266 Downloads (Pure)

Abstract

Generative AI presents vast opportunities but also risks. Misuse, whether intentional or not, can lead to significant 'real-world' consequences. We presented subjects (n=139) with five vignettes describing incidents involving generative AI. We explored the relationship between their level of AI literacy, attitude towards AI, trust in AI chatbots, and people's reactions to the vignettes. Attitude and trust, measured before and after the vignettes, declined significantly. However, these changes as well as the reactions to the vignettes were unrelated to AI literacy. Yet, higher AI literacy was associated with more frequent use of AI chatbots, higher trust and more positive attitudes towards AI. So while AI literacy appeared to be related to the general perceptions and usage of generative AI, it was not linked to the evaluation of incidents involving generative AI. The implications for trust calibration and appropriate reliance are discussed.

Original language	English
Title of host publication	HHAI 2024
Subtitle of host publication	Hybrid Human AI Systems for the Social Good - Proceedings of the 3rd International Conference on Hybrid Human-Artificial Intelligence
Editors	Fabian Lorig, Jason Tucker, Adam Dahlgren Lindstrom, Frank Dignum, Pradeep Murukannaiah, Andreas Theodorou, Pinar Yolum
Publisher	IOS
Pages	188-198
Number of pages	11
ISBN (Electronic)	9781643685229
DOIs	https://doi.org/10.3233/FAIA240194
Publication status	Published - 5 Jun 2024
Event	3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI 2024 - Hybrid, Malmo, Sweden Duration: 10 Jun 2024 → 14 Jun 2024 Conference number: 3

Publication series

Name	Frontiers in Artificial Intelligence and Applications
Volume	386
ISSN (Print)	0922-6389
ISSN (Electronic)	1879-8314

Conference

Conference	3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI 2024
Abbreviated title	HHAI 2024
Country/Territory	Sweden
City	Hybrid, Malmo
Period	10/06/24 → 14/06/24

Keywords

AI chatbots
AI literacy
attitude
LLMs
trust

Access to Document

10.3233/FAIA240194Licence: CC BY-NC

FAIA-386-FAIA240194Final published version, 741 KBLicence: CC BY-NC

Cite this

Kox, E. S., & Beretta, B. (2024). Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy. In F. Lorig, J. Tucker, A. D. Lindstrom, F. Dignum, P. Murukannaiah, A. Theodorou, & P. Yolum (Eds.), HHAI 2024: Hybrid Human AI Systems for the Social Good - Proceedings of the 3rd International Conference on Hybrid Human-Artificial Intelligence (pp. 188-198). (Frontiers in Artificial Intelligence and Applications; Vol. 386). IOS. https://doi.org/10.3233/FAIA240194

Kox, Esther S. ; Beretta, Beatrice. / Evaluating Generative AI Incidents : An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy. HHAI 2024: Hybrid Human AI Systems for the Social Good - Proceedings of the 3rd International Conference on Hybrid Human-Artificial Intelligence. editor / Fabian Lorig ; Jason Tucker ; Adam Dahlgren Lindstrom ; Frank Dignum ; Pradeep Murukannaiah ; Andreas Theodorou ; Pinar Yolum. IOS, 2024. pp. 188-198 (Frontiers in Artificial Intelligence and Applications).

@inproceedings{34bcc68f179246cca12514b83e7df916,

title = "Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy",

abstract = "Generative AI presents vast opportunities but also risks. Misuse, whether intentional or not, can lead to significant 'real-world' consequences. We presented subjects (n=139) with five vignettes describing incidents involving generative AI. We explored the relationship between their level of AI literacy, attitude towards AI, trust in AI chatbots, and people's reactions to the vignettes. Attitude and trust, measured before and after the vignettes, declined significantly. However, these changes as well as the reactions to the vignettes were unrelated to AI literacy. Yet, higher AI literacy was associated with more frequent use of AI chatbots, higher trust and more positive attitudes towards AI. So while AI literacy appeared to be related to the general perceptions and usage of generative AI, it was not linked to the evaluation of incidents involving generative AI. The implications for trust calibration and appropriate reliance are discussed.",

keywords = "AI chatbots, AI literacy, attitude, LLMs, trust",

author = "Kox, \{Esther S.\} and Beatrice Beretta",

note = "Publisher Copyright: {\textcopyright} 2024 The Authors.; 3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI 2024, HHAI 2024 ; Conference date: 10-06-2024 Through 14-06-2024",

year = "2024",

month = jun,

day = "5",

doi = "10.3233/FAIA240194",

language = "English",

series = "Frontiers in Artificial Intelligence and Applications",

publisher = "IOS",

pages = "188--198",

editor = "Fabian Lorig and Jason Tucker and Lindstrom, \{Adam Dahlgren\} and Frank Dignum and Pradeep Murukannaiah and Andreas Theodorou and Pinar Yolum",

booktitle = "HHAI 2024",

address = "Netherlands",

}

Kox, ES & Beretta, B 2024, Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy. in F Lorig, J Tucker, AD Lindstrom, F Dignum, P Murukannaiah, A Theodorou & P Yolum (eds), HHAI 2024: Hybrid Human AI Systems for the Social Good - Proceedings of the 3rd International Conference on Hybrid Human-Artificial Intelligence. Frontiers in Artificial Intelligence and Applications, vol. 386, IOS, pp. 188-198, 3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI 2024, Hybrid, Malmo, Sweden, 10/06/24. https://doi.org/10.3233/FAIA240194

Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy. / Kox, Esther S.; Beretta, Beatrice.
HHAI 2024: Hybrid Human AI Systems for the Social Good - Proceedings of the 3rd International Conference on Hybrid Human-Artificial Intelligence. ed. / Fabian Lorig; Jason Tucker; Adam Dahlgren Lindstrom; Frank Dignum; Pradeep Murukannaiah; Andreas Theodorou; Pinar Yolum. IOS, 2024. p. 188-198 (Frontiers in Artificial Intelligence and Applications; Vol. 386).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Evaluating Generative AI Incidents

T2 - 3rd International Conference on Hybrid Human-Artificial Intelligence, HHAI 2024

AU - Kox, Esther S.

AU - Beretta, Beatrice

N1 - Conference code: 3

PY - 2024/6/5

Y1 - 2024/6/5

N2 - Generative AI presents vast opportunities but also risks. Misuse, whether intentional or not, can lead to significant 'real-world' consequences. We presented subjects (n=139) with five vignettes describing incidents involving generative AI. We explored the relationship between their level of AI literacy, attitude towards AI, trust in AI chatbots, and people's reactions to the vignettes. Attitude and trust, measured before and after the vignettes, declined significantly. However, these changes as well as the reactions to the vignettes were unrelated to AI literacy. Yet, higher AI literacy was associated with more frequent use of AI chatbots, higher trust and more positive attitudes towards AI. So while AI literacy appeared to be related to the general perceptions and usage of generative AI, it was not linked to the evaluation of incidents involving generative AI. The implications for trust calibration and appropriate reliance are discussed.

AB - Generative AI presents vast opportunities but also risks. Misuse, whether intentional or not, can lead to significant 'real-world' consequences. We presented subjects (n=139) with five vignettes describing incidents involving generative AI. We explored the relationship between their level of AI literacy, attitude towards AI, trust in AI chatbots, and people's reactions to the vignettes. Attitude and trust, measured before and after the vignettes, declined significantly. However, these changes as well as the reactions to the vignettes were unrelated to AI literacy. Yet, higher AI literacy was associated with more frequent use of AI chatbots, higher trust and more positive attitudes towards AI. So while AI literacy appeared to be related to the general perceptions and usage of generative AI, it was not linked to the evaluation of incidents involving generative AI. The implications for trust calibration and appropriate reliance are discussed.

KW - AI chatbots

KW - AI literacy

KW - attitude

KW - LLMs

KW - trust

UR - https://www.scopus.com/pages/publications/85198752635

U2 - 10.3233/FAIA240194

DO - 10.3233/FAIA240194

M3 - Conference contribution

AN - SCOPUS:85198752635

T3 - Frontiers in Artificial Intelligence and Applications

SP - 188

EP - 198

BT - HHAI 2024

A2 - Lorig, Fabian

A2 - Tucker, Jason

A2 - Lindstrom, Adam Dahlgren

A2 - Dignum, Frank

A2 - Murukannaiah, Pradeep

A2 - Theodorou, Andreas

A2 - Yolum, Pinar

PB - IOS

Y2 - 10 June 2024 through 14 June 2024

ER -

Kox ES, Beretta B. Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy. In Lorig F, Tucker J, Lindstrom AD, Dignum F, Murukannaiah P, Theodorou A, Yolum P, editors, HHAI 2024: Hybrid Human AI Systems for the Social Good - Proceedings of the 3rd International Conference on Hybrid Human-Artificial Intelligence. IOS. 2024. p. 188-198. (Frontiers in Artificial Intelligence and Applications). doi: 10.3233/FAIA240194

Evaluating Generative AI Incidents: An Exploratory Vignette Study on the Role of Trust, Attitude and AI Literacy

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this