Pragmatic evaluations of automated linguistic creativity

Lorenzo Gatti*, Oliviero Stock, Carlo Strapparava, Gözde Özbal

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

27 Downloads (Pure)


The optimal innovation hypothesis (OIH) offers a good aesthetic and cognitive reference for the kind of linguistic creativity where minimal variations can have a strong effect on the audience and realize an overall intended goal. The same approach can be the basis for creative systems. The question is how to concretely evaluate not only their quality, but also their pragmatic effect. This paper describes the original evaluations of two systems based on the OIH, one automatically yielding witty headlines for incoming news, the other producing song parodies, varying the song lyrics to evoke a given concept. The goal is to bring attention to the importance of evaluating the pragmatic potential of creative systems, in addition to the quality of their output, and to demonstrate how such evaluations can be done.
Original languageEnglish
Pages (from-to)451–476
JournalLanguage resources and evaluation
Early online date14 Sept 2021
Publication statusPublished - Jun 2022


  • UT-Hybrid-D


Dive into the research topics of 'Pragmatic evaluations of automated linguistic creativity'. Together they form a unique fingerprint.

Cite this