AUI story maker: Animation generation from natural language

Nacir Bouali; Violetta Cavalli-Sforza

doi:10.1007/978-3-319-93846-2_79

AUI story maker: Animation generation from natural language

Nacir Bouali
, Violetta Cavalli-Sforza

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

2 Citations (Scopus)

1 Downloads (Pure)

Abstract

Various research works have tried to connect Natural Language Processing NLP to computer graphics, as this connection would lay the ground for an automatic generation of computer animations. In this research we aim to provide a novel approach for connecting graphics to NLP by using OpenNLP and the Unity 3D game engine. We rely on two linguistic approaches—Vendler’s verb classification and Jackendoff’s Lexical Conceptual Structure LCS—and present how the technology enablers and the linguistic approaches chosen collaborate to provide the animation generation capability. We describe the overall architecture of AUI Story Maker, a system built to illustrate the feasibility of our approach, and discuss the future work required to make it a reliable tool in a modern classroom setting. We also present some writing samples gathered during field work with 1st graders at Al Akhawayn School in Ifrane (ASI), and provide sample outputs of AUI Story Maker.

Original language	English
Title of host publication	Artificial Intelligence in Education
Subtitle of host publication	19th International Conference, AIED 2018, London, UK, June 27–30, 2018, Proceedings, Part II
Editors	Carolyn Rosé, Roberto Martínez-Maldonado, H. Ulrich Hoppe, Rose Luckin, Manolis Mavrikis, Kaska Porayska-Pomsta, Bruce McLaren, Benedict du Boulay
Place of Publication	Cham
Publisher	Springer
Pages	424–428
ISBN (Electronic)	978-3-319-93846-2
ISBN (Print)	978-3-319-93845-5
DOIs	https://doi.org/10.1007/978-3-319-93846-2_79
Publication status	Published - 2018
Externally published	Yes
Event	19th International Conference on Artificial Intelligence in Education, AIED 2018 - London, United Kingdom Duration: 27 Jun 2018 → 30 Jun 2018 Conference number: 19

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	10948
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	19th International Conference on Artificial Intelligence in Education, AIED 2018
Abbreviated title	AIED 2018
Country/Territory	United Kingdom
City	London
Period	27/06/18 → 30/06/18

Keywords

Natural Language Processing (NLP)
Computer graphics
Animation
Vendler verb classes
Unity 3D
OpenNLP
Lexical Conceptual Structure (LCS)
n/a OA procedure

Access to Document

10.1007/978-3-319-93846-2_79

Cite this

Bouali, N., & Cavalli-Sforza, V. (2018). AUI story maker: Animation generation from natural language. In C. Rosé, R. Martínez-Maldonado, H. U. Hoppe, R. Luckin, M. Mavrikis, K. Porayska-Pomsta, B. McLaren, & B. du Boulay (Eds.), Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK, June 27–30, 2018, Proceedings, Part II (pp. 424–428). (Lecture Notes in Computer Science; Vol. 10948). Springer. https://doi.org/10.1007/978-3-319-93846-2_79

Bouali, Nacir ; Cavalli-Sforza, Violetta. / AUI story maker : Animation generation from natural language. Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK, June 27–30, 2018, Proceedings, Part II. editor / Carolyn Rosé ; Roberto Martínez-Maldonado ; H. Ulrich Hoppe ; Rose Luckin ; Manolis Mavrikis ; Kaska Porayska-Pomsta ; Bruce McLaren ; Benedict du Boulay. Cham : Springer, 2018. pp. 424–428 (Lecture Notes in Computer Science).

@inproceedings{df2b6c48d81046f8b652491cbeb2a336,

title = "AUI story maker: Animation generation from natural language",

abstract = "Various research works have tried to connect Natural Language Processing NLP to computer graphics, as this connection would lay the ground for an automatic generation of computer animations. In this research we aim to provide a novel approach for connecting graphics to NLP by using OpenNLP and the Unity 3D game engine. We rely on two linguistic approaches—Vendler{\textquoteright}s verb classification and Jackendoff{\textquoteright}s Lexical Conceptual Structure LCS—and present how the technology enablers and the linguistic approaches chosen collaborate to provide the animation generation capability. We describe the overall architecture of AUI Story Maker, a system built to illustrate the feasibility of our approach, and discuss the future work required to make it a reliable tool in a modern classroom setting. We also present some writing samples gathered during field work with 1st graders at Al Akhawayn School in Ifrane (ASI), and provide sample outputs of AUI Story Maker.",

keywords = "Natural Language Processing (NLP), Computer graphics, Animation, Vendler verb classes, Unity 3D, OpenNLP, Lexical Conceptual Structure (LCS), n/a OA procedure",

author = "Nacir Bouali and Violetta Cavalli-Sforza",

year = "2018",

doi = "10.1007/978-3-319-93846-2\_79",

language = "English",

isbn = "978-3-319-93845-5",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "424–428",

editor = "Carolyn Ros{\'e} and Roberto Mart{\'i}nez-Maldonado and Hoppe, \{H. Ulrich\} and Rose Luckin and Manolis Mavrikis and Kaska Porayska-Pomsta and Bruce McLaren and \{du Boulay\}, Benedict",

booktitle = "Artificial Intelligence in Education",

address = "Germany",

note = "19th International Conference on Artificial Intelligence in Education, AIED 2018, AIED 2018 ; Conference date: 27-06-2018 Through 30-06-2018",

}

Bouali, N & Cavalli-Sforza, V 2018, AUI story maker: Animation generation from natural language. in C Rosé, R Martínez-Maldonado, HU Hoppe, R Luckin, M Mavrikis, K Porayska-Pomsta, B McLaren & B du Boulay (eds), Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK, June 27–30, 2018, Proceedings, Part II. Lecture Notes in Computer Science, vol. 10948, Springer, Cham, pp. 424–428, 19th International Conference on Artificial Intelligence in Education, AIED 2018, London, United Kingdom, 27/06/18. https://doi.org/10.1007/978-3-319-93846-2_79

AUI story maker: Animation generation from natural language. / Bouali, Nacir; Cavalli-Sforza, Violetta.
Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK, June 27–30, 2018, Proceedings, Part II. ed. / Carolyn Rosé; Roberto Martínez-Maldonado; H. Ulrich Hoppe; Rose Luckin; Manolis Mavrikis; Kaska Porayska-Pomsta; Bruce McLaren; Benedict du Boulay. Cham: Springer, 2018. p. 424–428 (Lecture Notes in Computer Science; Vol. 10948).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - AUI story maker

T2 - 19th International Conference on Artificial Intelligence in Education, AIED 2018

AU - Bouali, Nacir

AU - Cavalli-Sforza, Violetta

N1 - Conference code: 19

PY - 2018

Y1 - 2018

N2 - Various research works have tried to connect Natural Language Processing NLP to computer graphics, as this connection would lay the ground for an automatic generation of computer animations. In this research we aim to provide a novel approach for connecting graphics to NLP by using OpenNLP and the Unity 3D game engine. We rely on two linguistic approaches—Vendler’s verb classification and Jackendoff’s Lexical Conceptual Structure LCS—and present how the technology enablers and the linguistic approaches chosen collaborate to provide the animation generation capability. We describe the overall architecture of AUI Story Maker, a system built to illustrate the feasibility of our approach, and discuss the future work required to make it a reliable tool in a modern classroom setting. We also present some writing samples gathered during field work with 1st graders at Al Akhawayn School in Ifrane (ASI), and provide sample outputs of AUI Story Maker.

AB - Various research works have tried to connect Natural Language Processing NLP to computer graphics, as this connection would lay the ground for an automatic generation of computer animations. In this research we aim to provide a novel approach for connecting graphics to NLP by using OpenNLP and the Unity 3D game engine. We rely on two linguistic approaches—Vendler’s verb classification and Jackendoff’s Lexical Conceptual Structure LCS—and present how the technology enablers and the linguistic approaches chosen collaborate to provide the animation generation capability. We describe the overall architecture of AUI Story Maker, a system built to illustrate the feasibility of our approach, and discuss the future work required to make it a reliable tool in a modern classroom setting. We also present some writing samples gathered during field work with 1st graders at Al Akhawayn School in Ifrane (ASI), and provide sample outputs of AUI Story Maker.

KW - Natural Language Processing (NLP)

KW - Computer graphics

KW - Animation

KW - Vendler verb classes

KW - Unity 3D

KW - OpenNLP

KW - Lexical Conceptual Structure (LCS)

KW - n/a OA procedure

UR - https://www.scopus.com/pages/publications/85049364481

U2 - 10.1007/978-3-319-93846-2_79

DO - 10.1007/978-3-319-93846-2_79

M3 - Conference contribution

SN - 978-3-319-93845-5

T3 - Lecture Notes in Computer Science

SP - 424

EP - 428

BT - Artificial Intelligence in Education

A2 - Rosé, Carolyn

A2 - Martínez-Maldonado, Roberto

A2 - Hoppe, H. Ulrich

A2 - Luckin, Rose

A2 - Mavrikis, Manolis

A2 - Porayska-Pomsta, Kaska

A2 - McLaren, Bruce

A2 - du Boulay, Benedict

PB - Springer

CY - Cham

Y2 - 27 June 2018 through 30 June 2018

ER -

Bouali N, Cavalli-Sforza V. AUI story maker: Animation generation from natural language. In Rosé C, Martínez-Maldonado R, Hoppe HU, Luckin R, Mavrikis M, Porayska-Pomsta K, McLaren B, du Boulay B, editors, Artificial Intelligence in Education: 19th International Conference, AIED 2018, London, UK, June 27–30, 2018, Proceedings, Part II. Cham: Springer. 2018. p. 424–428. (Lecture Notes in Computer Science). doi: 10.1007/978-3-319-93846-2_79

AUI story maker: Animation generation from natural language

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this