A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

Jan Kolkmeier; Merijn Bruijnes; Dennis Reidsma

doi:10.1007/978-3-319-67401-8_26

A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

Jan Kolkmeier^*, Merijn Bruijnes, Dennis Reidsma

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

1 Citation (Scopus)

46 Downloads (Pure)

Abstract

Modern game engines such as Unity make prototyping and developing experiences in virtual and mixed reality environments increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not easily allow control of virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We demonstrate our integration of the ASAP BML Realizer and the Unity3D game engine at the hand of an Augmented Reality setup. We further show an in-unity editor for BML animations in the same system.

Original language	English
Title of host publication	Intelligent Virtual Agents
Subtitle of host publication	17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings
Editors	Jonas Beskow, Christopher Peters, Ginevra Castellano, Carol O'Sullivan, Iolanda Leite, Stefan Kopp
Place of Publication	Cham
Publisher	Springer
Pages	223-226
Number of pages	4
ISBN (Electronic)	978-3-319-67401-8
ISBN (Print)	978-3-319-67400-1
DOIs	https://doi.org/10.1007/978-3-319-67401-8_26
Publication status	Published - 2017
Event	17th International Conference on Intelligent Virtual Agents, IVA 2017 - KTH, Stockholm, Sweden Duration: 27 Aug 2017 → 30 Aug 2017 Conference number: 17 http://iva2017.org/

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	10498
ISSN (Print)	03029743
ISSN (Electronic)	16113349

Conference

Conference	17th International Conference on Intelligent Virtual Agents, IVA 2017
Abbreviated title	IVA
Country/Territory	Sweden
City	Stockholm
Period	27/08/17 → 30/08/17
Internet address	http://iva2017.org/

Keywords

BML
Mixed reality
SAIBA
Unity
Virtual agents
Virtual Reality (VR)
2024 OA procedure

Access to Document

10.1007/978-3-319-67401-8_26

ArticleFinal published version, 387 KBLicence: Taverne

Cite this

Kolkmeier, J., Bruijnes, M., & Reidsma, D. (2017). A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. In J. Beskow, C. Peters, G. Castellano, C. O'Sullivan, I. Leite, & S. Kopp (Eds.), Intelligent Virtual Agents : 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings (pp. 223-226). (Lecture Notes in Computer Science; Vol. 10498). Springer. https://doi.org/10.1007/978-3-319-67401-8_26

Kolkmeier, Jan ; Bruijnes, Merijn ; Reidsma, Dennis. / A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. Intelligent Virtual Agents : 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. editor / Jonas Beskow ; Christopher Peters ; Ginevra Castellano ; Carol O'Sullivan ; Iolanda Leite ; Stefan Kopp. Cham : Springer, 2017. pp. 223-226 (Lecture Notes in Computer Science).

@inproceedings{297156ddc8da44dca447c62bc31b3d81,

title = "A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications",

abstract = "Modern game engines such as Unity make prototyping and developing experiences in virtual and mixed reality environments increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not easily allow control of virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We demonstrate our integration of the ASAP BML Realizer and the Unity3D game engine at the hand of an Augmented Reality setup. We further show an in-unity editor for BML animations in the same system.",

keywords = "BML, Mixed reality, SAIBA, Unity, Virtual agents, Virtual Reality (VR), 2024 OA procedure",

author = "Jan Kolkmeier and Merijn Bruijnes and Dennis Reidsma",

year = "2017",

doi = "10.1007/978-3-319-67401-8_26",

language = "English",

isbn = "978-3-319-67400-1",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "223--226",

editor = "Jonas Beskow and Christopher Peters and Ginevra Castellano and Carol O'Sullivan and Iolanda Leite and Stefan Kopp",

booktitle = "Intelligent Virtual Agents",

address = "Germany",

note = "17th International Conference on Intelligent Virtual Agents, IVA 2017, IVA ; Conference date: 27-08-2017 Through 30-08-2017",

url = "http://iva2017.org/",

}

Kolkmeier, J, Bruijnes, M & Reidsma, D 2017, A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. in J Beskow, C Peters, G Castellano, C O'Sullivan, I Leite & S Kopp (eds), Intelligent Virtual Agents : 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. Lecture Notes in Computer Science, vol. 10498, Springer, Cham, pp. 223-226, 17th International Conference on Intelligent Virtual Agents, IVA 2017, Stockholm, Sweden, 27/08/17. https://doi.org/10.1007/978-3-319-67401-8_26

A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. / Kolkmeier, Jan; Bruijnes, Merijn; Reidsma, Dennis.
Intelligent Virtual Agents : 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. ed. / Jonas Beskow; Christopher Peters; Ginevra Castellano; Carol O'Sullivan; Iolanda Leite; Stefan Kopp. Cham: Springer, 2017. p. 223-226 (Lecture Notes in Computer Science; Vol. 10498).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

AU - Kolkmeier, Jan

AU - Bruijnes, Merijn

AU - Reidsma, Dennis

N1 - Conference code: 17

PY - 2017

Y1 - 2017

N2 - Modern game engines such as Unity make prototyping and developing experiences in virtual and mixed reality environments increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not easily allow control of virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We demonstrate our integration of the ASAP BML Realizer and the Unity3D game engine at the hand of an Augmented Reality setup. We further show an in-unity editor for BML animations in the same system.

AB - Modern game engines such as Unity make prototyping and developing experiences in virtual and mixed reality environments increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not easily allow control of virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We demonstrate our integration of the ASAP BML Realizer and the Unity3D game engine at the hand of an Augmented Reality setup. We further show an in-unity editor for BML animations in the same system.

KW - BML

KW - Mixed reality

KW - SAIBA

KW - Unity

KW - Virtual agents

KW - Virtual Reality (VR)

KW - 2024 OA procedure

UR - http://www.scopus.com/inward/record.url?scp=85028990591&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-67401-8_26

DO - 10.1007/978-3-319-67401-8_26

M3 - Conference contribution

AN - SCOPUS:85028990591

SN - 978-3-319-67400-1

T3 - Lecture Notes in Computer Science

SP - 223

EP - 226

BT - Intelligent Virtual Agents

A2 - Beskow, Jonas

A2 - Peters, Christopher

A2 - Castellano, Ginevra

A2 - O'Sullivan, Carol

A2 - Leite, Iolanda

A2 - Kopp, Stefan

PB - Springer

CY - Cham

T2 - 17th International Conference on Intelligent Virtual Agents, IVA 2017

Y2 - 27 August 2017 through 30 August 2017

ER -

Kolkmeier J, Bruijnes M, Reidsma D. A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. In Beskow J, Peters C, Castellano G, O'Sullivan C, Leite I, Kopp S, editors, Intelligent Virtual Agents : 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. Cham: Springer. 2017. p. 223-226. (Lecture Notes in Computer Science). doi: 10.1007/978-3-319-67401-8_26

A Demonstration of the ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this