An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

Jan  Kolkmeier; Merijn  Bruijnes; Dennis  Reidsma; Dirk Heylen

doi:10.1007/978-3-319-67401-8_27

An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

Jan Kolkmeier
, Merijn Bruijnes
, Dennis Reidsma
, Dirk Heylen

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

11 Citations (Scopus)

81 Downloads (Pure)

Abstract

Modern game engines such as Unity make prototyping and developing experiences for virtual and mixed reality contexts increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not have the capabilities to control virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We implemented a Unity embodiment bridge to the Articulated Social Agents Platform (ASAP) to combine the benefits of a modern game engine and a modern BML realizer. The challenges and solutions we report can help others integrate other game engines with BML realizers, and we end with a glimpse at future challenges and features of our implementation.

Original language	English
Title of host publication	Intelligent Virtual Agents
Subtitle of host publication	17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings
Editors	Jonas Beskow, Christopher Peters, Ginevra Castellano, Carol O'Sullivan, Iolanda Leite, Stefan Kopp
Place of Publication	Cham
Publisher	Springer
Pages	227-230
Number of pages	4
ISBN (Electronic)	978-3-319-67401-8
ISBN (Print)	978-3-319-67400-1
DOIs	https://doi.org/10.1007/978-3-319-67401-8_27
Publication status	Published - 26 Aug 2017
Event	17th International Conference on Intelligent Virtual Agents, IVA 2017 - KTH, Stockholm, Sweden Duration: 27 Aug 2017 → 30 Aug 2017 Conference number: 17 http://iva2017.org/

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	10498
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	17th International Conference on Intelligent Virtual Agents, IVA 2017
Abbreviated title	IVA
Country/Territory	Sweden
City	Stockholm
Period	27/08/17 → 30/08/17
Internet address	http://iva2017.org/

Keywords

BML
SAIBA
Virtual agents
Unity
Virtual Reality (VR)
Mixed reality
2024 OA procedure

Access to Document

10.1007/978-3-319-67401-8_27Licence: Unspecified

ArticleFinal published version, 93.8 KBLicence: Taverne

Cite this

Kolkmeier, J., Bruijnes, M., Reidsma, D., & Heylen, D. (2017). An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. In J. Beskow, C. Peters, G. Castellano, C. O'Sullivan, I. Leite, & S. Kopp (Eds.), Intelligent Virtual Agents: 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings (pp. 227-230). (Lecture Notes in Computer Science ; Vol. 10498). Springer. https://doi.org/10.1007/978-3-319-67401-8_27

Kolkmeier, Jan ; Bruijnes, Merijn ; Reidsma, Dennis et al. / An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. Intelligent Virtual Agents: 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. editor / Jonas Beskow ; Christopher Peters ; Ginevra Castellano ; Carol O'Sullivan ; Iolanda Leite ; Stefan Kopp. Cham : Springer, 2017. pp. 227-230 (Lecture Notes in Computer Science ).

@inproceedings{e83d9a11e2fe45a5a083bf881232a0a9,

title = "An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications",

abstract = "Modern game engines such as Unity make prototyping and developing experiences for virtual and mixed reality contexts increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not have the capabilities to control virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We implemented a Unity embodiment bridge to the Articulated Social Agents Platform (ASAP) to combine the benefits of a modern game engine and a modern BML realizer. The challenges and solutions we report can help others integrate other game engines with BML realizers, and we end with a glimpse at future challenges and features of our implementation. ",

keywords = "BML, SAIBA, Virtual agents, Unity, Virtual Reality (VR), Mixed reality, 2024 OA procedure",

author = "Jan Kolkmeier and Merijn Bruijnes and Dennis Reidsma and Dirk Heylen",

year = "2017",

month = aug,

day = "26",

doi = "10.1007/978-3-319-67401-8\_27",

language = "English",

isbn = "978-3-319-67400-1",

series = "Lecture Notes in Computer Science ",

publisher = "Springer",

pages = "227--230",

editor = "Jonas Beskow and Christopher Peters and Ginevra Castellano and Carol O'Sullivan and Iolanda Leite and Stefan Kopp",

booktitle = "Intelligent Virtual Agents",

address = "Germany",

note = "17th International Conference on Intelligent Virtual Agents, IVA 2017, IVA ; Conference date: 27-08-2017 Through 30-08-2017",

url = "http://iva2017.org/",

}

Kolkmeier, J, Bruijnes, M, Reidsma, D & Heylen, D 2017, An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. in J Beskow, C Peters, G Castellano, C O'Sullivan, I Leite & S Kopp (eds), Intelligent Virtual Agents: 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. Lecture Notes in Computer Science , vol. 10498, Springer, Cham, pp. 227-230, 17th International Conference on Intelligent Virtual Agents, IVA 2017, Stockholm, Sweden, 27/08/17. https://doi.org/10.1007/978-3-319-67401-8_27

An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. / Kolkmeier, Jan ; Bruijnes, Merijn ; Reidsma, Dennis et al.
Intelligent Virtual Agents: 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. ed. / Jonas Beskow; Christopher Peters; Ginevra Castellano; Carol O'Sullivan; Iolanda Leite; Stefan Kopp. Cham: Springer, 2017. p. 227-230 (Lecture Notes in Computer Science ; Vol. 10498).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

AU - Kolkmeier, Jan

AU - Bruijnes, Merijn

AU - Reidsma, Dennis

AU - Heylen, Dirk

N1 - Conference code: 17

PY - 2017/8/26

Y1 - 2017/8/26

N2 - Modern game engines such as Unity make prototyping and developing experiences for virtual and mixed reality contexts increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not have the capabilities to control virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We implemented a Unity embodiment bridge to the Articulated Social Agents Platform (ASAP) to combine the benefits of a modern game engine and a modern BML realizer. The challenges and solutions we report can help others integrate other game engines with BML realizers, and we end with a glimpse at future challenges and features of our implementation.

AB - Modern game engines such as Unity make prototyping and developing experiences for virtual and mixed reality contexts increasingly accessible and efficient, and their value has long been recognized by the scientific community as well. However, these game engines do not have the capabilities to control virtual embodied characters, situated in such environments, with the same expressiveness, flexibility, and generalizability, as offered by modern BML realizers that generate synchronized multimodal behavior from Behavior Markup Language (BML). We implemented a Unity embodiment bridge to the Articulated Social Agents Platform (ASAP) to combine the benefits of a modern game engine and a modern BML realizer. The challenges and solutions we report can help others integrate other game engines with BML realizers, and we end with a glimpse at future challenges and features of our implementation.

KW - BML

KW - SAIBA

KW - Virtual agents

KW - Unity

KW - Virtual Reality (VR)

KW - Mixed reality

KW - 2024 OA procedure

UR - https://github.com/hmi-utwente/AsapUnityBridge

U2 - 10.1007/978-3-319-67401-8_27

DO - 10.1007/978-3-319-67401-8_27

M3 - Conference contribution

SN - 978-3-319-67400-1

T3 - Lecture Notes in Computer Science

SP - 227

EP - 230

BT - Intelligent Virtual Agents

A2 - Beskow, Jonas

A2 - Peters, Christopher

A2 - Castellano, Ginevra

A2 - O'Sullivan, Carol

A2 - Leite, Iolanda

A2 - Kopp, Stefan

PB - Springer

CY - Cham

T2 - 17th International Conference on Intelligent Virtual Agents, IVA 2017

Y2 - 27 August 2017 through 30 August 2017

ER -

Kolkmeier J, Bruijnes M, Reidsma D , Heylen D. An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications. In Beskow J, Peters C, Castellano G, O'Sullivan C, Leite I, Kopp S, editors, Intelligent Virtual Agents: 17th International Conference, IVA 2017, Stockholm, Sweden, August 27-30, 2017, Proceedings. Cham: Springer. 2017. p. 227-230. (Lecture Notes in Computer Science ). doi: 10.1007/978-3-319-67401-8_27

An ASAP Realizer-Unity3D Bridge for Virtual and Mixed Reality Applications

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this