Head worn 3D-Visualization of the Invisible for Surgical Intra-Operative Augmented Reality H3D-VISIOnAiR

Jaap Heukelom; Nicole D. Bouvy; Lejla  Alic; Maarten Burie; Vincent Graham; Rutger M. Schols; Fokko P. Wieringa; Gabriëlle J.M. Tuijthof

Head worn 3D-Visualization of the Invisible for Surgical Intra-Operative Augmented Reality H3D-VISIOnAiR

Jaap Heukelom^*, Nicole D. Bouvy, Lejla Alic, Maarten Burie, Vincent Graham, Rutger M. Schols, Fokko P. Wieringa, Gabriëlle J.M. Tuijthof

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

123 Downloads (Pure)

Abstract

During surgery, surgeons must identify vital anatomical structures (nerves and lymph nodes) to prevent damage. Correct identification remains enormously challenging and surgeons require high-tech intra-operative imaging. Our team worked on developing a demonstrator of H3D-VISIOnAiR that enables visualizing the invisible by combining a commercial spectral + RGB camera, advanced image analytics and near eye display. Tests were performed with a simulated surgical task consisting of positioning beads in a nailbed with very low contrast. The results show proof of concept by real-time 2D high-resolution image acquisition, processing of hyperspectral images and displaying augmented reality overlay of processed hyperspectral images.

Original language	English
Title of host publication	ATTRACT Final Conference
Pages	1-6
Number of pages	6
Publication status	Published - Sept 2020
Event	ATTRACT online Conference 2020: Igniting the Deep Tech Revolution - Online Duration: 22 Sept 2020 → 23 Sept 2020 https://attract-eu.com/

Conference

Conference	ATTRACT online Conference 2020
City	Online
Period	22/09/20 → 23/09/20
Internet address	https://attract-eu.com/

Access to Document

ATTRACT_FinalConferencepaper september 2020Final published version, 1.22 MB

https://www.researchgate.net/publication/345258948_Head-worn_3D-Visualization_of_the_Invisible_for_Surgical_Intra-Operative_Augmented_Reality_H3D-VISIOnAiR

Cite this

Heukelom, J., Bouvy, N. D., Alic, L., Burie, M., Graham, V., Schols, R. M., Wieringa, F. P., & Tuijthof, G. J. M. (2020). Head worn 3D-Visualization of the Invisible for Surgical Intra-Operative Augmented Reality H3D-VISIOnAiR. In ATTRACT Final Conference (pp. 1-6) https://www.researchgate.net/publication/345258948_Head-worn_3D-Visualization_of_the_Invisible_for_Surgical_Intra-Operative_Augmented_Reality_H3D-VISIOnAiR

@inproceedings{e82cf50a14dd42ddb00b622171609fdc,

title = "Head worn 3D-Visualization of the Invisible for Surgical Intra-Operative Augmented Reality H3D-VISIOnAiR",

abstract = "During surgery, surgeons must identify vital anatomical structures (nerves and lymph nodes) to prevent damage. Correct identification remains enormously challenging and surgeons require high-tech intra-operative imaging. Our team worked on developing a demonstrator of H3D-VISIOnAiR that enables visualizing the invisible by combining a commercial spectral + RGB camera, advanced image analytics and near eye display. Tests were performed with a simulated surgical task consisting of positioning beads in a nailbed with very low contrast. The results show proof of concept by real-time 2D high-resolution image acquisition, processing of hyperspectral images and displaying augmented reality overlay of processed hyperspectral images.",

author = "Jaap Heukelom and Bouvy, {Nicole D.} and Lejla Alic and Maarten Burie and Vincent Graham and Schols, {Rutger M.} and Wieringa, {Fokko P.} and Tuijthof, {Gabri{\"e}lle J.M.}",

year = "2020",

month = sep,

language = "English",

pages = "1--6",

booktitle = "ATTRACT Final Conference",

note = "ATTRACT online Conference 2020 : Igniting the Deep Tech Revolution ; Conference date: 22-09-2020 Through 23-09-2020",

url = "https://attract-eu.com/",

}

Heukelom, J, Bouvy, ND, Alic, L, Burie, M, Graham, V, Schols, RM, Wieringa, FP & Tuijthof, GJM 2020, Head worn 3D-Visualization of the Invisible for Surgical Intra-Operative Augmented Reality H3D-VISIOnAiR. in ATTRACT Final Conference. pp. 1-6, ATTRACT online Conference 2020, Online, 22/09/20. <https://www.researchgate.net/publication/345258948_Head-worn_3D-Visualization_of_the_Invisible_for_Surgical_Intra-Operative_Augmented_Reality_H3D-VISIOnAiR>

TY - GEN

T1 - Head worn 3D-Visualization of the Invisible for Surgical Intra-Operative Augmented Reality H3D-VISIOnAiR

AU - Heukelom, Jaap

AU - Bouvy, Nicole D.

AU - Alic, Lejla

AU - Burie, Maarten

AU - Graham, Vincent

AU - Schols, Rutger M.

AU - Wieringa, Fokko P.

AU - Tuijthof, Gabriëlle J.M.

PY - 2020/9

Y1 - 2020/9

N2 - During surgery, surgeons must identify vital anatomical structures (nerves and lymph nodes) to prevent damage. Correct identification remains enormously challenging and surgeons require high-tech intra-operative imaging. Our team worked on developing a demonstrator of H3D-VISIOnAiR that enables visualizing the invisible by combining a commercial spectral + RGB camera, advanced image analytics and near eye display. Tests were performed with a simulated surgical task consisting of positioning beads in a nailbed with very low contrast. The results show proof of concept by real-time 2D high-resolution image acquisition, processing of hyperspectral images and displaying augmented reality overlay of processed hyperspectral images.

AB - During surgery, surgeons must identify vital anatomical structures (nerves and lymph nodes) to prevent damage. Correct identification remains enormously challenging and surgeons require high-tech intra-operative imaging. Our team worked on developing a demonstrator of H3D-VISIOnAiR that enables visualizing the invisible by combining a commercial spectral + RGB camera, advanced image analytics and near eye display. Tests were performed with a simulated surgical task consisting of positioning beads in a nailbed with very low contrast. The results show proof of concept by real-time 2D high-resolution image acquisition, processing of hyperspectral images and displaying augmented reality overlay of processed hyperspectral images.

M3 - Conference contribution

SP - 1

EP - 6

BT - ATTRACT Final Conference

T2 - ATTRACT online Conference 2020

Y2 - 22 September 2020 through 23 September 2020

ER -

Head worn 3D-Visualization of the Invisible for Surgical Intra-Operative Augmented Reality H3D-VISIOnAiR

Abstract

Conference

Access to Document

Fingerprint

Cite this