Head worn 3D-Visualization of the Invisible for Surgical Intra-Operative Augmented Reality H3D-VISIOnAiR

During surgery, surgeons must identify vital anatomical structures (nerves and lymph nodes) to prevent damage. Correct identification remains enormously challenging and surgeons require high-tech intra-operative imaging. Our team worked on developing a demonstrator of H3D-VISIOnAiR that enables visualizing the invisible by combining a commercial spectral + RGB camera, advanced image analytics and near eye display. Tests were performed with a simulated surgical task consisting of positioning beads in a nailbed with very low contrast. The results show proof of concept by real-time 2D high-resolution image acquisition, processing of hyperspectral images and displaying augmented reality overlay of processed hyperspectral images.