5 Applications of Mixed Reality (MR) in Surgery

Mixed reality is the merging of real and virtual worlds, where physical and digital objects co-exist and interact in real-time.

The user views the real world while manipulating the digital content generated by the device.

Complex information such as holographic images or 3D objects can be placed in the surgeon’s field of vision, avoid using other displays in the operating room, and facilitate more accurate alignment between virtual information and physical objects.

This would reduce the need for awkward postures for the surgeon and provide new interactive experiences in surgical planning.

5 Applications of mixed reality in surgery:

1. Preoperative planning

2. Documentation of the intervention

3. Holographic 3D visualization of any imaging of the patient during surgery with the possibility to interact with it: immersion and interaction with the two real and virtual worlds

4. Collaboration of surgeons in real-time and collaboration of remote surgeons

5. Education of medical students and training of surgical residents

1. Preoperative planning

Mixed reality can be useful for planning surgery.

A surgical plan performed on a patient’s X-ray may be used during surgery and even after for resident training in surgery or the patient.

Mixed reality glasses such as HoloLens 2, and Holoeyes, facilitate the spatial localization of anatomical structures and improve mental alignment, which simplifies preoperative planning.

These smart glasses can also improve patient comfort and understanding with Virtual Surgery Intelligence for HoloLens 2.

2. Documentation of the operation

Surgeons can document the procedure and then use images, videos, or audio to train residents or students, using MR headsets.

3. Holographic 3D visualization during the operation

Mixed reality allows the process of reconstructive surgery. With reconstructive surgery, surgeons can locate and reconnect major blood vessels.

Holographic overlays help surgeons see the bones and identify the evolution of the blood vessels that help them with their surgery, improving the outcome for the patient.

Mixed reality helps healthcare professionals access 3D medical information and anatomical images of the patient during surgery.

Mixed reality allows you to generate customized 3D models for each patient and visualize the internal anatomy in a fully immersive environment.

4. Collaboration between surgeons

Mixed reality also helps build a bridge between surgeons who work in different parts of the world to collaborate or even surgeons in the same operating room or hospital.

5. Education and training of students and residents

Mixed reality surgical simulators allow an appropriate training environment to recreate realistic and reproducible scenarios without putting the patient at risk.