Extended reality includes virtual reality (VR), augmented reality (AR), and mixed reality (MR).
Virtual reality (VR) provides a fully immersive digital experience, transporting users to virtual environments.
Augmented reality (AR) overlays digital content in the real world, enhancing it with virtual elements.
Mixed reality (MR) combines virtual and real-world elements, allowing users to interact with both digital and physical objects in a merged environment.
1. Virtual Reality
Virtual reality is a complete visual immersion in a computer-generated artificial environment. The system can also generate synthetic sounds and other stimuli.
The purpose of virtual reality (VR) is to simulate the real world (or entirely imaginary worlds) using high-power computers and sensory technology such as a headset and a pocket controller.
The user loses contact with the outside world.
Virtual reality (VR) is a simulated experience that uses pose tracking and 3D near-eye displays to give the user an immersive sense of a virtual world.
2. Augmented Reality
Augmented reality is an overlay of useful information or digital images in the real world (seen only by the user).
Augmented reality offers to display digital content on real surfaces, allowing deep perception. Currently available for smartphone and head display platforms.
The user keeps in touch with the real world.
Augmented reality is a combination of the human world, the digital world, and the physical world.
Augmented reality is largely synonymous with mixed reality. There is also an overlap of terminology between extended reality and computer-assisted reality.
3. Mixed Reality
Mixed reality is the fusion of real and virtual worlds, where physical and digital objects coexist and interact in real-time.
The user looks at the real world while manipulating the digital content generated by the MR headset.
Mixed reality is the ability to do both, virtual reality and augmented reality in the same application or on the same device.
Differences between VR, AR, and MR
Virtual Reality vs Augmented Reality (VR vs AR)
Virtual reality creates an immersive virtual environment, while augmented reality creates a real-world scene.
Virtual reality requires a headset and gloves, but augmented reality is accessible with a smartphone.
Augmented reality, unlike virtual reality, always occurs in the physical space in which you are currently.
Mixed Reality vs Augmented Reality (MR vs AR)
Mixed reality makes it possible to penetrate and manipulate a scene, whereas augmented reality does not.
Mixed reality has improved freedom of control over digital content through responses to verbal commands and hand gestures.
In the future, there is a great possibility that we will no longer be able to distinguish between VR, AR, and MR, different hardware will merge and will be capable of anything.
Updated: Jun 28
Mixed reality is the merging of real and virtual worlds, where physical and digital objects co-exist and interact in real-time.
The user views the real world while manipulating the digital content generated by the device.
Complex information such as holographic images or 3D objects can be placed in the surgeon’s field of vision, avoid using other displays in the operating room, and facilitate more accurate alignment between virtual information and physical objects.
This would reduce the need for awkward postures for the surgeon and provide new interactive experiences in surgical planning.
5 Applications of mixed reality in surgery:
Preoperative planning
Documentation of the intervention
Holographic 3D visualization of any imaging of the patient during surgery with the possibility to interact with it: immersion and interaction with the two real and virtual worlds
Collaboration of surgeons in real-time and collaboration of remote surgeons
Education of medical students and training of surgical residents
1. Preoperative planning
Mixed reality can be useful for planning surgery.
A surgical plan performed on a patient’s X-ray may be used during surgery and even after for resident training in surgery or the patient.
Mixed reality glasses such as HoloLens 2, and Holoeyes, facilitate the spatial localization of anatomical structures and improve mental alignment, which simplifies preoperative planning.
These smart glasses can also improve patient comfort and understanding with Virtual Surgery Intelligence for HoloLens 2.
2. Documentation of the operation
Surgeons can document the procedure and then use images, videos, or audio to train residents or students, using MR headsets.
3. Holographic 3D visualization during the operation
Mixed reality allows the process of reconstructive surgery. With reconstructive surgery, surgeons can locate and reconnect major blood vessels.
Holographic overlays help surgeons see the bones and identify the evolution of the blood vessels that help them with their surgery, improving the outcome for the patient.
Mixed reality helps healthcare professionals access 3D medical information and anatomical images of the patient during surgery.
Mixed reality allows you to generate customized 3D models for each patient and visualize the internal anatomy in a fully immersive environment.
4. Collaboration between surgeons
Mixed reality also helps build a bridge between surgeons who work in different parts of the world to collaborate or even surgeons in the same operating room or hospital.
5. Education and training of students and residents
Mixed reality surgical simulators allow an appropriate training environment to recreate realistic and reproducible scenarios without putting the patient at risk.
Updated: Jun 28
1. More procedures and anatomies
Researchers and developers are working to create VR simulations for a broader range of surgical procedures and anatomies.
2. Surgical planning and execution
VR is being used to assist in surgical planning, allowing surgeons to visualize and plan procedures before they are performed, and also to aid in the execution of the procedure.
3. Integration with other technologies
VR is being integrated with other technologies such as augmented reality (AR) and haptic feedback to create more realistic and immersive simulations.
4. AI-powered virtual reality
AI is being used in VR to communicate with users and engage them in such a manner that makes them feel at ease.
This is being done through AI-powered chatbots and robots used to determine the behavior of that user and help choose the best results to match the level of each user.