All stagesStage 2 of 8

Technology

What should this be built on?

Headsets, tracking, haptics, rendering, and the platform choices that constrain everything downstream.

Open technical problems

What is still hard here

Unsolved engineering problems at this stage, each linked to work documenting the difficulty.

Technical problem
Aligning a 3D model to the patient on the table

An augmented overlay is only useful if it sits exactly where the anatomy is. Registration has to survive patient movement, soft-tissue shift, and a surgeon's changing viewpoint, and the error budget is millimetres.

ARMRCross-specialty
GlobalOpen problem
Technical problem
Recreating what tissue actually feels like

Visual realism has advanced far faster than touch. Without convincing resistance and texture, a simulator teaches the sequence of a procedure but not the feel of it, which is much of the skill.

VRHapticsCross-specialty
GlobalOpen problem
Technical problem
Latency quietly degrades fine motor precision

Delay between hand and image is tolerable when watching, but not when operating. Small amounts of lag measurably reduce precision and raise cognitive load, and the effect compounds the longer someone works.

VRHapticsCross-specialty
GlobalOpen problem
Technical problem
Building once and running on every headset

Hardware turns over faster than clinical software can be revalidated. Without a portable target, each new device risks a rebuild — a serious cost when the software is a regulated medical product.

VRARMRCross-specialty
GlobalOpen problem
Problems

2 records at this stage

Clinical problem
Keeping the plan visible during the operation

A plan built from imaging has to be carried into theatre and aligned with the patient on the table, where attention and sterile field both constrain how it can be shown.

MRARNeurosurgerySpine surgery
GlobalActive challenge
Clinical problem
Turning imaging into a usable model in time

Interactive three-dimensional models are compelling in demonstration; producing one for an urgent case depends on segmentation staffing, not software.

MRARRadiologyMedical imaging
GlobalActive challenge
Solutions

7 records at this stage

Standalone VR/MR headset
Meta Quest 3

A standalone virtual and mixed reality headset with full-colour passthrough and inside-out tracking, requiring no external sensors or tethered computer.

VRMRCross-specialty
GlobalConsumer hardware
Spatial computer
Apple Vision Pro

A head-worn spatial computer blending digital content with the wearer's surroundings, controlled by eye, hand, and voice input.

MRARCross-specialty
GlobalCommercial hardware
Enterprise VR headset
HTC VIVE Focus Vision

A standalone enterprise virtual reality headset with eye tracking and colour passthrough, positioned for organisational training and simulation deployments.

VRMRCross-specialty
GlobalEnterprise hardware
High-fidelity XR headset
Varjo XR-4

A professional mixed reality headset built for high visual fidelity, aimed at simulation, training, and engineering work where display detail matters.

VRMRCross-specialty
GlobalProfessional hardware
Open-source medical imaging platform
3D Slicer

Free, open-source software for visualisation, segmentation, registration, and analysis of medical images, with extensions for viewing and interacting with scenes in virtual reality.

VRScreen-basedRadiologyMedical imaging
GlobalOpen source
Source reviewed
Open-source simulation framework
SOFA Framework

Open-source framework for real-time physics simulation, widely used as the engine underneath medical simulation and surgical training research.

VRHapticsSurgeryMedical education
GlobalOpen source
Enterprise AR headset
Magic Leap 2

A see-through augmented reality headset with dimming technology, marketed for enterprise use including healthcare and surgical visualisation settings.

ARMRCross-specialty
GlobalEnterprise hardware
Projects

1 record at this stage

Events

3 records at this stage

XR conference and expo
United XR Europe 2026

A European XR industry conference and expo. AVRMD tracks it as a broad ecosystem event rather than a medical-only conference.

VRARMRCross-specialty
EuropeDec 7, 2026
Source reviewed
Academic workshop
MedXR 2026

An IEEE COMPSAC workshop focused on AR, VR, XR, AI-driven immersive visualization, medical imaging, and clinical applications.

VRARMedical imagingClinical research
Global2026 event
Source reviewed
Academic conference
IEEE ISMAR 2026

The International Symposium on Mixed and Augmented Reality, the leading academic venue for AR and MR research, organised by IEEE and ACM SIGCHI.

ARMRClinical researchMedical imaging
Bari, ItalyOct 4, 2026
Source reviewed
Stuck at this stage?Ask the members who work here — questions go to the people who can help.
See questionsAsk