An augmented overlay is only useful if it sits exactly where the anatomy is. Registration has to survive patient movement, soft-tissue shift, and a surgeon's changing viewpoint, and the error budget is millimetres.
Technology
What should this be built on?
Headsets, tracking, haptics, rendering, and the platform choices that constrain everything downstream.
What is still hard here
Unsolved engineering problems at this stage, each linked to work documenting the difficulty.
Visual realism has advanced far faster than touch. Without convincing resistance and texture, a simulator teaches the sequence of a procedure but not the feel of it, which is much of the skill.
Delay between hand and image is tolerable when watching, but not when operating. Small amounts of lag measurably reduce precision and raise cognitive load, and the effect compounds the longer someone works.
Hardware turns over faster than clinical software can be revalidated. Without a portable target, each new device risks a rebuild — a serious cost when the software is a regulated medical product.
2 records at this stage
A plan built from imaging has to be carried into theatre and aligned with the patient on the table, where attention and sterile field both constrain how it can be shown.
Interactive three-dimensional models are compelling in demonstration; producing one for an urgent case depends on segmentation staffing, not software.
7 records at this stage
A standalone virtual and mixed reality headset with full-colour passthrough and inside-out tracking, requiring no external sensors or tethered computer.
A head-worn spatial computer blending digital content with the wearer's surroundings, controlled by eye, hand, and voice input.
A standalone enterprise virtual reality headset with eye tracking and colour passthrough, positioned for organisational training and simulation deployments.
A professional mixed reality headset built for high visual fidelity, aimed at simulation, training, and engineering work where display detail matters.
Free, open-source software for visualisation, segmentation, registration, and analysis of medical images, with extensions for viewing and interacting with scenes in virtual reality.
Open-source framework for real-time physics simulation, widely used as the engine underneath medical simulation and surgical training research.
A see-through augmented reality headset with dimming technology, marketed for enterprise use including healthcare and surgical visualisation settings.
1 record at this stage
Research exploring XR devices, haptics, motor learning, sensorimotor coordination, and medical-training applications.
3 records at this stage
A European XR industry conference and expo. AVRMD tracks it as a broad ecosystem event rather than a medical-only conference.
An IEEE COMPSAC workshop focused on AR, VR, XR, AI-driven immersive visualization, medical imaging, and clinical applications.
The International Symposium on Mixed and Augmented Reality, the leading academic venue for AR and MR research, organised by IEEE and ACM SIGCHI.