Augmented Reality System Lets Doctors See under Patients' Skin without the Scalpel

New technology is bringing the power of augmented reality into clinical practice. The system, called ProjectDR, allows medical images such as CT scans and MRI data to be displayed directly on a patient's body in a way that moves as the patient does.

"We wanted to create a system that would show clinicians a patient's internal anatomy within the context of the body," explained Ian Watts, a computing science graduate student and the developer of ProjectDR.

The technology includes a motion-tracking system using infrared cameras and markers on the patient's body, as well as a projector to display the images. But the really difficult part, Watts explained, is having the image track properly on the patient's body even as they shift and move. The solution: custom software written by Watts that gets all of the components working together.

Vast applications

"There are lots of applications for this technology, including in teaching, physiotherapy, laparoscopic surgery and even surgical planning," said Watts, who developed the technology with fellow graduate student Michael Fiest.

ProjectDR also has the capacity to present segmented images - for example, only the lungs or only the blood vessels - depending on what a clinician is interested in seeing.

For now, Watts is working on refining ProjectDR to improve the system's automatic calibration and to add components such as depth sensors. The next steps are testing the program's viability in a clinical setting, explained Pierre Boulanger, professor in the Department of Computing Science.

Next steps

"Soon, we'll deploy ProjectDR in an operating room in a surgical simulation laboratory to test the pros and cons in real-life surgical applications," said Boulanger. "We are also doing pilot studies to test the usability of the system for teaching chiropractic and physical therapy procedures." added Greg Kawchuk, a co-supervisor on the project from the Faculty of Rehabilitation Medicine. Once these pilot studies are complete, the research team expects the deployment of the system in real surgical pilot studies will quickly follow.

Watts is co-supervised by Boulanger, Cisco Chair in Healthcare Solutions and professor in the Faculty of Science, and by Kawchuk, professor in the Faculty of Rehabilitation Medicine.

ProjectDR was presented last November at the Virtual Reality Software and Technology Symposium in Gothenburg, Sweden.

Most Popular Now

Artificial Intelligence Detects a New Cl…

Many mutations in DNA that contribute to disease are not in actual genes but instead lie in the 99% of the genome once considered "junk." Even though scientists have recently...

Essen University Medicine and Siemens He…

The Essen University Medicine, Germany's leading hospital company for digitalized medicine, and Siemens Healthineers, a world-leading medical technology company, plan to work together to develop the hospital of the future...

Final Cohort Selected For Pioneering Dig…

Propel@YH has announced the six start-ups to participate in its inaugural digital health accelerator programme, aimed at navigating the complex healthcare landscape and building an NHS-relevant business case. The Leeds-based...

New Kid on the Block: The Doctrina Acade…

The Doctrina Academy is a new service, developed by Doctrina, a video e-learning platform that reaches over 1,000,000 healthcare professionals (HCPs) from around the globe, helping them to switch ...

Gloucestershire Hospitals to Deliver EPR…

Gloucestershire Hospitals NHS Foundation Trust is moving to a 'clinical wrap' strategy to deliver an electronic patient record (EPR) and achieve the highest levels of digital maturity within five-years. The...

Efficacy and SilverCloud Health Supports…

A leading mental health service is using the digital mental health platform developed by SilverCloud Health to support a confidential NHS service for GPs in England. London-based Efficacy is offering...

Mobile Phone App Designed to Boost Physi…

Activity trackers and mobile phone apps are all the rage, but do they really help users increase and maintain physical activity? A new study has found that one mobile phone...

Application Period for an International …

The Master of Science (M.Sc.)in Medical Informatics (MMI) at European Campus Rottal-Inn (ECRI) in Pfarrkirchen - a branch of the Deggendorf University of Applied Sciences (THD - Technische Hochschule Deggendorf)...

NHS Prescribing is Back in the Spotlight…

Opinion Article by Dr Simon Hendricks, Product Innovation Manager and Clinical Strategy Lead, FDB (First Databank) Political will for better and safer prescribing in the NHS has fast gained momentum in...

Sectra to Provide Large Centralized Regi…

International medical imaging IT and cybersecurity company Sectra (STO: SECT B) has signed a five-year contract with North Tees and Hartlepool NHS Foundation Trust for the delivery of a regional...

IMI to Boost Patient Involvement in its …

The Innovative Medicines Initiative (IMI) is creating a 'pool' of patient experts to strengthen the role and voice of patients in IMI activities at both strategic and operational levels. IMI...