Augmented Reality System Lets Doctors See under Patients' Skin without the Scalpel

New technology is bringing the power of augmented reality into clinical practice. The system, called ProjectDR, allows medical images such as CT scans and MRI data to be displayed directly on a patient's body in a way that moves as the patient does.

"We wanted to create a system that would show clinicians a patient's internal anatomy within the context of the body," explained Ian Watts, a computing science graduate student and the developer of ProjectDR.

The technology includes a motion-tracking system using infrared cameras and markers on the patient's body, as well as a projector to display the images. But the really difficult part, Watts explained, is having the image track properly on the patient's body even as they shift and move. The solution: custom software written by Watts that gets all of the components working together.

Vast applications

"There are lots of applications for this technology, including in teaching, physiotherapy, laparoscopic surgery and even surgical planning," said Watts, who developed the technology with fellow graduate student Michael Fiest.

ProjectDR also has the capacity to present segmented images - for example, only the lungs or only the blood vessels - depending on what a clinician is interested in seeing.

For now, Watts is working on refining ProjectDR to improve the system's automatic calibration and to add components such as depth sensors. The next steps are testing the program's viability in a clinical setting, explained Pierre Boulanger, professor in the Department of Computing Science.

Next steps

"Soon, we'll deploy ProjectDR in an operating room in a surgical simulation laboratory to test the pros and cons in real-life surgical applications," said Boulanger. "We are also doing pilot studies to test the usability of the system for teaching chiropractic and physical therapy procedures." added Greg Kawchuk, a co-supervisor on the project from the Faculty of Rehabilitation Medicine. Once these pilot studies are complete, the research team expects the deployment of the system in real surgical pilot studies will quickly follow.

Watts is co-supervised by Boulanger, Cisco Chair in Healthcare Solutions and professor in the Faculty of Science, and by Kawchuk, professor in the Faculty of Rehabilitation Medicine.

ProjectDR was presented last November at the Virtual Reality Software and Technology Symposium in Gothenburg, Sweden.

Most Popular Now

Gait Assessed with Body-Worn Sensors may…

Body-worn sensors used at home and in clinic by people with mild Alzheimer's to assess walking could offer a cost-effective way to detect early disease and monitor progression of the...

Applications for the G4A Global Accelera…

Founded in 2013 in Berlin initially giving out grants to innovative healthcare apps, G4A Accelerator is now a global program dedicated to helping innovative health & care startups grow and...

Siemens Healthineers Fully on Track to M…

Siemens Healthineers AG has posted good business figures in the first quarter following its successful initial public offering on March 16, 2018. Year-over-year revenue was up four percent at EUR...

How to Build GDPR and HIPAA Compliant He…

The adoption of cloud and mobile technologies in healthcare is disrupting the services delivery models, and responsibilities and risks for involved actors. By their very nature, eHealth applications collect and...

Computers Equal Radiologists in Assessin…

Automated breast-density evaluation was just as accurate in predicting women's risk of breast cancer, found and not found by mammography, as subjective evaluation done by radiologists, in a study led...

The Big Ethical Questions for Artificial…

AI in healthcare is developing rapidly, with many applications currently in use or in development in the UK and worldwide. The Nuffield Council on Bioethics examines the current and potential...

Consultation: Transformation Health and …

The present report provides an analysis of the results of consultation activities carried out by the European Commission in preparation of a Communication on the Transformation of Health and Care...

Novartis Launches FocalView App, Providi…

Novartis announced the launch of its FocalView app, an ophthalmic digital research platform created with ResearchKit. FocalView aims to allow researchers to track disease progression by collecting real-time, self-reported data...

International Masters's in Medical Infor…

The Master of Science Program in Medical Informatics (MMI) at European Campus Rottal-Inn (ECRI)in Pfarrkirchen - a branch of the Deggendorf University of Applied Sciences (THD - Technische Hochschule Deggendorf)...

Data in the EU: Commission Steps Up Effo…

The European Commission is putting forward a set of measures to increase the availability of data in the EU, building on previous initiatives to boost the free flow of non-personal...

Philips Expands its Sleep & Respirat…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, today announced that it has acquired NightBalance, a digital health scale-up company based in the Netherlands, that has...

A New Way to Watch Brain Activity in Act…

It's a neuroscientist's dream: being able to track the millions of interactions among brain cells in animals that move about freely, behaving as they would under natural circumstances. New technology...