Augmented Reality System Lets Doctors See under Patients' Skin without the Scalpel

New technology is bringing the power of augmented reality into clinical practice. The system, called ProjectDR, allows medical images such as CT scans and MRI data to be displayed directly on a patient's body in a way that moves as the patient does.

"We wanted to create a system that would show clinicians a patient's internal anatomy within the context of the body," explained Ian Watts, a computing science graduate student and the developer of ProjectDR.

The technology includes a motion-tracking system using infrared cameras and markers on the patient's body, as well as a projector to display the images. But the really difficult part, Watts explained, is having the image track properly on the patient's body even as they shift and move. The solution: custom software written by Watts that gets all of the components working together.

Vast applications

"There are lots of applications for this technology, including in teaching, physiotherapy, laparoscopic surgery and even surgical planning," said Watts, who developed the technology with fellow graduate student Michael Fiest.

ProjectDR also has the capacity to present segmented images - for example, only the lungs or only the blood vessels - depending on what a clinician is interested in seeing.

For now, Watts is working on refining ProjectDR to improve the system's automatic calibration and to add components such as depth sensors. The next steps are testing the program's viability in a clinical setting, explained Pierre Boulanger, professor in the Department of Computing Science.

Next steps

"Soon, we'll deploy ProjectDR in an operating room in a surgical simulation laboratory to test the pros and cons in real-life surgical applications," said Boulanger. "We are also doing pilot studies to test the usability of the system for teaching chiropractic and physical therapy procedures." added Greg Kawchuk, a co-supervisor on the project from the Faculty of Rehabilitation Medicine. Once these pilot studies are complete, the research team expects the deployment of the system in real surgical pilot studies will quickly follow.

Watts is co-supervised by Boulanger, Cisco Chair in Healthcare Solutions and professor in the Faculty of Science, and by Kawchuk, professor in the Faculty of Rehabilitation Medicine.

ProjectDR was presented last November at the Virtual Reality Software and Technology Symposium in Gothenburg, Sweden.

Most Popular Now

Doctors Rely on More than Just Data for …

Many technology companies are working on artificial intelligence systems that can analyze medical data to help diagnose or treat health problems. Such systems raise the question of whether this kind...

App, Brief Intervention may be Lifesaver…

A troubled teenager is hospitalized with suicidal thoughts. The patient is diagnosed, medicated, and counseled by a team of experts. The teen is sent home a few days later, and...

New Coalition of Philanthropists Includi…

Philanthropist Bill Gates and the Alzheimer's Drug Discovery Foundation (ADDF) co-founder Leonard Lauder have announced a new initiative, Diagnostics Accelerator, to develop novel biomarkers for the early detection of Alzheimer's...

IMI Launches New Antimicrobial Resistanc…

A new Antimicrobial Resistance (AMR) Accelerator Programme is part of new Calls for proposals launched today by the Innovative Medicines Initiative (IMI). Of the other topics launched in the Calls...

Wearable Devices and Mobile Health Techn…

With increasing efforts being made to address the current global obesity epidemic, wearable devices and mobile health ("mHealth") technology have emerged as promising tools for promoting physical activity. However, current...

Frontiers Health 2018

15 - 16 November 2018, Berlin, Germany. Frontiers Health has fast become one of the premiere conferences in the digital health space, combining a unique mix of attendees and presenters from...

Digital Health to Disrupt Health IT Mark…

25 - 26 March 2019, London, United Kingdom. Digital Health - publishers of digitalhealth.net and organisers of the CCIO, CNIO, CIO Networks and annual Summer Schools - is to shake up...

Bayer Cares Foundation Promotes Sustaina…

Grants4Impact (G4I), a new energizer program launched by Bayer Cares Foundation, is providing targeted support to social impact pioneers and start-ups in the fields of healthcare and nutrition. The aim...

Philips and Oxford University Hospitals …

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, and Oxford University Hospitals (OUH) NHS Foundation Trust, announced plans to create a digital pathology network to help...

Maidstone and Tunbridge Wells NHS Trust …

Maidstone and Tunbridge Wells NHS Trust has selected Allscripts Sunrise as its electronic health record, in a move that further solidifies the company's position in the South East of England...

Start Alliance Berlin: Digital Health

Start Alliance Berlin: Digital Health is a two-week program taking place in November 2018 which is intended to help startups from BEIJING, DUBAI, NEW YORK, LONDON, PARIS, SHANGHAI, TEL AVIV...