Augmented Reality System Lets Doctors See under Patients' Skin without the Scalpel

New technology is bringing the power of augmented reality into clinical practice. The system, called ProjectDR, allows medical images such as CT scans and MRI data to be displayed directly on a patient's body in a way that moves as the patient does.

"We wanted to create a system that would show clinicians a patient's internal anatomy within the context of the body," explained Ian Watts, a computing science graduate student and the developer of ProjectDR.

The technology includes a motion-tracking system using infrared cameras and markers on the patient's body, as well as a projector to display the images. But the really difficult part, Watts explained, is having the image track properly on the patient's body even as they shift and move. The solution: custom software written by Watts that gets all of the components working together.

Vast applications

"There are lots of applications for this technology, including in teaching, physiotherapy, laparoscopic surgery and even surgical planning," said Watts, who developed the technology with fellow graduate student Michael Fiest.

ProjectDR also has the capacity to present segmented images - for example, only the lungs or only the blood vessels - depending on what a clinician is interested in seeing.

For now, Watts is working on refining ProjectDR to improve the system's automatic calibration and to add components such as depth sensors. The next steps are testing the program's viability in a clinical setting, explained Pierre Boulanger, professor in the Department of Computing Science.

Next steps

"Soon, we'll deploy ProjectDR in an operating room in a surgical simulation laboratory to test the pros and cons in real-life surgical applications," said Boulanger. "We are also doing pilot studies to test the usability of the system for teaching chiropractic and physical therapy procedures." added Greg Kawchuk, a co-supervisor on the project from the Faculty of Rehabilitation Medicine. Once these pilot studies are complete, the research team expects the deployment of the system in real surgical pilot studies will quickly follow.

Watts is co-supervised by Boulanger, Cisco Chair in Healthcare Solutions and professor in the Faculty of Science, and by Kawchuk, professor in the Faculty of Rehabilitation Medicine.

ProjectDR was presented last November at the Virtual Reality Software and Technology Symposium in Gothenburg, Sweden.

Most Popular Now

Top 20 Breaking eHealth News of 2018

eHealthNews.eu proudly presents the top 20 most popular breaking eHealth news from 2018. Have a wonderful 2019 New(s) Year filled with health, happiness, and spectacular success!

Artificial Intelligence Advances Threate…

Advances in artificial intelligence have created new threats to the privacy of people's health data, a new University of California, Berkeley, study shows. Led by UC Berkeley engineer Anil Aswani...

Shaping Cloud Selects Highland Marketing…

Public sector cloud transformation specialists Shaping Cloud have chosen Highland Marketing as their marketing and PR partner to help them deliver their growth ambitions in the burgeoning health and care...

Artificial Intelligence System Learns to…

A team of investigators from the Massachusetts General Hospital (MGH) Department of Radiology has developed a system using artificial intelligence to quickly diagnose and classify brain hemorrhages and to provide...

Rewired Pitchfest Launched to Showcase B…

Digital health innovators and start-ups are invited to pitch their disruptive ideas and prototypes to NHS digital leaders and leading healthtech investors at the new Digital Health Rewired event next...

Allscripts Joins with Microsoft to Explo…

Today, Allscripts (NASDAQ:MDRX), a global leader in health care information technology, announced a collaboration with Microsoft focused on implementing an innovative, integrated model for clinical research, aiming to enhance clinical...

Merck Welcomes Ten New Startups to its I…

Merck, a leading science and technology company, today announced the ten startups that will be joining the seventh intake of its Accelerator program at the Merck Innovation Center in Darmstadt...

First Smartphone App to Detect Opioid Ov…

At least 115 people die every day in the U.S. after overdosing on opioids, according to the National Institute on Drug Abuse. And in 2016, illegal injectable opioids became the...

Stanford Researchers Create a Wireless, …

A new device developed by Stanford University researchers could make it easier for doctors to monitor the success of blood vessel surgery. The sensor, detailed in a paper published Jan...

AI Approach Outperformed Human Experts i…

A research team led by investigators from the National Institutes of Health and Global Good has developed a computer algorithm that can analyze digital images of a woman's cervix and...

Digital Health Consultancy Invests in Cy…

Digital health consultancy Populo Consulting has secured Cyber Essentials Plus certification, in a move that demonstrates its commitment to operating to the same high standards as its NHS clients. Cyber Essentials...