Augmented Reality System Lets Doctors See under Patients' Skin without the Scalpel

New technology is bringing the power of augmented reality into clinical practice. The system, called ProjectDR, allows medical images such as CT scans and MRI data to be displayed directly on a patient's body in a way that moves as the patient does.

"We wanted to create a system that would show clinicians a patient's internal anatomy within the context of the body," explained Ian Watts, a computing science graduate student and the developer of ProjectDR.

The technology includes a motion-tracking system using infrared cameras and markers on the patient's body, as well as a projector to display the images. But the really difficult part, Watts explained, is having the image track properly on the patient's body even as they shift and move. The solution: custom software written by Watts that gets all of the components working together.

Vast applications

"There are lots of applications for this technology, including in teaching, physiotherapy, laparoscopic surgery and even surgical planning," said Watts, who developed the technology with fellow graduate student Michael Fiest.

ProjectDR also has the capacity to present segmented images - for example, only the lungs or only the blood vessels - depending on what a clinician is interested in seeing.

For now, Watts is working on refining ProjectDR to improve the system's automatic calibration and to add components such as depth sensors. The next steps are testing the program's viability in a clinical setting, explained Pierre Boulanger, professor in the Department of Computing Science.

Next steps

"Soon, we'll deploy ProjectDR in an operating room in a surgical simulation laboratory to test the pros and cons in real-life surgical applications," said Boulanger. "We are also doing pilot studies to test the usability of the system for teaching chiropractic and physical therapy procedures." added Greg Kawchuk, a co-supervisor on the project from the Faculty of Rehabilitation Medicine. Once these pilot studies are complete, the research team expects the deployment of the system in real surgical pilot studies will quickly follow.

Watts is co-supervised by Boulanger, Cisco Chair in Healthcare Solutions and professor in the Faculty of Science, and by Kawchuk, professor in the Faculty of Rehabilitation Medicine.

ProjectDR was presented last November at the Virtual Reality Software and Technology Symposium in Gothenburg, Sweden.

Most Popular Now

Apple Health Records Available for Allsc…

Allscripts (NASDAQ: MDRX) announced that Apple Health Records is now available for Allscripts Sunrise™, TouchWorks® and Professional EHR™ clients and their patients. Health Records brings together hospitals, clinics and the...

Philips Signs Agreement to Create Taiwan…

Royal Philips (NYSE: PHG, AEX: PHIA), a global leader in health technology, today announced that Taipei Veterans General Hospital (TPVGH) will utilize the Philips IntelliSite Pathology Solution to transform its...

Robotic Thread is Designed to Slip throu…

MIT engineers have developed a magnetically steerable, thread-like robot that can actively glide through narrow, winding pathways, such as the labrynthine vasculature of the brain. In the future, this robotic...

St Helens and Knowsley Advance with Ambi…

St Helens and Knowsley Teaching Hospitals NHS Trusthas successfully gone live with System C’s CareFlow Vitals as part of its ambitious strategy to accelerate digitisation and become a digital exemplar...

Machine Learning Improves the Diagnosis …

Researchers from Charité - Universitätsmedizin Berlin and the German Cancer Consortium (DKTK) have successfully solved a longstanding problem in the diagnosis of head and neck cancers. Working alongside colleagues from...

Experimental Validation Confirms the Abi…

Insilico Medicine, a global leader in artificial intelligence for drug discovery, today announced the publication of a paper titled, "Deep learning enables rapid identification of potent DDR1 kinase inhibitors," in...

Using a Smartphone to Detect Norovirus

A little bit of norovirus - the highly infectious microbe that causes about 20 million cases of food poisoning in the United States each year - goes a long way...

Computer Model could Help Test New Sickl…

A team of Brown University researchers has developed a new computer model that simulates the way red blood cells become misshapen by sickle cell disease. The model, described in a...

The Future of Mind Control

Electrodes implanted in the brain help alleviate symptoms like the intrusive tremors associated with Parkinson's disease. But current probes face limitations due to their size and inflexibility. "The brain is...

Medical Informatics Europe Conference 20…

28 April - 1 May 2020, Geneva, Switzerland. The European Federation of Medical Informatics (EFMI) presents the 30th Medical Informatics Europe conference (MIE) at the Geneva International Conference Center (CICG). This...