Augmented Reality System Lets Doctors See under Patients' Skin without the Scalpel

New technology is bringing the power of augmented reality into clinical practice. The system, called ProjectDR, allows medical images such as CT scans and MRI data to be displayed directly on a patient's body in a way that moves as the patient does.

"We wanted to create a system that would show clinicians a patient's internal anatomy within the context of the body," explained Ian Watts, a computing science graduate student and the developer of ProjectDR.

The technology includes a motion-tracking system using infrared cameras and markers on the patient's body, as well as a projector to display the images. But the really difficult part, Watts explained, is having the image track properly on the patient's body even as they shift and move. The solution: custom software written by Watts that gets all of the components working together.

Vast applications

"There are lots of applications for this technology, including in teaching, physiotherapy, laparoscopic surgery and even surgical planning," said Watts, who developed the technology with fellow graduate student Michael Fiest.

ProjectDR also has the capacity to present segmented images - for example, only the lungs or only the blood vessels - depending on what a clinician is interested in seeing.

For now, Watts is working on refining ProjectDR to improve the system's automatic calibration and to add components such as depth sensors. The next steps are testing the program's viability in a clinical setting, explained Pierre Boulanger, professor in the Department of Computing Science.

Next steps

"Soon, we'll deploy ProjectDR in an operating room in a surgical simulation laboratory to test the pros and cons in real-life surgical applications," said Boulanger. "We are also doing pilot studies to test the usability of the system for teaching chiropractic and physical therapy procedures." added Greg Kawchuk, a co-supervisor on the project from the Faculty of Rehabilitation Medicine. Once these pilot studies are complete, the research team expects the deployment of the system in real surgical pilot studies will quickly follow.

Watts is co-supervised by Boulanger, Cisco Chair in Healthcare Solutions and professor in the Faculty of Science, and by Kawchuk, professor in the Faculty of Rehabilitation Medicine.

ProjectDR was presented last November at the Virtual Reality Software and Technology Symposium in Gothenburg, Sweden.

Most Popular Now

Open Call SC1-DTH-01-2019: Big Data and …

Currently available methods and strategies for diagnosis and treatment of cancer help clinicians continuously improve quality of care and prevent cancer deaths in the population. Accurate risk assessment, availability of...

Cerner Selected for NHS Framework to Sup…

Integrated Care Systems (ICS) and Sustainability and Transformation Partnerships (STPs) aim to deliver the best possible quality of health and care, shift to value-based care and proactively improve outcomes for...

Brainlab and Magic Leap Partner in Digit…

Brainlab has announced a strategic development partnership with Florida-based Magic Leap, a developer of proprietary spatial computing solutions that help users enrich their real world experience by integrating digital content...

The Merck Accelerator Program 2019

The Merck Accelerator is looking for real partners so that you can work together in shaping the future. With programs in the headquarters in Germany, in China and the Satellites...

Whole-Brain Connectome Maps Teach Artifi…

Medical University of South Carolina (MUSC) neurologists have developed a new method based on artificial intelligence that may eventually help both patients and doctors weigh the pros and cons of...

MEDICA 2018: The Starting Block for Many…

12 - 15 November 2018, Düsseldorf, Germany. MEDICA, the world’s leading medical trade fair in Düsseldorf which attracts over 5,000 exhibitors from around 70 countries, is becoming an even bigger hotspot...

MEDICA 2018 Presents the Future of Medic…

12 - 15 November 2018, Düsseldorf, Germany. Artificial intelligence, Big Data or IoT (Internet of Things) - we would be hard pressed to find a sector that doesn’t have these terms...

Artificial Intelligence for Health: ITU …

The ITU Focus Group on 'AI for Health' (FG-AI4H), created in collaboration with the World Health Organization (WHO), has issued a Call for Proposals to identify compelling use cases of...

Siemens Healthineers and STORZ MEDICAL P…

On the occasion of the 70th annual congress of the German Society for Urology, DGU, Siemens Healthineers and STORZ MEDICAL have announced plans to enter into a sales partnership agreement...

Spinal Cord Stimulation, Physical Therap…

Spinal cord stimulation and physical therapy have helped a man paralyzed since 2013 regain his ability to stand and walk with assistance. The results, achieved in a research collaboration between...

Sandoz Healthcare Access Challenge #Sand…

Sandoz, the Novartis generics and biosimilars division, today announces the launch of the second Sandoz Healthcare Access Challenge (HACk). The #SandozHACk is a global competition that invites entrepreneurs and innovators...

Connecting Care Goes Live with a Care Co…

The Connecting Care Interoperability Programme has gone live with its first Care Connect FHIR API so staff working with homeless and vulnerable people can see if they have a prescription...