Augmented Reality in Medicine

Since Robert Mann introduced the first virtual system in medicine in 1965, Augmented Reality has forever changed the way Physicians and practitioners go about caring for their patients. A revolutionary advancement in the realm of medicine, Augmented Reality, also known simply as “AR”, provides learners with an interactive experience of a real-world environment where the objects are enhanced by computer-generated perceptual information. This is all regardless of the physical setting, whether that be an operating room, clinic or classroom.

Benefits of Augmented Reality

The objects can be generated across multiple sensory modalities, including visual, auditory, haptic, somatosensory and olfactory. This all occurs amidst a virtual space where physiological data from multiple sources can merge in real time. This maturing technology has since made possible imaging 3-D anatomical information actually overlaid on top of the patient.

Sponsored Content:

Oftentimes the objects are generated using displays that are worn directly in front of the eyes, and that overlay information onto the world of the viewer. A single AR display that integrates all imaging and patient data and allows doctors to keep their eyes on the patient has the potential to improve quality, safety and reduce cost by decreasing procedure-related complications.

Another benefit of the implementation of Augmented Reality in medicine is that the technology will likely reduce costs caused by safer procedures and by eliminating the need for redundant screens. Currently ultrasound, endoscopy, and bronchoscopy all require hospitals to buy costly systems, each with a separate display. Alternatively, Augmented Reality can provide a shared display, reducing the need for a dedicated monitor for each aspect of a patient’s data over time.

Although this technology has not been readily integrated into common societal use, Augmented Reality is expanding rapidly in professional context. This is because the potential benefits stemming from the use of Augmented Reality for educational and training purposes are immeasurable.

For example, Augmented Reality has been shown to have great purpose across surgery and surgical training. According to the Harvard Business Review article “How Augmented Reality Will Make Surgery Safer,” Augmented Reality’s potential ability to concurrently display imaging data and other patient information could save lives and decrease medical errors. Augmented Reality could also potentially transform Electronic Medical Records by providing a means by which Physicians and Practitioners do not need to turn away from a patient to look at a monitor.

Sponsored Content:

However, the article’s authors, Sarah Murthi, MD and Amitabh Varshney clearly establish that the technology is still in relatively early stages. Considering Augmented Reality is in such early phases, there are a number of challenges that will need to be overcome to expand the technology’s use across the medical community.

One challenge of Augmented Reality is that hardware needs to be advanced to fit securely and comfortably on a practitioner’s head. The images also need quality advancements that will enable them to be as opaque as possible, while for others they will need to be more translucent. Another technical challenge impacting Augmented Reality use is that, if the projected images are being used for operative guidance, they need to be positioned with extreme accuracy.

Despite these challenges, the future of Augmented Reality being used across medicine for training and education is bright. From brain surgery to reconnecting blood vessels research teams across the world are working closely with Augmented Reality technology companies. Today, teams at Stanford, Duke and Johns Hopkins are all working to merge and project visual data, while simultaneously creating Augmented Reality displays ideal for patient care, the Harvard Business Review reports.

Augmented Reality Products

One type of relatively well-known Augmented Reality that could be used in medical simulation product is Google Glass, a brand of smart glasses with an optical head-mounted display. The display is designed in the shape of a pair of eyeglasses so that Google Glass can exhibit information in a smartphone-like, hands-free format. Pairing with smart glasses, a few AR software companies have developed an ultrasound scanner, which with the help of products like Google Glass work as a traditional one. is dedicated to providing the latest Augmented Reality news and #MedSim resources from around the world. To follow along, sign up for our free medical simulation email newsletter, follow @HealthySim on Twitter and @HealthySim on Facebook, or join our HealthySim LinkedIn Group!

Another Augmented Reality option, a team of researchers at Imperial College London at St. Mary’s Hospital in London, England have demonstrated how Mixed Reality and Microsoft HoloLens headsets can be used while operating on patients undergoing reconstructive lower limb surgery. According to the Imperial Team, the technology can help surgeons locate and reconnect key blood vessels during reconstructive surgery.

This technique could help to improve outcomes for patients. Using HoloLens, Practitioners and learners can overlay scan images onto the patient during the operation. This is so they can see elements like bones, the course of the blood vessels and identify exactly where the targets are located.

Also on the market, an Augmented Reality system called ProjectDR, created by computing science graduate students Ian Watts and Michael Fiest at the University of Alberta in Canada, allows medical images such as CT scans and MRI data to be displayed directly on a patient’s body. Then, the image moves as the patient moves thanks to custom software, giving the practitioner a full view of the patient’s internal anatomy.

Click Here to Connect to Leading Medical Simulation AR Vendors

According to the developers, ProjectDR also has the capacity to present segmented images. This means the software is capable of showing only the lungs or the blood vessels. The exact body part needing imaging will depend on what a practitioner is required to see, leaving out any other distraction and achieving more focus in the targeted area.

In the coming years, U.S.-based Magic Leap and Munich-based Brainlab are also hoping to add an innovative dimension to surgical procedures and medical imaging in an operating system through Augmented Reality for craniotomy planning. Their operating system combines medical technology company Brainlab’s data management, cloud computing, visualization, and data pre-processing software with Augmented Reality technology company Magic Leap’s spatial computing and experiential platforms.

According to the companies, the first release of the product promises to enable surgical planning and simulation in an office setting. The companies also says this will quickly be expanded to include a next-generation mix of virtual and physical worlds for the operating room, radiotherapy treatment room, intensive care unit, and radiology suite.

AR in Medicine Latest News

Dr Hologram UCF

UCF Installs Impressive Dr. Hologram Technology to Improve Healthcare Simulation Education

Today's most innovative hologram technology is now being used in the academic setting to provide unique healthcare simulation education experiences. This Fall, the University of Central Florida (UCF) will be ...
Read More
Axon Park

Axon Park Expands VR Course Offerings to Meet Virtual Learning Demand

As more medical training facilities turn to healthcare simulation as a virtual means of instruction amid COVID-19, virtual reality and e-learning solutions have been met with demand like never before ...
Read More
Magic Leap

Magic Leap Could ‘Leap’ into AR-Focused Healthcare Solutions Market

Magic Leap is an augmented reality (AR) company that works to amplify human potential through a transformational impact on professional productivity. According to Business Insider, Magic Leap cut half the ...
Read More
healthy simulation webinars

June 2021 Webinars

The webinar platform hosts a number of informative healthcare simulation webinars each month. These presentations are designed to cover a range of topics related to clinical simulation, including education, ...
Read More
Avkin Wearable Simulators

NCLEX Changes Require Human Component During Clinical Simulation

For some time now, hospital administrators and staff have found that many novice nurses lack the skills necessary for treating patients. To address this gap, the National Council of State ...
Read More
WHO Academy PPE Course

WHO Academy Develops Mobile Augmented Reality PPE Course

The WHO Academy launched an app that has a new feature that deploys augmented reality (AR) technology to help health workers address a critical challenge that many face every day ...
Read More

MedReality Releases 3D Covid-19 Lung Model to Download

MedReality has announced the world’s first public release of a 3D model of lungs severely damaged by COVID-19. The model was created from an actual patient with severe COVID-19 Illness ...
Read More
MedCognition PerSim

How PerSim Helps Learners Overcome ER Training Barriers

In many instances, the COVID-19 pandemic changed the ways educators are able to provide instruction to learners. Prior to COVID-19, team emergency training could take place in-situ clinical spaces, but ...
Read More

Visualizing the Future for Health Professions Education

Pamela J. Boyers, Ph.D., MA, associate vice chancellor of clinical simulation at the Interprofessional Experiential Center for Enduring Learning (iEXCEL) at the University of Nebraska Medical Center (UNMC), will be ...
Read More
HoloPatient Remote

GIGXR Helps Nursing Programs Teach Clinical Reasoning, Meet Clinical Simulation Requirements

Helping future nursing professionals master vital skills of observation, diagnosis and treatment has never been more important. Specifically, as clinical placements become more competitive and the overall nursing sector becomes ...
Read More

MetaHumans Leads Digital Human Creation Through Cloud-Streamed App

MetaHuman Creator is a cloud-streamed app that takes real-time digital human creation from weeks or even months to less than an hour—at an unprecedented standard of quality, fidelity and realism ...
Read More
Allan Hamilton

Simterviews: Dr. Allan Hamilton | Executive Director, ASTEC

This week,’s new healthcare simulation expert interview series “Simterviews” speaks with Dr. Allan Hamilton, MD, FACS, the executive director of the Arizona Simulation Technology and Education Center (ASTEC). Hamilton ...
Read More

Subscribe for the Latest AR in Medicine News!

Sponsored Content: