CES Showcases Future Technologies Which Will Impact Clinical Simulation
A massive and crazy fun filled week in Las Vegas just took place with the latest gadgets, electronics, devices, and toys being shown at CES 2020, which brought out a plethora of innovative technologies — some with direct implications for clinical simulation! The Consumer Electronics Show is the world’s biggest technology showcase, highlighting the latest technical achievements from top brands like Sony, Samsung and IBM to new contenders such as Neon and TeslaSuit. Today, we share some of the things we loved from CES 2020 — some of which will surely impact healthcare simulation in the years to come.
NEON: World’s First Realistic Digital Avatar?
Samsung subsidiary STAR Labs unveiled its new “artificial human” project at NEON and the possibilities for medical simulation are inherently obvious. Imagine filming just one simulated patient or medical professional subject once and then being able to make them say or do anything needed to realistically represent a human on screen to learners all over the world. With an AI based learning system that has already started creating its own expressions and conversations beyond what was originally recorded, NEON is clearly demonstrating the potential for dramatic and dynamic human representations. Want to simulate an angry coworker or scared patient in real-time with hyper realistic features and independent thoughts? NEON suggests that one day we can!
Each Neon avatar is “computationally generated” and will hold conversations with users while displaying “emotions and intelligence,” says the company. Their likenesses are modeled after real humans, but have newly generated “expressions, dialogs, and emotion.” Each avatar (known individually as “NEONs”) can be customized for different tasks, and is able to respond to queries “with latency of less than a few milliseconds.”
They’re not intended to be just visual skins for AI assistants, but put to more varying uses instead: “In the near future, one will be able to license or subscribe to a NEON as a service representative, a financial advisor, a healthcare provider, or a concierge. Over time, NEONs will work as TV anchors, spokespeople, or movie actors; or they can simply be companions and friends.” Learn more on NEON’s website!
Next, let’s take a look at a suit designed to help simulationists improve learning mastery…
TeslaSuit Provides Haptic Body Feedback for Mastery Learning
Teslasuit is a human-to-digital interface designed to simulate experience and accelerate mastery in the physical world. The integrated complex of haptics, motion capture, and biometry provides improved human performance. Teslasuit is used in virtual and augmented reality industry as an interface between human and virtuality. Teslasuit, a smart textile two-piece full bodysuit that consists of a jacket and trousers, is a result of work by engineers, designers, programmers, doctors, AR/VR experts.
Teslasuit makes the experience in virtual and augmented reality more realistic and effective through the synergy of systems: haptics, motion capture, and biometry. At present, Teslasuit is intended for integration into a diverse range of enterprise applications and training solutions. In the future, Teslasuit will be widely used in games and entertainment, fitness and sports, wellness and healthcare. The integrated complex of these elements provides improved human performance with Teslasuit.
Teslasuit’s haptic technology allows to transmit touch: it is actually an additional channel of communication and a new way of making VR experience deeper, immersive, and more realistic. Electrostimulation based haptics is proven to increase immersion and improve learning. By means of stimulation of muscles and nerve endings, the human body becomes more alert and active, which favors learning. Learn more on TeslaSuit’s website!
RiVR Provides Affordable VR Training Programs for EMS Providers
Recently we covered how California Firefighter Academy Students Train with Virtual Reality and saw some of the systems in action thanks to RiVR: Reality in Virtual Reality. Alex Harvey explained to us that once a 360 degree camera experience was recorded, it could be immediately uploaded to a fleet of VR headsets backed by Pico’s LMS providing realistic environmental awareness training in real-time. In other words, new fire cadets can experience the start to finish experience of fighting a building fire well before they themselves enter such a dangerous environment.
Reality in Virtual Reality Limited is a developer of Virtual Reality assets in both 360 video and photo realistic virtual reality experiences. Offering immersive training for all industries. They scan any real-world environment and use their RiVR VR Simulation Engine and our VRM (Virtual Reality Monitor) to enable cutting edge training anywhere in the world. With their simulation engine they can capture any location and recreate it in photorealistic virtual reality. RiVR allows users to interact with and experience these worlds, enhancing the way humans learn.
Using custom built photogrammetry rigs, they can also scan any real world object and recreate it as an accurate 3d model. Offering both on and off site solutions to quickly create a large number of items for use in their training experiences or offered as an external service to the film, game or training industry. Watch the video above to see how the Leicestershire Fire service is utilizing RiVR for outstanding learning improvement results. Learn more at RiVR’s website!
Sony Pushes Boundaries on Visual Technologies
Sony showed off some very impressive video technologies ranging from 5G Live Production Cameras, Crystal LED Walls and 3D holograms — we very impressed! Learn more on Sony’s CES 2020 page.
Virtual Production with Atom View: Sony Showcased a virtual production set that captures a part of the Sony Pictures studio lot as photo-realistic volumetric data. What looks like a real and constructed background is actually a rendered digital wall. Immersive Interactive has moving walls for medical simulation right now, but Sony’s technologies are real enough to shoot high quality movies with. But its only a matter of time before the higher quality Sony technologies find their way to our industry!
5G Live Production: Sony Introduced the latest live sports production initiative utilizing 5G technologies which enables the transmission of high-quality video in real-time. In the longterm, 5G technologies will help provide simulation centers with improved video transfer rates which means higher quality imaging!
Eye-sensing Light Field Display: Combining “Eye-sensing” and Sony’s own binocular display technology focus all light field for one viewer which enable super high precision and contrast for best spatial reality experience. This is the absolute closest thing we have seen to a realistic hologram — which we could find a useful tool in 3D educational spatial training opportunities in medicine.
Anatomage Virtual Dissection Table Shows Cardiac Cycle on Digital Cadaver
Anatomage develops digital cadavers, which are available on the Anatomage Table. These cadavers are accurately reconstructed from preserved human bodies and serve as precise references for anatomical studies. The digital bodies have more than 2,500 anatomical structures that are highly detailed and segmented. Each cadaver has a fully detailed cardiovascular system including not only intricately traced arteries and veins, but also segmented chambers, valves, and cardiac conduction branches.
Jack Choi, CEO of Anatomage shared “We are excited that we have achieved real human functions on a cadaver. This is the first time in history that the cadaver has demonstrated a full cardiac cycle in digital simulation – an important beginning. Digital modeling and simulation of physical behavior is a common practice in engineering. It started as crude and simple modeling, but digital modeling and simulations have become so sophisticated that they are replacing physical testings.
Other Technologies From CES with Implications for Simulation in Healthcare
LG TV Screens That Roll Away: LG has unveiled a concept television that rolls up into the ceiling when not in use, removing it from sight. The screen takes advantage of the fact that the OLED technology on which it is based does not have to be kept rigid.
Royle Screens That Are as Flat as Paper: Royole Corporation, a pioneer and the global leader in flexible technology unveils two brand new products during a special launch event at CES 2020 in Las Vegas, USA. Royole aims to transform the way people experience and interact with the world, and is the company behind FlexPai, the world’s first commercial foldable smartphone with a fully flexible display shipped in Q1 2019.
Volumetric Camera Systems for VR Learning: These portable 4D capture systems are able to create high quality and realistic “holograms-in-motion” of people, animals, or any moving subject, suitable for use in Unity or Unreal Engine. Instead of learning just in 360 video recordings, learners can experience a fully 3D environment in VR that better resembles clinical environments. Great potential here!
Genzo Remote Learning Glasses from 1Minuut: The Genzõ communication app lets you chat or call video securely and easily. In addition, the Genzõ app in combination with the Smart Glass can be used for image calling and thus providing expertise without distance. During the image call, you can support, test and guide the Smart Glass carrier. What makes Genzõ so special is that it is designed for and by care staff and carers. The Smart Glass carrier can call during the image to continue exercising his/her daily (nursing) acts, while his/her hands remain free. By creating a profile, you can chat, make video calls and call image with professionals who are both inside and outside your own organization.
Most Fun Thing at CES 2020? VR LaserTag from ArenaVerse of Course!
We had the opportunity to dawn headsets from ArenaVerse and boot up a live Virtual Reality version of LaserTag — and was it ever fun! Up to 8 players can play in a completely virtual environment. From hiding behind virtual walls and shielding against incoming shots, we successfully defeated our enemies with precision shots from our laser guns. So much pewpew! Learn more at ArenaVerseGaming.com!
Lance Baily, BA, EMT-B, is the Founder & CEO of HealthySimulation.com, which he started while serving as the Director of the Nevada System of Higher Education’s Clinical Simulation Center of Las Vegas back in 2010. Lance is also the Founder and acting Advisor to the Board of SimGHOSTS.org, the world’s only non-profit organization dedicated to supporting professionals operating healthcare simulation technologies. His new co-edited Book: “Comprehensive Healthcare Simulation: Operations, Technology, and Innovative Practice” is available now. Lance’s background also includes serving as a Simulation Technology Specialist for the LA Community College District, EMS fire fighting, Hollywood movie production, rescue diving, and global travel. He lives with his wife Abigail in Las Vegas, Nevada.