Virtual Reality is Making Medical Care for Kids Less Scary and Painful
A blood draw is not normally a fun experience, but these days, virtual reality technology is changing that.
Instead of watching a needle go into his arm, a child wearing a VR headset at Children's Hospital Los Angeles can play a game throwing balls at cartoon bears. In Seattle, at the University of Washington, a burn patient can immerse herself in a soothing snow scene. And at the University of Miami Hospital, a five-minute skin biopsy can become an exciting ride at an amusement park.
VR is transforming once-frightening medical encounters for kids, from blood draws to biopsies to pre-surgical prep, into tolerable ones.
It's literally a game changer, says pediatric neurosurgeon Kurtis Auguste, who uses the tool to help explain pending operations to his young patients and their families. The virtual reality 3-D portrait of their brain is recreated from an MRI, originally to help plan the surgery. The image of normally bland tissue is painted with false colors to better see the boundaries and anomalies of each component. It can be rotated, viewed from every possible angle, zoomed in and out; incisions can be made and likely results anticipated. Auguste has extended its use to patients and families.
"The moment you put these headsets on the kids, we immediately have a link, because honestly, this is how they communicate with each other," says Auguste. "We're all sitting around the table playing games. It's really bridged the distance between me, the pediatric specialist, and my patients" at the Benioff Children's Hospital Oakland, now affiliated with the University of California San Francisco School of Medicine.
The VR experience engages people where they are, immersing them in the environment rather than lecturing them. And it seems to work in all environments, across age and cultural differences, leading to a better grasp of what will be undertaken. That understanding is crucial to meaningful informed consent for surgery. It is particularly relevant for safety-net hospitals, which includes most children's hospitals, because often members of the families were born elsewhere and may have limited understanding of English, not to mention advanced medicine.
Targeting pain
"We're trying to target ways that we can decrease pain, anxiety, fear – what people usually experience as a function of a needle," says Jeffrey Gold, a pioneer in adapting VR at Children's Hospital Los Angeles. He ran the pain clinic there and in 2004 initially focused on phlebotomy, simple blood draws. Many of their kids require frequent blood draws to monitor serious chronic conditions such as diabetes, HIV infection, sickle cell disease, and other conditions that affect the heart, liver, kidneys and other organs.
The scientific explanation of how VR works for pain relief draws upon two basic principles of brain function. The first is "top down inhibition," Gold explains. "We all have the inherent capacity to turn down signals once we determine that signal is no longer harmful, dangerous, hurtful, etc. That's how our brain operates on purpose. It's not just a distraction, it's actually your brain stopping the pain signal at the spinal cord before it can fire all the way up to the frontal lobe."
Second is the analgesic effect from endorphins. "If you're in a gaming environment, and you're having fun and you're laughing and giggling, you are actually releasing endorphins...a neurochemical reaction at the synaptic level of the brain," he says.
Part of what makes VR effective is "what's called a cognitive load, where you have to actually learn something and do something," says Gold. He has worked with developers on a game call Bear Blast, which has proven to be effective in a clinical trial for mitigating pain. But he emphasizes, it is not a one-size-fits all; the programs and patients need to be evaluated to understand what works best for each case.
Gold was a bit surprised to find that VR "actually facilitates quicker blood draws," because the staff doesn't have to manage the kids' anxiety, so "they require fewer needle sticks." The kids, parents, and staff were all having a good time, "and that's a big win when everybody is benefiting." About two years ago the hospital made VR an option that patients can request in the phlebotomy lab, and about half of kids age 4 and older choose to do so.
The technology "gets the kids engaged and performing the activity the way we want them to" to maximize recovery.
VR reduces or eliminates the need to use sedation or anesthesia, which carries a small but real risk of an adverse reaction. And important to parents, it eliminates the recovery time from using sedation, which shortens the visit and time missed from school and work.
A more intriguing question is whether reducing fear and anxiety in early-life experiences with the healthcare system through activities like VR will have a long-term affect on kids' attitudes toward medicine as they grow older. "If you're a screaming meemie when you come get your blood draw when you're five or seven, you're still that anxious adolescent or adult who is all quivering and sweating and avoiding healthcare," Gold says. "That's a longitudinal health outcome I'd love to get my hands on in 10-15 years from now."
Broader applications
Dermatologist Hadar Lev-Tov read about the use of VR to treat pain and decided to try it in his practice at the University of Miami Hospital. He thought, "OK, this is low risk, it's easy to do. So we got some equipment and got it done." It was so affordable he paid for it out of his own pocket, rather than wait to go through administrative channels. The results were so interesting that he decided to publish it as a series of case studies with a wide variety of patients and types of procedures.
Some of them, such as freezing off warts, are not particularly painful. "But there can be a lot of anxiety, especially for kids, which can be worse than pain and can disrupt the procedure." It can trigger a non-rational, primal fight or flight response in the limbic region of the brain.
Adults understand the need for a biopsy of a skin growth and tolerate what might be a momentary flick of pain. "But for a kid you think twice about a biopsy, both because it's a hassle and because it could be a traumatic event for a child," says Lev-Tov. VR has helped to allay such fears and improve medical care.
Integrating VR into practice has been relatively easy, primarily focusing on simple training for staff and ensuring that standard infection control practices are used in handling equipment that is used by different patients. More mundane issues are ensuring that the play back and wi-fi equipment are functioning properly. He has had a few complaints from kids when the procedure is competed and the VR is turned off prematurely, which is why he favors programs like a roller coaster ride that lasts about five minutes, ample time to take a biopsy or two.
The future is today
The pediatric neurosurgeon Auguste is collaborating with colleagues at Oakland Children's to expand use of VR into different areas of care. Cancer specialists often use a port, a bubble installed under the skin in the chest of the child, to administer chemotherapy. But the young patient's curiosity often draws their attention downward to the port and their chin can potentially contaminate or obstruct it, interfering with the procedure. So the team developed a VR game involving birds that requires players to move their heads upward, away from the port, improving administration of the drugs and reducing the risk of infection.
Innovative use of VR just may be one tool that actually makes kids eager to visit the doctor.
Other games are being developed for rehabilitation that require the use of specific nerve and muscle combinations. The technology "gets the kids engaged and performing the activity the way we want them to" to maximize recovery, Auguste explains. "We can monitor their progress by the score on the game, and if it plateaus, maybe switch to another game."
Another project is trying to ease the anxiety and confusion of the patient and family experience within the hospital itself. Hospital staff are creating a personalized VR introductory walking tour that leads from the parking garage through the maze of structures and corridors in the hospital complex to Dr. Auguste's office, phlebotomy, the MRI site, and other locations they might visit. The goal is to make them familiar with key landmarks before they even set foot in the facility. "So when they come the day of the visit they have already taken that exact same path, hopefully more than once."
"They don't miss their MRI appointment and therefore they don't miss their clinical appointment with me," says Auguste. It reduces patient anxiety about the encounter and from the hospital's perspective, it will reduce costs of missed and rescheduled visits simply because patients did not go to the right place at the right time.
The VR visit will be emailed to patients ahead of time and they can watch it on a smartphone installed in a disposable cardboard viewer. Oakland Children's hopes to have the system in place by early next year. Auguste says their goal in using VR, like other health care providers across the country, is "to streamline the entire patient experience."
Innovative use of VR just may be one tool that actually makes kids eager to visit the doctor. That would be a boon to kids, parents, and the health of America.
In the 1966 movie "Fantastic Voyage," actress Raquel Welch and her submarine were shrunk to the size of a cell in order to eliminate a blood clot in a scientist's brain. Now, 55 years later, the scenario is becoming closer to reality.
California-based startup Bionaut Labs has developed a nanobot about the size of a grain of rice that's designed to transport medication to the exact location in the body where it's needed. If you think about it, the conventional way to deliver medicine makes little sense: A painkiller affects the entire body instead of just the arm that's hurting, and chemotherapy is flushed through all the veins instead of precisely targeting the tumor.
"Chemotherapy is delivered systemically," Bionaut-founder and CEO Michael Shpigelmacher says. "Often only a small percentage arrives at the location where it is actually needed."
But what if it was possible to send a tiny robot through the body to attack a tumor or deliver a drug at exactly the right location?
Several startups and academic institutes worldwide are working to develop such a solution but Bionaut Labs seems the furthest along in advancing its invention. "You can think of the Bionaut as a tiny screw that moves through the veins as if steered by an invisible screwdriver until it arrives at the tumor," Shpigelmacher explains. Via Zoom, he shares the screen of an X-ray machine in his Culver City lab to demonstrate how the half-transparent, yellowish device winds its way along the spine in the body. The nanobot contains a tiny but powerful magnet. The "invisible screwdriver" is an external magnetic field that rotates that magnet inside the device and gets it to move and change directions.
The current model has a diameter of less than a millimeter. Shpigelmacher's engineers could build the miniature vehicle even smaller but the current size has the advantage of being big enough to see with bare eyes. It can also deliver more medicine than a tinier version. In the Zoom demonstration, the micorobot is injected into the spine, not unlike an epidural, and pulled along the spine through an outside magnet until the Bionaut reaches the brainstem. Depending which organ it needs to reach, it could be inserted elsewhere, for instance through a catheter.
"The hope is that we can develop a vehicle to transport medication deep into the body," says Max Planck scientist Tian Qiu.
Imagine moving a screw through a steak with a magnet — that's essentially how the device works. But of course, the Bionaut is considerably different from an ordinary screw: "At the right location, we give a magnetic signal, and it unloads its medicine package," Shpigelmacher says.
To start, Bionaut Labs wants to use its device to treat Parkinson's disease and brain stem gliomas, a type of cancer that largely affects children and teenagers. About 300 to 400 young people a year are diagnosed with this type of tumor. Radiation and brain surgery risk damaging sensitive brain tissue, and chemotherapy often doesn't work. Most children with these tumors live less than 18 months. A nanobot delivering targeted chemotherapy could be a gamechanger. "These patients really don't have any other hope," Shpigelmacher says.
Of course, the main challenge of the developing such a device is guaranteeing that it's safe. Because tissue is so sensitive, any mistake could risk disastrous results. In recent years, Bionaut has tested its technology in dozens of healthy sheep and pigs with no major adverse effects. Sheep make a good stand-in for humans because their brains and spines are similar to ours.
The Bionaut device is about the size of a grain of rice.
Bionaut Labs
"As the Bionaut moves through brain tissue, it creates a transient track that heals within a few weeks," Shpigelmacher says. The company is hoping to be the first to test a nanobot in humans. In December 2022, it announced that a recent round of funding drew $43.2 million, for a total of 63.2 million, enabling more research and, if all goes smoothly, human clinical trials by early next year.
Once the technique has been perfected, further applications could include addressing other kinds of brain disorders that are considered incurable now, such as Alzheimer's or Huntington's disease. "Microrobots could serve as a bridgehead, opening the gateway to the brain and facilitating precise access of deep brain structure – either to deliver medication, take cell samples or stimulate specific brain regions," Shpigelmacher says.
Robot-assisted hybrid surgery with artificial intelligence is already used in state-of-the-art surgery centers, and many medical experts believe that nanorobotics will be the instrument of the future. In 2016, three scientists were awarded the Nobel Prize in Chemistry for their development of "the world's smallest machines," nano "elevators" and minuscule motors. Since then, the scientific experiments have progressed to the point where applicable devices are moving closer to actually being implemented.
Bionaut's technology was initially developed by a research team lead by Peer Fischer, head of the independent Micro Nano and Molecular Systems Lab at the Max Planck Institute for Intelligent Systems in Stuttgart, Germany. Fischer is considered a pioneer in the research of nano systems, which he began at Harvard University more than a decade ago. He and his team are advising Bionaut Labs and have licensed their technology to the company.
"The hope is that we can develop a vehicle to transport medication deep into the body," says Max Planck scientist Tian Qiu, who leads the cooperation with Bionaut Labs. He agrees with Shpigelmacher that the Bionaut's size is perfect for transporting medication loads and is researching potential applications for even smaller nanorobots, especially in the eye, where the tissue is extremely sensitive. "Nanorobots can sneak through very fine tissue without causing damage."
In "Fantastic Voyage," Raquel Welch's adventures inside the body of a dissident scientist let her swim through his veins into his brain, but her shrunken miniature submarine is attacked by antibodies; she has to flee through the nerves into the scientist's eye where she escapes into freedom on a tear drop. In reality, the exit in the lab is much more mundane. The Bionaut simply leaves the body through the same port where it entered. But apart from the dramatization, the "Fantastic Voyage" was almost prophetic, or, as Shpigelmacher says, "Science fiction becomes science reality."
This article was first published by Leaps.org on April 12, 2021.
How the Human Brain Project Built a Mind of its Own
In 2009, neuroscientist Henry Markram gave an ambitious TED talk. “Our mission is to build a detailed, realistic computer model of the human brain,” he said, naming three reasons for this unmatched feat of engineering. One was because understanding the human brain was essential to get along in society. Another was because experimenting on animal brains could only get scientists so far in understanding the human ones. Third, medicines for mental disorders weren’t good enough. “There are two billion people on the planet that are affected by mental disorders, and the drugs that are used today are largely empirical,” Markram said. “I think that we can come up with very concrete solutions on how to treat disorders.”
Markram's arguments were very persuasive. In 2013, the European Commission launched the Human Brain Project, or HBP, as part of its Future and Emerging Technologies program. Viewed as Europe’s chance to try to win the “brain race” between the U.S., China, Japan, and other countries, the project received about a billion euros in funding with the goal to simulate the entire human brain on a supercomputer, or in silico, by 2023.
Now, after 10 years of dedicated neuroscience research, the HBP is coming to an end. As its many critics warned, it did not manage to build an entire human brain in silico. Instead, it achieved a multifaceted array of different goals, some of them unexpected.
Scholars have found that the project did help advance neuroscience more than some detractors initially expected, specifically in the area of brain simulations and virtual models. Using an interdisciplinary approach of combining technology, such as AI and digital simulations, with neuroscience, the HBP worked to gain a deeper understanding of the human brain’s complicated structure and functions, which in some cases led to novel treatments for brain disorders. Lastly, through online platforms, the HBP spearheaded a previously unmatched level of global neuroscience collaborations.
Simulating a human brain stirs up controversy
Right from the start, the project was plagued with controversy and condemnation. One of its prominent critics was Yves Fregnac, a professor in cognitive science at the Polytechnic Institute of Paris and research director at the French National Centre for Scientific Research. Fregnac argued in numerous articles that the HBP was overfunded based on proposals with unrealistic goals. “This new way of over-selling scientific targets, deeply aligned with what modern society expects from mega-sciences in the broad sense (big investment, big return), has been observed on several occasions in different scientific sub-fields,” he wrote in one of his articles, “before invading the field of brain sciences and neuromarketing.”
"A human brain model can simulate an experiment a million times for many different conditions, but the actual human experiment can be performed only once or a few times," said Viktor Jirsa, a professor at Aix-Marseille University.
Responding to such critiques, the HBP worked to restructure the effort in its early days with new leadership, organization, and goals that were more flexible and attainable. “The HBP got a more versatile, pluralistic approach,” said Viktor Jirsa, a professor at Aix-Marseille University and one of the HBP lead scientists. He believes that these changes fixed at least some of HBP’s issues. “The project has been on a very productive and scientifically fruitful course since then.”
After restructuring, the HBP became a European hub on brain research, with hundreds of scientists joining its growing network. The HBP created projects focused on various brain topics, from consciousness to neurodegenerative diseases. HBP scientists worked on complex subjects, such as mapping out the brain, combining neuroscience and robotics, and experimenting with neuromorphic computing, a computational technique inspired by the human brain structure and function—to name just a few.
Simulations advance knowledge and treatment options
In 2013, it seemed that bringing neuroscience into a digital age would be farfetched, but research within the HBP has made this achievable. The virtual maps and simulations various HBP teams create through brain imaging data make it easier for neuroscientists to understand brain developments and functions. The teams publish these models on the HBP’s EBRAINS online platform—one of the first to offer access to such data to neuroscientists worldwide via an open-source online site. “This digital infrastructure is backed by high-performance computers, with large datasets and various computational tools,” said Lucy Xiaolu Wang, an assistant professor in the Resource Economics Department at the University of Massachusetts Amherst, who studies the economics of the HBP. That means it can be used in place of many different types of human experimentation.
Jirsa’s team is one of many within the project that works on virtual brain models and brain simulations. Compiling patient data, Jirsa and his team can create digital simulations of different brain activities—and repeat these experiments many times, which isn’t often possible in surgeries on real brains. “A human brain model can simulate an experiment a million times for many different conditions,” Jirsa explained, “but the actual human experiment can be performed only once or a few times.” Using simulations also saves scientists and doctors time and money when looking at ways to diagnose and treat patients with brain disorders.
Compiling patient data, scientists can create digital simulations of different brain activities—and repeat these experiments many times.
The Human Brain Project
Simulations can help scientists get a full picture that otherwise is unattainable. “Another benefit is data completion,” added Jirsa, “in which incomplete data can be complemented by the model. In clinical settings, we can often measure only certain brain areas, but when linked to the brain model, we can enlarge the range of accessible brain regions and make better diagnostic predictions.”
With time, Jirsa’s team was able to move into patient-specific simulations. “We advanced from generic brain models to the ability to use a specific patient’s brain data, from measurements like MRI and others, to create individualized predictive models and simulations,” Jirsa explained. He and his team are working on this personalization technique to treat patients with epilepsy. According to the World Health Organization, about 50 million people worldwide suffer from epilepsy, a disorder that causes recurring seizures. While some epilepsy causes are known others remain an enigma, and many are hard to treat. For some patients whose epilepsy doesn’t respond to medications, removing part of the brain where seizures occur may be the only option. Understanding where in the patients’ brains seizures arise can give scientists a better idea of how to treat them and whether to use surgery versus medications.
“We apply such personalized models…to precisely identify where in a patient’s brain seizures emerge,” Jirsa explained. “This guides individual surgery decisions for patients for which surgery is the only treatment option.” He credits the HBP for the opportunity to develop this novel approach. “The personalization of our epilepsy models was only made possible by the Human Brain Project, in which all the necessary tools have been developed. Without the HBP, the technology would not be in clinical trials today.”
Personalized simulations can significantly advance treatments, predict the outcome of specific medical procedures and optimize them before actually treating patients. Jirsa is watching this happen firsthand in his ongoing research. “Our technology for creating personalized brain models is now used in a large clinical trial for epilepsy, funded by the French state, where we collaborate with clinicians in hospitals,” he explained. “We have also founded a spinoff company called VB Tech (Virtual Brain Technologies) to commercialize our personalized brain model technology and make it available to all patients.”
The Human Brain Project created a level of interconnectedness within the neuroscience research community that never existed before—a network not unlike the brain’s own.
Other experts believe it’s too soon to tell whether brain simulations could change epilepsy treatments. “The life cycle of developing treatments applicable to patients often runs over a decade,” Wang stated. “It is still too early to draw a clear link between HBP’s various project areas with patient care.” However, she admits that some studies built on the HBP-collected knowledge are already showing promise. “Researchers have used neuroscientific atlases and computational tools to develop activity-specific stimulation programs that enabled paraplegic patients to move again in a small-size clinical trial,” Wang said. Another intriguing study looked at simulations of Alzheimer’s in the brain to understand how it evolves over time.
Some challenges remain hard to overcome even with computer simulations. “The major challenge has always been the parameter explosion, which means that many different model parameters can lead to the same result,” Jirsa explained. An example of this parameter explosion could be two different types of neurodegenerative conditions, such as Parkinson’s and Huntington’s diseases. Both afflict the same area of the brain, the basal ganglia, which can affect movement, but are caused by two different underlying mechanisms. “We face the same situation in the living brain, in which a large range of diverse mechanisms can produce the same behavior,” Jirsa said. The simulations still have to overcome the same challenge.
Understanding where in the patients’ brains seizures arise can give scientists a better idea of how to treat them and whether to use surgery versus medications.
The Human Brain Project
A network not unlike the brain’s own
Though the HBP will be closing this year, its legacy continues in various studies, spin-off companies, and its online platform, EBRAINS. “The HBP is one of the earliest brain initiatives in the world, and the 10-year long-term goal has united many researchers to collaborate on brain sciences with advanced computational tools,” Wang said. “Beyond the many research articles and projects collaborated on during the HBP, the online neuroscience research infrastructure EBRAINS will be left as a legacy even after the project ends.”
Those who worked within the HBP see the end of this project as the next step in neuroscience research. “Neuroscience has come closer to very meaningful applications through the systematic link with new digital technologies and collaborative work,” Jirsa stated. “In that way, the project really had a pioneering role.” It also created a level of interconnectedness within the neuroscience research community that never existed before—a network not unlike the brain’s own. “Interconnectedness is an important advance and prerequisite for progress,” Jirsa said. “The neuroscience community has in the past been rather fragmented and this has dramatically changed in recent years thanks to the Human Brain Project.”
According to its website, by 2023 HBP’s network counted over 500 scientists from over 123 institutions and 16 different countries, creating one of the largest multi-national research groups in the world. Even though the project hasn’t produced the in-silico brain as Markram envisioned it, the HBP created a communal mind with immense potential. “It has challenged us to think beyond the boundaries of our own laboratories,” Jirsa said, “and enabled us to go much further together than we could have ever conceived going by ourselves.”