Scientists Jason Schrum and Kerry Benenato solved crucial challenges in mRNA vaccine development.
Derrick Rossi, a scientist at MIT, and Noubar Afeyan, a Cambridge-based investor, launched Moderna in September 2010. Their idea was to create mRNA molecules capable of delivering instructions to the body's cells, directing them to make proteins to heal ailments and cure disease. Need a statin, immunosuppressive, or other drug or vaccine? Just use mRNA to send a message to the body's cells to produce it. Rossi and Afeyan were convinced injecting mRNA into the body could turn it into its own laboratory, generating specific medications or vaccines as needed.
At the time, the notion that one might be able to teach the body to make proteins bordered on heresy. Everyone knew mRNA was unstable and set off the body's immune system on its way into cells. But in the late 2000's, two scientists at the University of Pennsylvania, Katalin Karikó and Drew Weissman, had figured out how to modify mRNA's chemical building blocks so the molecule could escape the notice of the immune system and enter the cell. Rossi and Afeyan couldn't convince the University of Pennsylvania to license Karikó and Weissman's patent, however, stymying Moderna's early ambitions. At the same time, the Penn scientists' technique seemed more applicable to an academic lab than a biotech company that needed to produce drugs or shots consistently and in bulk. Rossi and Afeyan's new company needed their own solution to help mRNA evade the body's defenses.
Some of Moderna's founders doubted Schrum could find success and they worried if their venture was doomed from the start.
The Scientist Who Modified mRNA: Jason Schrum
In 2010, Afeyan's firm subleased laboratory space in the basement of another Cambridge biotech company to begin scientific work. Afeyan chose a young scientist on his staff, Jason Schrum, to be Moderna's first employee, charging him with getting mRNA into cells without relying on Karikó and Weissman's solutions.
Schrum seemed well suited for the task. Months earlier, he had received a PhD in biological chemistry at Harvard University, where he had focused on nucleotide chemistry. Schrum even had the look of someone who might do big things. The baby-faced twenty-eight-year-old favored a relaxed, start-up look: khakis, button-downs, and Converse All-Stars.
Schrum felt immediate strain, however. He hadn't told anyone, but he was dealing with intense pain in his hands and joints, a condition that later would be diagnosed as degenerative arthritis. Soon Schrum couldn't bend two fingers on his left hand, making lab work difficult. He joined a drug trial, but the medicine proved useless. Schrum tried corticosteroid injections and anti-inflammatory drugs, but his left hand ached, restricting his experiments.
"It just wasn't useful," Schrum says, referring to his tender hand.*
He persisted, nonetheless. Each day in the fall of 2010, Schrum walked through double air-locked doors into a sterile "clean room" before entering a basement laboratory, in the bowels of an office in Cambridge's Kendall Square neighborhood, where he worked deep into the night. Schrum searched for potential modifications of mRNA nucleosides, hoping they might enable the molecule to produce proteins. Like all such rooms, there were no windows, so Schrum had to check a clock to know if it was day or night. A colleague came to visit once in a while, but most of the time, Schrum was alone.
Some of Moderna's founders doubted Schrum could find success and they worried if their venture was doomed from the start. An established MIT scientist turned down a job with the start-up to join pharmaceutical giant Novartis, dubious of Moderna's approach. Colleagues wondered if mRNA could produce proteins, at least on a consistent basis.
As Schrum began testing the modifications in January 2011, he made an unexpected discovery. Karikó and Weissman saw that by turned one of the building blocks for mRNA, a ribonucleoside called uridine, into a slightly different form called pseudouridine, the cell's immune system ignored the mRNA and the molecule avoided an immune response. After a series of experiments in the basement lab, Schrum discovered that a variant of pseudouridine called N1- methyl-pseudouridine did an even better job reducing the cell's innate immune response. Schrum's nucleoside switch enabled even higher protein production than Karikó and Weissman had generated, and Schrum's mRNAs lasted longer than either unmodified molecules or the modified mRNA the Penn academics had used, startling the young researcher. Working alone in a dreary basement and through intense pain, he had actually improved on the Penn professors' work.
Years later, Karikó and Weissman who would win acclaim. In September 2021, the scientists were awarded the Lasker-DeBakey Clinical Medical Research Award. Some predict they eventually will win a Nobel prize. But it would be Schrum's innovation that would form the backbone of both Moderna and Pfizer-BioNTech's Covid-19 vaccine, not the chemical modifications that Karikó and Weissman developed. For Schrum, necessity had truly been the mother of invention.
The Scientist Who Solved Delivery: Kerry Benenato
For several years, Moderna would make slow progress developing drugs to treat various diseases. Eventually, the company decided that mRNA was likely better suited for vaccines. By 2017, Moderna and the National Institutes of Health were discussing working together to develop mRNA–based vaccines, a partnership that buoyed Moderna's executives. There remained a huge obstacle in Moderna's way, however. It was up to Kerry Benenato to find a solution.
Benenato received an early hint of the hurdle in front of her three years earlier, when the organic chemist was first hired. When a colleague gave her a company tour, she was introduced to Moderna's chief scientific officer, Joseph Bolen, who seemed unusually excited to meet her.
"Oh, great!" Bolen said with a smile. "She's the one who's gonna solve delivery."
Bolen gave a hearty laugh and walked away, but Benenato detected seriousness in his quip.
Solve delivery?
It was a lot to expect from a 37-year-old scientist already dealing with insecurities and self-doubt. Benenato was an accomplished researcher who most recently had worked at AstraZeneca after completing post-doctoral studies at Harvard University. Despite her impressive credentials, Benenato battled a lack of confidence that sometimes got in her way. Performance reviews from past employers had been positive, but they usually produced similar critiques: Be more vocal. Do a better job advocating for your ideas. Give us more, Kerry.
Benenato was petite and soft-spoken. She sometimes stuttered or relied on "ums" and "ahs" when she became nervous, especially in front of groups, part of why she sometimes didn't feel comfortable speaking up.
"I'm an introvert," she says. "Self-confidence is something that's always been an issue."
To Benenato, Moderna's vaccine approach seemed promising—the team was packaging mRNAs in microscopic fatty-acid compounds called lipid nanoparticles, or LNPs, that protected the molecules on their way into cells. Moderna's shots should have been producing ample and long-lasting proteins. But the company's scientists were alarmed—they were injecting shots deep into the muscle of mice, but their immune systems were mounting spirited responses to the foreign components of the LNPs, which had been developed by a Canadian company.
This toxicity was a huge issue: A vaccine or drug that caused sharp pain and awful fevers wasn't going to prove very popular. The Moderna team was in a bind: Its mRNA had to be wrapped in the fatty nanoparticles to have a chance at producing plentiful proteins, but the body wasn't tolerating the microscopic encasements, especially upon repeated dosing.
The company's scientists had done everything they could to try to make the molecule's swathing material disappear soon after entering the cells, in order to avoid the unfortunate side effects, such as chills and headaches, but they weren't making headway. Frustration mounted. Somehow, the researchers had to find a way to get the encasements—made of little balls of fat, cholesterol, and other substances—to deliver their payload mRNA and then quickly vanish, like a parent dropping a teenager off at a party, to avoid setting off the immune system in unpleasant ways, even as the RNA and the proteins the molecule created stuck around.
Benenato wasn't entirely shocked by the challenges Moderna was facing. One of the reasons she had joined the upstart company was to help develop its delivery technology. She just didn't realize how pressing the issue was, or how stymied the researchers had become. Benenato also didn't know that Moderna board members were among those most discouraged by the delivery issue. In meetings, some of them pointed out that pharmaceutical giants like Roche Holding and Novartis had worked on similar issues and hadn't managed to develop lipid nanoparticles that were both effective and well tolerated by the body. Why would Moderna have any more luck?
Stephen Hoge insisted the company could yet find a solution.
"There's no way the only innovations in LNP are going to come from some academics and a small Canadian company," insisted Hoge, who had convinced the executives that hiring Benenato might help deliver an answer.
Benenato realized that while Moderna might have been a hot Boston-area start- up, it wasn't set up to do the chemistry necessary to solve their LNP problem. Much of its equipment was old or secondhand, and it was the kind used to tinker with mRNAs, not lipids.
"It was scary," she says.
When Benenato saw the company had a nuclear magnetic resonance spectrometer, which allows chemists to see the molecular structure of material, she let out a sigh of relief. Then Benenato inspected the machine and realized it was a jalopy. The hulking, aging instrument had been decommissioned and left behind by a previous tenant, too old and banged up to bring with them.
Benenato began experimenting with different chemical changes for Moderna's LNPs, but without a working spectrometer she and her colleagues had to have samples ready by noon each day, so they could be picked up by an outside company that would perform the necessary analysis. After a few weeks, her superiors received an enormous bill for the outsourced work and decided to pay to get the old spectrometer running again.
After months of futility, Benenato became impatient. An overachiever who could be hard on herself, she was eager to impress her new bosses. Benenato felt pressure outside the office, as well. She was married with a preschool-age daughter and an eighteen-month-old son. In her last job, Benenato's commute had been a twenty-minute trip to Astra-Zeneca's office in Waltham, outside Boston; now she was traveling an hour to Moderna's Cambridge offices. She became anxious—how was she going to devote the long hours she realized were necessary to solve their LNP quandary while providing her children proper care? Joining Moderna was beginning to feel like a possible mistake.
She turned to her husband and father for help. They reminded her of the hard work she had devoted to establishing her career and said it would be a shame if she couldn't take on the new challenge. Benenato's husband said he was happy to stay home with the kids, alleviating some of her concerns.
Back in the office, she got to work. She wanted to make lipids that were easier for the body to chop into smaller pieces, so they could be eliminated by the body's enzymes. Until then, Moderna, like most others, relied on all kinds of complicated chemicals to hold its LNP packaging together. They weren't natural, though, so the body was having a hard time breaking them down, causing the toxicity.
Benenato began experimenting with simpler chemicals. She inserted "ester bonds"—compounds referred to in chemical circles as "handles" because the body easily grabs them and breaks them apart. Ester bonds had two things going for them: They were strong enough to help ensure the LNP remained stable, acting much like a drop of oil in water, but they also gave the body's enzymes something to target and break down as soon as the LNP entered the cell, a way to quickly rid the body of the potentially toxic LNP components. Benenato thought the inclusion of these chemicals might speed the elimination of the LNP delivery material.
This idea, Benenato realized, was nothing more than traditional, medicinal chemistry. Most people didn't use ester bonds because they were pretty unsophisticated. But, hey, the tricky stuff wasn't working, so Benenato thought she'd see if the simple stuff worked.
Benenato also wanted to try to replace a group of unnatural chemicals in the LNP that was contributing to the spirited and unwelcome response from the immune system. Benenato set out to build a new and improved chemical combination. She began with ethanolamine, a colorless, natural chemical, an obvious start for any chemist hoping to build a more complex chemical combination. No one relied on ethanolamine on its own.
Benenato was curious, though. What would happen if she used just these two simple modifications to the LNP: ethanolamine with the ester bonds? Right away, Benenato noticed her new, super-simple compound helped mRNA create some protein in animals. It wasn't much, but it was a surprising and positive sign. Benenato spent over a year refining her solution, testing more than one hundred variations, all using ethanolamine and ester bonds, showing improvements with each new version of LNP. After finishing her 102nd version of the lipid molecule, which she named SM102, Benenato was confident enough in her work to show it to Hoge and others.
They immediately got excited. The team kept tweaking the composition of the lipid encasement. In 2017, they wrapped it around mRNA molecules and injected the new combination in mice and then monkeys. They saw plentiful, potent proteins were being produced and the lipids were quickly being eliminated, just as Benenato and her colleagues had hoped. Moderna had its special sauce.
That year, Benenato was asked to deliver a presentation to Stephane Bancel, Moderna's chief executive, Afeyan, and Moderna's executive committee to explain why it made sense to use the new, simpler LNP formulation for all its mRNA vaccines. She still needed approval from the executives to make the change. Ahead of the meeting, she was apprehensive, as some of her earlier anxieties returned. But an unusual calm came over her as she began speaking to the group. Benenato explained how experimenting with basic, overlooked chemicals had led to her discovery.
She said she had merely stumbled onto the company's solution, though her bosses understood the efforts that had been necessary for the breakthrough. The board complimented her work and agreed with the idea of switching to the new LNP. Benenato beamed with pride.
"As a scientist, serendipity has been my best friend," she told the executives.
Over the next few years, Benenato and her colleagues would improve on their methods and develop even more tolerable and potent LNP encasement for mRNA molecules. Their work enabled Moderna to include higher doses of vaccine in its shots. In early 2020, Moderna developed Covid-19 shots that included 100 micrograms of vaccine, compared with 30 micrograms in the Pfizer-BioNTech vaccine. That difference appears to help the Moderna vaccine generate higher titers and provide more protection.
"You set out in a career in drug discovery to want to make a difference," Benenato says. "Seeing it come to reality has been surreal and emotional."
Editor's Note: This essay is excerpted from A SHOT TO SAVE THE WORLD: The Inside Story of the Life-or-Death Race for a COVID-19 Vaccine by Gregory Zuckerman, now on sale from Portfolio/Penguin.
*Jason Schrum's arthritis is now in complete remission, thanks to Humira (adalimumab), a TNF-alpha blocker.
Drones are just one of several new technologies that are rising to the challenge of more frequent wildfires.
Robots have been a game-changer. Inspired by Paris, the Los Angeles Fire Department (LAFD) was the first in the U.S. to deploy a firefighting robot in 2021, the Thermite Robotics System 3 – RS3, for short.
RS3 is a 3,500-pound turbine on a crawler—the size of a Smart car—with a 36.8 horsepower engine that can go for 20 hours without refueling. It can plow through hazardous terrain, move cars from its path, and pull an 8,000-pound object from a fire.
All that while spurting 2,500 gallons of water per minute with a rear exhaust fan clearing the smoke. At a recent trade show, RS3 was billed as equivalent to 10 firefighters. The Los Angeles Times referred to it as “a droid on steroids.”
Robots such as the Thermite RS3 can plow through hazardous terrain and pull an 8,000-pound object from a fire.
Los Angeles Fire Department
The advantage of the robot is obvious. Operated remotely from a distance, it greatly reduces an emergency responder’s exposure to danger, says Wade White, assistant chief of the LAFD. The robot can be sent into airplane fires, nuclear reactors, hazardous areas with carcinogens (think East Palestine, Ohio), or buildings where a roof collapse is imminent.
Advances for firefighters are taking many other forms as well. Fibers have been developed that make the firefighter’s coat lighter and more protective from carcinogens. New wearable devices track firefighters’ biometrics in real time so commanders can monitor their heat stress and exertion levels. A sensor patch is in development which takes readings every four seconds to detect dangerous gases such as methane and carbon dioxide. A sonic fire extinguisher is being explored that uses low frequency soundwaves to remove oxygen from air molecules without unhealthy chemical compounds.
The demand for this technology is only increasing, especially with the recent rise in wildfires. In 2021, fires were responsible for 3,800 deaths and 14,700 injuries of civilians in this country. Last year, 68,988 wildfires burned down 7.6 million acres. Whether the next generation of firefighting can address these new challenges could depend on special cameras, robots of the aerial variety, AI and smart systems.
Fighting fire with cameras
Another key innovation for firefighters is a thermal imaging camera (TIC) that improves visibility through smoke. “At a fire, you might not see your hand in front of your face,” says White. “Using the TIC screen, you can find the door to get out safely or see a victim in the corner.” Since these cameras were introduced in the 1990s, the price has come down enough (from $10,000 or more to about $700) that every LAFD firefighter on duty has been carrying one since 2019, says White.
TICs are about the size of a cell phone. The camera can sense movement and body heat so it is ideal as a search tool for people trapped in buildings. If a firefighter has not moved in 30 seconds, the motion detector picks that up, too, and broadcasts a distress signal and directional information to others.
To enable firefighters to operate the camera hands-free, the newest TICs can attach inside a helmet. The firefighter sees the images inside their mask.
TICs also can be mounted on drones to get a bird’s-eye, 360 degree view of a disaster or scout for hot spots through the smoke. In addition, the camera can take photos to aid arson investigations or help determine the cause of a fire.
More help From above
Firefighters prefer the term “unmanned aerial systems” (UAS) to drones to differentiate them from military use.
A UAS carrying a camera can provide aerial scene monitoring and topography maps to help fire captains deploy resources more efficiently. At night, floodlights from the drone can illuminate the landscape for firefighters. They can drop off payloads of blankets, parachutes, life preservers or radio devices for stranded people to communicate, too. And like the robot, the UAS reduces risks for ground crews and helicopter pilots by limiting their contact with toxic fumes, hazardous chemicals, and explosive materials.
“The nice thing about drones is that they perform multiple missions at once,” says Sean Triplett, team lead of fire and aviation management, tools and technology at the Forest Service.
Experts predict we’ll see swarms of drones dropping water and fire retardant on burning buildings and forests in the near future.
The UAS is especially helpful during wildfires because it can track fires, get ahead of wind currents and warn firefighters of wind shifts in real time. The U.S. Forest Service also uses long endurance, solar-powered drones that can fly for up to 30 days at a time to detect early signs of wildfire. Wildfires are no longer seasonal in California – they are a year-long threat, notes Thanh Nguyen, fire captain at the Orange County Fire Authority.
In March, Nguyen’s crew deployed a drone to scope out a huge landslide following torrential rains in San Clemente, CA. Emergency responders used photos and videos from the drone to survey the evacuated area, enabling them to stay clear of ground on the hillside that was still sliding.
Improvements in drone batteries are enabling them to fly for longer with heavier payloads. Experts predict we’ll see swarms of drones dropping water and fire retardant on burning buildings and forests in the near future.
AI to the rescue
The biggest peril for a firefighter is often what they don’t see coming. Flashovers are a leading cause of firefighter deaths, for example. They occur when flammable materials in an enclosed area ignite almost instantaneously. Or dangerous backdrafts can happen when a firefighter opens a window or door; the air rushing in can ignite a fire without warning.
The Fire Fighting Technology Group at the National Institute of Standards and Technology (NIST) is developing tools and systems to predict these potentially lethal events with computer models and artificial intelligence.
Partnering with other institutions, NIST researchers developed the Flashover Prediction Neural Network (FlashNet) after looking at common house layouts and running sets of scenarios through a machine-learning model. In the lab, FlashNet was able to predict a flashover 30 seconds before it happened with 92.1% success. When ready for release, the technology will be bundled with sensors that are already installed in buildings, says Anthony Putorti, leader of the NIST group.
The NIST team also examined data from hundreds of backdrafts as a basis for a machine-learning model to predict them. In testing chambers the model predicted them correctly 70.8% of the time; accuracy increased to 82.4% when measures of backdrafts were taken in more positions at different heights in the chambers. Developers are working on how to integrate the AI into a small handheld device that can probe the air of a room through cracks around a door or through a created opening, Putorti says. This way, the air can be analyzed with the device to alert firefighters of any significant backdraft risk.
Early wildfire detection technologies based on AI are in the works, too. The Forest Service predicts the acreage burned each year during wildfires will more than triple in the next 80 years. By gathering information on historic fires, weather patterns, and topography, says White, AI can help firefighters manage wildfires before they grow out of control and create effective evacuation plans based on population data and fire patterns.
The future is connectivity
We are in our infancy with “smart firefighting,” says Casey Grant, executive director emeritus of the Fire Protection Research Foundation. Grant foresees a new era of cyber-physical systems for firefighters—a massive integration of wireless networks, advanced sensors, 3D simulations, and cloud services. To enhance teamwork, the system will connect all branches of emergency responders—fire, emergency medical services, law enforcement.
FirstNet (First Responder Network Authority) now provides a nationwide high-speed broadband network with 5G capabilities for first responders through a terrestrial cell network. Battling wildfires, however, the Forest Service needed an alternative because they don’t always have access to a power source. In 2022, they contracted with Aerostar for a high altitude balloon (60,000 feet up) that can extend cell phone power and LTE. “It puts a bubble of connectivity over the fire to hook in the internet,” Triplett explains.
A high altitude balloon, 60,000 feet high, can extend cell phone power and LTE, putting a "bubble" of internet connectivity over fires.
Courtesy of USDA Forest Service
Advances in harvesting, processing and delivering data will improve safety and decision-making for firefighters, Grant sums up. Smart systems may eventually calculate fire flow paths and make recommendations about the best ways to navigate specific fire conditions. NIST’s plan to combine FlashNet with sensors is one example.
The biggest challenge is developing firefighting technology that can work across multiple channels—federal, state, local and tribal systems as well as for fire, police and other emergency services— in any location, says Triplett. “When there’s a wildfire, there are no political boundaries,” he says. “All hands are on deck.”
A new test called the EyeBox could provide a more objective - and portable - tool to measure whether people have concussions in stadiums and hospitals.
Concussion affects around 42 million people worldwide. While it’s increasingly common in the news because of sports injuries, anything that causes damage to the head, from a fall to a car accident, can result in a concussion. The sudden blow or jolt can disrupt the normal way the brain works. In the immediate aftermath, people may suffer from headaches, lose consciousness and experience dizziness, confusion and vomiting. Some recover but others have side effects that can last for years, particularly affecting memory and concentration.
There is no simple standard-of-care test to confirm a concussion or rule it out. Neither do they appear on MRI and CT scans. Instead, medical professionals use more indirect approaches that test symptoms of concussions, such as assessments of patients’ learning and memory skills, ability to concentrate and problem solving. They also look at balance and coordination. Most tests are in the form of questionnaires or symptom checklists. Consequently, they have limitations, can be biased and may miss a concussion or produce a false positive. Some people suspected of having a concussion may ordinarily have difficulties with literary and problem-solving tests because of language challenges or education levels.
Another problem with current tests is that patients, particularly soldiers who want to return to combat and athletes who would like to keep competing, could try and hide their symptoms to avoid being diagnosed with a brain injury. Trauma physicians who work with concussion patients have the need for a tool that is more objective and consistent.
“This type of assessment doesn’t rely on the patient's education level, willingness to follow instructions or cooperation. You can’t game this.” -- Uzma Samadani, founder of Oculogica
“The importance of having an objective measurement tool for the diagnosis of concussion is of great importance,” says Douglas Powell, associate professor of biomechanics at the University of Memphis, with research interests in sports injury and concussion. “While there are a number of promising systems or metrics, we have yet to develop a system that is portable, accessible and objective for use on the sideline and in the clinic. The EyeBOX may be able to address these issues, though time will be the ultimate test of performance.”
The EyeBOX as a window inside the brain
Using eye movements to diagnose a concussion has emerged as a promising technique since around 2010. Oculogica combined eye movements with AI to develop the EyeBOX to develop an unbiased objective diagnostic tool.
“What’s so great about this type of assessment is it doesn’t rely on the patient's education level, willingness to follow instructions or cooperation,” says Uzma Samadani, a neurosurgeon and brain injury researcher at the University of Minnesota, who founded Oculogica. “You can’t game this. It assesses functions that are prompted by your brain.”
In 2010, Samadani was working on a clinical trial to improve the outcome of brain injuries. The team needed some way to measure if seriously brain injured patients were improving. One thing patients could do was watch TV. So Samadani designed and patented an AI-based algorithm that tracks the relationship between eye movement and concussion.
The EyeBOX test requires patients to watch movie or music clips for 220 seconds. An eye tracking camera records subconscious eye movements, tracking eye positions 500 times per seconds as patients watch the video. It collects over 100,000 data points. The device then uses AI to assess whether there’s any disruptions from the normal way the eyes move.
Cranial nerves are responsible for transmitting information between the brain and the body. Many are involved in eye movement. Pressure caused by a concussion can affect how these nerves work. So tracking how the eyes move can indicate if there’s anything wrong with the cranial nerves and where the problem lies.
If someone is healthy, their eyes should be able to focus on an object, follow movement and both eyes should be coordinated with each other. The EyeBox can detect abnormalities. For example, if a patient’s eyes are coordinated but they are not moving as they should, that indicates issues in the central brain stem, whilst only one eye moving abnormally suggests that a particular nerve section is affected.
Uzma Samadani with the EyeBOX device
Courtesy Oculogica
“The EyeBOX is a monitor for cranial nerves,” says Samadani. “Essentially it’s a form of digital neurological exam. “Several other eye-tracking techniques already exist, but they rely on subjective self-reported symptoms. Many also require a baseline, a measure of how patients reacted when they were healthy, which often isn’t available.
VOMS (Vestibular Ocular Motor Screen) is one of the most accurate diagnostic tests used in clinics in combination with other tests, but it is subjective. It involves a therapist getting patients to move their head or eyes as they focus or follow a particular object. Patients then report their symptoms.
The King-Devick test measures how fast patients can read numbers and compares it to a baseline. Since it is mainly used for athletes, the initial test is completed before the season starts. But participants can manipulate it. It also cannot be used in emergency rooms because the majority of patients wouldn’t have prior baseline tests.
Unlike these tests, EyeBOX doesn’t use a baseline and is objective because it doesn’t rely on patients’ answers. “It shows great promise,” says Thomas Wilcockson, a senior lecturer of psychology in Loughborough University, who is an expert in using eye tracking techniques in neurological disorders. “Baseline testing of eye movements is not always possible. Alternative measures of concussion currently in development, including work with VR headsets, seem to currently require it. Therefore the EyeBOX may have an advantage.”
A technology that’s still evolving
In their last clinical trial, Oculogica used the EyeBOX to test 46 patients who had concussion and 236 patients who did not. The sensitivity of the EyeBOX, or the probability of it correctly identifying the patient’s concussion, was 80.4 percent. Meanwhile, the test accurately ruled out a concussion in 66.1 percent of cases. This is known as its specificity score.
While the team is working on improving the numbers, experts who treat concussion patients find the device promising. “I strongly support their use of eye tracking for diagnostic decision making,” says Douglas Powell. “But for diagnostic tests, we would prefer at least one of the sensitivity or specificity values to be greater than 90 percent. Powell compares EyeBOX with the Buffalo Concussion Treadmill Test, which has sensitivity and specificity values of 73 and 78 percent, respectively. The VOMS also has shown greater accuracy than the EyeBOX, at least for now. Still, EyeBOX is competitive with the best diagnostic testing available for concussion and Powell hopes that its detection prowess will improve. “I anticipate that the algorithms being used by Oculogica will be under continuous revision and expect the results will improve within the next several years.”
“The color of your skin can have a huge impact in how quickly you are triaged and managed for brain injury. People of color have significantly worse outcomes after traumatic brain injury than people who are white.” -- Uzma Samadani, founder of Oculogica
Powell thinks the EyeBOX could be an important complement to other concussion assessments.
“The Oculogica product is a viable diagnostic tool that supports clinical decision making. However, concussion is an injury that can present with a wide array of symptoms, and the use of technology such as the Oculogica should always be a supplement to patient interaction.”
Ioannis Mavroudis, a consultant neurologist at Leeds Teaching Hospital, agrees that the EyeBOX has promise, but cautions that concussions are too complex to rely on the device alone. For example, not all concussions affect how eyes move. “I believe that it can definitely help, however not all concussions show changes in eye movements. I believe that if this could be combined with a cognitive assessment the results would be impressive.”
The Oculogica team submitted their clinical data for FDA approval and received it in 2018. Now, they’re working to bring the test to the commercial market and using the device clinically to help diagnose concussions for clients. They also want to look at other areas of brain health in the next few years. Samadani believes that the EyeBOX could possibly be used to detect diseases like multiple sclerosis or other neurological conditions. “It’s a completely new way of figuring out what someone’s neurological exam is and we’re only beginning to realize the potential,” says Samadani.
One of Samadani’s biggest aspirations is to help reduce inequalities in healthcare because of skin color and other factors like money or language barriers. From that perspective, the EyeBOX’s greatest potential could be in emergency rooms. It can help diagnose concussions in addition to the questionnaires, assessments and symptom checklists, currently used in the emergency departments. Unlike these more subjective tests, EyeBOX can produce an objective analysis of brain injury through AI when patients are admitted and assessed, unrelated to their socioeconomic status, education, or language abilities. Studies suggest that there are racial disparities in how patients with brain injuries are treated, such as how quickly they're assessed and get a treatment plan.
“The color of your skin can have a huge impact in how quickly you are triaged and managed for brain injury,” says Samadani. “As a result of that, people of color have significantly worse outcomes after traumatic brain injury than people who are white. The EyeBOX has the potential to reduce inequalities,” she explains.
“If you had a digital neurological tool that you could screen and triage patients on admission to the emergency department you would potentially be able to make sure that everybody got the same standard of care,” says Samadani. “My goal is to change the way brain injury is diagnosed and defined.”