New device can diagnose concussions using AI
For a long time after Mary Smith hit her head, she was not able to function. Test after test came back normal, so her doctors ruled out the concussion, but she knew something was wrong. Finally, when she took a test with a novel EyeBOX device, recently approved by the FDA, she learned she indeed had been dealing with the aftermath of a concussion.
“I felt like even my husband and doctors thought I was faking it or crazy,” recalls Smith, who preferred not to disclose her real name. “When I took the EyeBOX test it showed that my eyes were not moving together and my BOX score was abnormal.” To her diagnosticians, scientists at the Minneapolis-based company Oculogica who developed the EyeBOX, these markers were concussion signs. “I cried knowing that finally someone could figure out what was wrong with me and help me get better,” she says.
Concussion affects around 42 million people worldwide. While it’s increasingly common in the news because of sports injuries, anything that causes damage to the head, from a fall to a car accident, can result in a concussion. The sudden blow or jolt can disrupt the normal way the brain works. In the immediate aftermath, people may suffer from headaches, lose consciousness and experience dizziness, confusion and vomiting. Some recover but others have side effects that can last for years, particularly affecting memory and concentration.
There is no simple standard-of-care test to confirm a concussion or rule it out. Neither do they appear on MRI and CT scans. Instead, medical professionals use more indirect approaches that test symptoms of concussions, such as assessments of patients’ learning and memory skills, ability to concentrate and problem solving. They also look at balance and coordination. Most tests are in the form of questionnaires or symptom checklists. Consequently, they have limitations, can be biased and may miss a concussion or produce a false positive. Some people suspected of having a concussion may ordinarily have difficulties with literary and problem-solving tests because of language challenges or education levels.
Another problem with current tests is that patients, particularly soldiers who want to return to combat and athletes who would like to keep competing, could try and hide their symptoms to avoid being diagnosed with a brain injury. Trauma physicians who work with concussion patients have the need for a tool that is more objective and consistent.
“This type of assessment doesn’t rely on the patient's education level, willingness to follow instructions or cooperation. You can’t game this.” -- Uzma Samadani, founder of Oculogica
“The importance of having an objective measurement tool for the diagnosis of concussion is of great importance,” says Douglas Powell, associate professor of biomechanics at the University of Memphis, with research interests in sports injury and concussion. “While there are a number of promising systems or metrics, we have yet to develop a system that is portable, accessible and objective for use on the sideline and in the clinic. The EyeBOX may be able to address these issues, though time will be the ultimate test of performance.”
The EyeBOX as a window inside the brain
Using eye movements to diagnose a concussion has emerged as a promising technique since around 2010. Oculogica combined eye movements with AI to develop the EyeBOX to develop an unbiased objective diagnostic tool.
“What’s so great about this type of assessment is it doesn’t rely on the patient's education level, willingness to follow instructions or cooperation,” says Uzma Samadani, a neurosurgeon and brain injury researcher at the University of Minnesota, who founded Oculogica. “You can’t game this. It assesses functions that are prompted by your brain.”
In 2010, Samadani was working on a clinical trial to improve the outcome of brain injuries. The team needed some way to measure if seriously brain injured patients were improving. One thing patients could do was watch TV. So Samadani designed and patented an AI-based algorithm that tracks the relationship between eye movement and concussion.
The EyeBOX test requires patients to watch movie or music clips for 220 seconds. An eye tracking camera records subconscious eye movements, tracking eye positions 500 times per seconds as patients watch the video. It collects over 100,000 data points. The device then uses AI to assess whether there’s any disruptions from the normal way the eyes move.
Cranial nerves are responsible for transmitting information between the brain and the body. Many are involved in eye movement. Pressure caused by a concussion can affect how these nerves work. So tracking how the eyes move can indicate if there’s anything wrong with the cranial nerves and where the problem lies.
If someone is healthy, their eyes should be able to focus on an object, follow movement and both eyes should be coordinated with each other. The EyeBox can detect abnormalities. For example, if a patient’s eyes are coordinated but they are not moving as they should, that indicates issues in the central brain stem, whilst only one eye moving abnormally suggests that a particular nerve section is affected.
Uzma Samadani with the EyeBOX device
Courtesy Oculogica
“The EyeBOX is a monitor for cranial nerves,” says Samadani. “Essentially it’s a form of digital neurological exam. “Several other eye-tracking techniques already exist, but they rely on subjective self-reported symptoms. Many also require a baseline, a measure of how patients reacted when they were healthy, which often isn’t available.
VOMS (Vestibular Ocular Motor Screen) is one of the most accurate diagnostic tests used in clinics in combination with other tests, but it is subjective. It involves a therapist getting patients to move their head or eyes as they focus or follow a particular object. Patients then report their symptoms.
The King-Devick test measures how fast patients can read numbers and compares it to a baseline. Since it is mainly used for athletes, the initial test is completed before the season starts. But participants can manipulate it. It also cannot be used in emergency rooms because the majority of patients wouldn’t have prior baseline tests.
Unlike these tests, EyeBOX doesn’t use a baseline and is objective because it doesn’t rely on patients’ answers. “It shows great promise,” says Thomas Wilcockson, a senior lecturer of psychology in Loughborough University, who is an expert in using eye tracking techniques in neurological disorders. “Baseline testing of eye movements is not always possible. Alternative measures of concussion currently in development, including work with VR headsets, seem to currently require it. Therefore the EyeBOX may have an advantage.”
A technology that’s still evolving
In their last clinical trial, Oculogica used the EyeBOX to test 46 patients who had concussion and 236 patients who did not. The sensitivity of the EyeBOX, or the probability of it correctly identifying the patient’s concussion, was 80.4 percent. Meanwhile, the test accurately ruled out a concussion in 66.1 percent of cases. This is known as its specificity score.
While the team is working on improving the numbers, experts who treat concussion patients find the device promising. “I strongly support their use of eye tracking for diagnostic decision making,” says Douglas Powell. “But for diagnostic tests, we would prefer at least one of the sensitivity or specificity values to be greater than 90 percent. Powell compares EyeBOX with the Buffalo Concussion Treadmill Test, which has sensitivity and specificity values of 73 and 78 percent, respectively. The VOMS also has shown greater accuracy than the EyeBOX, at least for now. Still, EyeBOX is competitive with the best diagnostic testing available for concussion and Powell hopes that its detection prowess will improve. “I anticipate that the algorithms being used by Oculogica will be under continuous revision and expect the results will improve within the next several years.”
“The color of your skin can have a huge impact in how quickly you are triaged and managed for brain injury. People of color have significantly worse outcomes after traumatic brain injury than people who are white.” -- Uzma Samadani, founder of Oculogica
Powell thinks the EyeBOX could be an important complement to other concussion assessments.
“The Oculogica product is a viable diagnostic tool that supports clinical decision making. However, concussion is an injury that can present with a wide array of symptoms, and the use of technology such as the Oculogica should always be a supplement to patient interaction.”
Ioannis Mavroudis, a consultant neurologist at Leeds Teaching Hospital, agrees that the EyeBOX has promise, but cautions that concussions are too complex to rely on the device alone. For example, not all concussions affect how eyes move. “I believe that it can definitely help, however not all concussions show changes in eye movements. I believe that if this could be combined with a cognitive assessment the results would be impressive.”
The Oculogica team submitted their clinical data for FDA approval and received it in 2018. Now, they’re working to bring the test to the commercial market and using the device clinically to help diagnose concussions for clients. They also want to look at other areas of brain health in the next few years. Samadani believes that the EyeBOX could possibly be used to detect diseases like multiple sclerosis or other neurological conditions. “It’s a completely new way of figuring out what someone’s neurological exam is and we’re only beginning to realize the potential,” says Samadani.
One of Samadani’s biggest aspirations is to help reduce inequalities in healthcare because of skin color and other factors like money or language barriers. From that perspective, the EyeBOX’s greatest potential could be in emergency rooms. It can help diagnose concussions in addition to the questionnaires, assessments and symptom checklists, currently used in the emergency departments. Unlike these more subjective tests, EyeBOX can produce an objective analysis of brain injury through AI when patients are admitted and assessed, unrelated to their socioeconomic status, education, or language abilities. Studies suggest that there are racial disparities in how patients with brain injuries are treated, such as how quickly they're assessed and get a treatment plan.
“The color of your skin can have a huge impact in how quickly you are triaged and managed for brain injury,” says Samadani. “As a result of that, people of color have significantly worse outcomes after traumatic brain injury than people who are white. The EyeBOX has the potential to reduce inequalities,” she explains.
“If you had a digital neurological tool that you could screen and triage patients on admission to the emergency department you would potentially be able to make sure that everybody got the same standard of care,” says Samadani. “My goal is to change the way brain injury is diagnosed and defined.”
If you look back on the last century of scientific achievements, you might notice that most of the scientists we celebrate are overwhelmingly white, while scientists of color take a backseat. Since the Nobel Prize was introduced in 1901, for example, no black scientists have landed this prestigious award.
The work of black women scientists has gone unrecognized in particular. Their work uncredited and often stolen, black women have nevertheless contributed to some of the most important advancements of the last 100 years, from the polio vaccine to GPS.
Here are five black women who have changed science forever.
Dr. May Edward Chinn
Dr. May Edward Chinn practicing medicine in Harlem
George B. Davis, PhD.
Chinn was born to poor parents in New York City just before the start of the 20th century. Although she showed great promise as a pianist, playing with the legendary musician Paul Robeson throughout the 1920s, she decided to study medicine instead. Chinn, like other black doctors of the time, were barred from studying or practicing in New York hospitals. So Chinn formed a private practice and made house calls, sometimes operating in patients’ living rooms, using an ironing board as a makeshift operating table.
Chinn worked among the city’s poor, and in doing this, started to notice her patients had late-stage cancers that often had gone undetected or untreated for years. To learn more about cancer and its prevention, Chinn begged information off white doctors who were willing to share with her, and even accompanied her patients to other clinic appointments in the city, claiming to be the family physician. Chinn took this information and integrated it into her own practice, creating guidelines for early cancer detection that were revolutionary at the time—for instance, checking patient health histories, checking family histories, performing routine pap smears, and screening patients for cancer even before they showed symptoms. For years, Chinn was the only black female doctor working in Harlem, and she continued to work closely with the poor and advocate for early cancer screenings until she retired at age 81.
Alice Ball
Pictorial Press Ltd/Alamy
Alice Ball was a chemist best known for her groundbreaking work on the development of the “Ball Method,” the first successful treatment for those suffering from leprosy during the early 20th century.
In 1916, while she was an undergraduate student at the University of Hawaii, Ball studied the effects of Chaulmoogra oil in treating leprosy. This oil was a well-established therapy in Asian countries, but it had such a foul taste and led to such unpleasant side effects that many patients refused to take it.
So Ball developed a method to isolate and extract the active compounds from Chaulmoogra oil to create an injectable medicine. This marked a significant breakthrough in leprosy treatment and became the standard of care for several decades afterward.
Unfortunately, Ball died before she could publish her results, and credit for this discovery was given to another scientist. One of her colleagues, however, was able to properly credit her in a publication in 1922.
Henrietta Lacks
onathan Newton/The Washington Post/Getty
The person who arguably contributed the most to scientific research in the last century, surprisingly, wasn’t even a scientist. Henrietta Lacks was a tobacco farmer and mother of five children who lived in Maryland during the 1940s. In 1951, Lacks visited Johns Hopkins Hospital where doctors found a cancerous tumor on her cervix. Before treating the tumor, the doctor who examined Lacks clipped two small samples of tissue from Lacks’ cervix without her knowledge or consent—something unthinkable today thanks to informed consent practices, but commonplace back then.
As Lacks underwent treatment for her cancer, her tissue samples made their way to the desk of George Otto Gey, a cancer researcher at Johns Hopkins. He noticed that unlike the other cell cultures that came into his lab, Lacks’ cells grew and multiplied instead of dying out. Lacks’ cells were “immortal,” meaning that because of a genetic defect, they were able to reproduce indefinitely as long as certain conditions were kept stable inside the lab.
Gey started shipping Lacks’ cells to other researchers across the globe, and scientists were thrilled to have an unlimited amount of sturdy human cells with which to experiment. Long after Lacks died of cervical cancer in 1951, her cells continued to multiply and scientists continued to use them to develop cancer treatments, to learn more about HIV/AIDS, to pioneer fertility treatments like in vitro fertilization, and to develop the polio vaccine. To this day, Lacks’ cells have saved an estimated 10 million lives, and her family is beginning to get the compensation and recognition that Henrietta deserved.
Dr. Gladys West
Andre West
Gladys West was a mathematician who helped invent something nearly everyone uses today. West started her career in the 1950s at the Naval Surface Warfare Center Dahlgren Division in Virginia, and took data from satellites to create a mathematical model of the Earth’s shape and gravitational field. This important work would lay the groundwork for the technology that would later become the Global Positioning System, or GPS. West’s work was not widely recognized until she was honored by the US Air Force in 2018.
Dr. Kizzmekia "Kizzy" Corbett
TIME Magazine
At just 35 years old, immunologist Kizzmekia “Kizzy” Corbett has already made history. A viral immunologist by training, Corbett studied coronaviruses at the National Institutes of Health (NIH) and researched possible vaccines for coronaviruses such as SARS (Severe Acute Respiratory Syndrome) and MERS (Middle East Respiratory Syndrome).
At the start of the COVID pandemic, Corbett and her team at the NIH partnered with pharmaceutical giant Moderna to develop an mRNA-based vaccine against the virus. Corbett’s previous work with mRNA and coronaviruses was vital in developing the vaccine, which became one of the first to be authorized for emergency use in the United States. The vaccine, along with others, is responsible for saving an estimated 14 million lives.On today’s episode of Making Sense of Science, I’m honored to be joined by Dr. Paul Song, a physician, oncologist, progressive activist and biotech chief medical officer. Through his company, NKGen Biotech, Dr. Song is leveraging the power of patients’ own immune systems by supercharging the body’s natural killer cells to make new treatments for Alzheimer’s and cancer.
Whereas other treatments for Alzheimer’s focus directly on reducing the build-up of proteins in the brain such as amyloid and tau in patients will mild cognitive impairment, NKGen is seeking to help patients that much of the rest of the medical community has written off as hopeless cases, those with late stage Alzheimer’s. And in small studies, NKGen has shown remarkable results, even improvement in the symptoms of people with these very progressed forms of Alzheimer’s, above and beyond slowing down the disease.
In the realm of cancer, Dr. Song is similarly setting his sights on another group of patients for whom treatment options are few and far between: people with solid tumors. Whereas some gradual progress has been made in treating blood cancers such as certain leukemias in past few decades, solid tumors have been even more of a challenge. But Dr. Song’s approach of using natural killer cells to treat solid tumors is promising. You may have heard of CAR-T, which uses genetic engineering to introduce cells into the body that have a particular function to help treat a disease. NKGen focuses on other means to enhance the 40 plus receptors of natural killer cells, making them more receptive and sensitive to picking out cancer cells.
Paul Y. Song, MD is currently CEO and Vice Chairman of NKGen Biotech. Dr. Song’s last clinical role was Asst. Professor at the Samuel Oschin Cancer Center at Cedars Sinai Medical Center.
Dr. Song served as the very first visiting fellow on healthcare policy in the California Department of Insurance in 2013. He is currently on the advisory board of the Pritzker School of Molecular Engineering at the University of Chicago and a board member of Mercy Corps, The Center for Health and Democracy, and Gideon’s Promise.
Dr. Song graduated with honors from the University of Chicago and received his MD from George Washington University. He completed his residency in radiation oncology at the University of Chicago where he served as Chief Resident and did a brachytherapy fellowship at the Institute Gustave Roussy in Villejuif, France. He was also awarded an ASTRO research fellowship in 1995 for his research in radiation inducible gene therapy.
With Dr. Song’s leadership, NKGen Biotech’s work on natural killer cells represents cutting-edge science leading to key findings and important pieces of the puzzle for treating two of humanity’s most intractable diseases.
Show links
- Paul Song LinkedIn
- NKGen Biotech on Twitter - @NKGenBiotech
- NKGen Website: https://nkgenbiotech.com/
- NKGen appoints Paul Song
- Patient Story: https://pix11.com/news/local-news/long-island/promising-new-treatment-for-advanced-alzheimers-patients/
- FDA Clearance: https://nkgenbiotech.com/nkgen-biotech-receives-ind-clearance-from-fda-for-snk02-allogeneic-natural-killer-cell-therapy-for-solid-tumors/Q3 earnings data: https://www.nasdaq.com/press-release/nkgen-biotech-inc.-reports-third-quarter-2023-financial-results-and-business