A new test called the EyeBox could provide a more objective - and portable - tool to measure whether people have concussions in stadiums and hospitals.
Concussion affects around 42 million people worldwide. While it’s increasingly common in the news because of sports injuries, anything that causes damage to the head, from a fall to a car accident, can result in a concussion. The sudden blow or jolt can disrupt the normal way the brain works. In the immediate aftermath, people may suffer from headaches, lose consciousness and experience dizziness, confusion and vomiting. Some recover but others have side effects that can last for years, particularly affecting memory and concentration.
There is no simple standard-of-care test to confirm a concussion or rule it out. Neither do they appear on MRI and CT scans. Instead, medical professionals use more indirect approaches that test symptoms of concussions, such as assessments of patients’ learning and memory skills, ability to concentrate and problem solving. They also look at balance and coordination. Most tests are in the form of questionnaires or symptom checklists. Consequently, they have limitations, can be biased and may miss a concussion or produce a false positive. Some people suspected of having a concussion may ordinarily have difficulties with literary and problem-solving tests because of language challenges or education levels.
Another problem with current tests is that patients, particularly soldiers who want to return to combat and athletes who would like to keep competing, could try and hide their symptoms to avoid being diagnosed with a brain injury. Trauma physicians who work with concussion patients have the need for a tool that is more objective and consistent.
“This type of assessment doesn’t rely on the patient's education level, willingness to follow instructions or cooperation. You can’t game this.” -- Uzma Samadani, founder of Oculogica
“The importance of having an objective measurement tool for the diagnosis of concussion is of great importance,” says Douglas Powell, associate professor of biomechanics at the University of Memphis, with research interests in sports injury and concussion. “While there are a number of promising systems or metrics, we have yet to develop a system that is portable, accessible and objective for use on the sideline and in the clinic. The EyeBOX may be able to address these issues, though time will be the ultimate test of performance.”
The EyeBOX as a window inside the brain
Using eye movements to diagnose a concussion has emerged as a promising technique since around 2010. Oculogica combined eye movements with AI to develop the EyeBOX to develop an unbiased objective diagnostic tool.
“What’s so great about this type of assessment is it doesn’t rely on the patient's education level, willingness to follow instructions or cooperation,” says Uzma Samadani, a neurosurgeon and brain injury researcher at the University of Minnesota, who founded Oculogica. “You can’t game this. It assesses functions that are prompted by your brain.”
In 2010, Samadani was working on a clinical trial to improve the outcome of brain injuries. The team needed some way to measure if seriously brain injured patients were improving. One thing patients could do was watch TV. So Samadani designed and patented an AI-based algorithm that tracks the relationship between eye movement and concussion.
The EyeBOX test requires patients to watch movie or music clips for 220 seconds. An eye tracking camera records subconscious eye movements, tracking eye positions 500 times per seconds as patients watch the video. It collects over 100,000 data points. The device then uses AI to assess whether there’s any disruptions from the normal way the eyes move.
Cranial nerves are responsible for transmitting information between the brain and the body. Many are involved in eye movement. Pressure caused by a concussion can affect how these nerves work. So tracking how the eyes move can indicate if there’s anything wrong with the cranial nerves and where the problem lies.
If someone is healthy, their eyes should be able to focus on an object, follow movement and both eyes should be coordinated with each other. The EyeBox can detect abnormalities. For example, if a patient’s eyes are coordinated but they are not moving as they should, that indicates issues in the central brain stem, whilst only one eye moving abnormally suggests that a particular nerve section is affected.
Uzma Samadani with the EyeBOX device
Courtesy Oculogica
“The EyeBOX is a monitor for cranial nerves,” says Samadani. “Essentially it’s a form of digital neurological exam. “Several other eye-tracking techniques already exist, but they rely on subjective self-reported symptoms. Many also require a baseline, a measure of how patients reacted when they were healthy, which often isn’t available.
VOMS (Vestibular Ocular Motor Screen) is one of the most accurate diagnostic tests used in clinics in combination with other tests, but it is subjective. It involves a therapist getting patients to move their head or eyes as they focus or follow a particular object. Patients then report their symptoms.
The King-Devick test measures how fast patients can read numbers and compares it to a baseline. Since it is mainly used for athletes, the initial test is completed before the season starts. But participants can manipulate it. It also cannot be used in emergency rooms because the majority of patients wouldn’t have prior baseline tests.
Unlike these tests, EyeBOX doesn’t use a baseline and is objective because it doesn’t rely on patients’ answers. “It shows great promise,” says Thomas Wilcockson, a senior lecturer of psychology in Loughborough University, who is an expert in using eye tracking techniques in neurological disorders. “Baseline testing of eye movements is not always possible. Alternative measures of concussion currently in development, including work with VR headsets, seem to currently require it. Therefore the EyeBOX may have an advantage.”
A technology that’s still evolving
In their last clinical trial, Oculogica used the EyeBOX to test 46 patients who had concussion and 236 patients who did not. The sensitivity of the EyeBOX, or the probability of it correctly identifying the patient’s concussion, was 80.4 percent. Meanwhile, the test accurately ruled out a concussion in 66.1 percent of cases. This is known as its specificity score.
While the team is working on improving the numbers, experts who treat concussion patients find the device promising. “I strongly support their use of eye tracking for diagnostic decision making,” says Douglas Powell. “But for diagnostic tests, we would prefer at least one of the sensitivity or specificity values to be greater than 90 percent. Powell compares EyeBOX with the Buffalo Concussion Treadmill Test, which has sensitivity and specificity values of 73 and 78 percent, respectively. The VOMS also has shown greater accuracy than the EyeBOX, at least for now. Still, EyeBOX is competitive with the best diagnostic testing available for concussion and Powell hopes that its detection prowess will improve. “I anticipate that the algorithms being used by Oculogica will be under continuous revision and expect the results will improve within the next several years.”
“The color of your skin can have a huge impact in how quickly you are triaged and managed for brain injury. People of color have significantly worse outcomes after traumatic brain injury than people who are white.” -- Uzma Samadani, founder of Oculogica
Powell thinks the EyeBOX could be an important complement to other concussion assessments.
“The Oculogica product is a viable diagnostic tool that supports clinical decision making. However, concussion is an injury that can present with a wide array of symptoms, and the use of technology such as the Oculogica should always be a supplement to patient interaction.”
Ioannis Mavroudis, a consultant neurologist at Leeds Teaching Hospital, agrees that the EyeBOX has promise, but cautions that concussions are too complex to rely on the device alone. For example, not all concussions affect how eyes move. “I believe that it can definitely help, however not all concussions show changes in eye movements. I believe that if this could be combined with a cognitive assessment the results would be impressive.”
The Oculogica team submitted their clinical data for FDA approval and received it in 2018. Now, they’re working to bring the test to the commercial market and using the device clinically to help diagnose concussions for clients. They also want to look at other areas of brain health in the next few years. Samadani believes that the EyeBOX could possibly be used to detect diseases like multiple sclerosis or other neurological conditions. “It’s a completely new way of figuring out what someone’s neurological exam is and we’re only beginning to realize the potential,” says Samadani.
One of Samadani’s biggest aspirations is to help reduce inequalities in healthcare because of skin color and other factors like money or language barriers. From that perspective, the EyeBOX’s greatest potential could be in emergency rooms. It can help diagnose concussions in addition to the questionnaires, assessments and symptom checklists, currently used in the emergency departments. Unlike these more subjective tests, EyeBOX can produce an objective analysis of brain injury through AI when patients are admitted and assessed, unrelated to their socioeconomic status, education, or language abilities. Studies suggest that there are racial disparities in how patients with brain injuries are treated, such as how quickly they're assessed and get a treatment plan.
“The color of your skin can have a huge impact in how quickly you are triaged and managed for brain injury,” says Samadani. “As a result of that, people of color have significantly worse outcomes after traumatic brain injury than people who are white. The EyeBOX has the potential to reduce inequalities,” she explains.
“If you had a digital neurological tool that you could screen and triage patients on admission to the emergency department you would potentially be able to make sure that everybody got the same standard of care,” says Samadani. “My goal is to change the way brain injury is diagnosed and defined.”
Q. We are sitting here in the so-called pop-up network state Zuzalu temporarily realized in the village of Lusticia Bay by the beautiful Mediterranean Sea. To me this is an entirely new concept: What is a network state?
A. A network state is a highly aligned online community that has a level of in-person civility; it crowd-funds territory, and it eventually seeks diplomatic recognition. In a way it's about starting a new country. The term was coined by the crypto influencer and former CTO of Coinbase Balaji Srinivasan in a book by the same title last year [2022]. What many people don't know is that it is a more recent addition or innovation in a space called competitive governance. The idea is that you have multiple jurisdictions competing to provide you services as a customer. When you have competition among governments or government service providers, these entities are forced to provide you with a better service instead of the often worse service at higher prices or higher taxes that we're currently getting. The idea went from seasteading, which was hardly feasible because of costs, to charter cities getting public/private partnerships with existing governments and a level of legal autonomy, to special economic zones, to now network states.
Q. How do network states compare to charter cities and similar jurisdictions?
A. Charter cities and special economic zones were legal forks from other existing states. Dubai, Shenzhen in China, to some degree Hong Kong, to some degree Singapore are some examples. There's a host of other charter cities, one of which I'm based in myself, which is Prospera located in Honduras on the island Roatán. Charter cities provide the full stack of governance; they provide new laws and regulations, business registration, tax codes and governance services, Estonia style: you log on to the government platform and you get services as a citizen.
When conceptualizing network states, Balagi Srinivasan turns the idea of a charter city a bit on its head: he doesn't want to start with this full stack because it's still very hard to get these kinds of partnerships with government. It's very expensive and requires lots of experience and lots of social capital. He is saying that network states could instead start as an online community. They could have a level of alignment where they trade with each other; they have their own economy; they meet in person in regular gatherings like we're doing here in Zuzulu for two months, and then they negotiate with existing governments or host cities to get a certain degree of legal autonomy that is centered around a moral innovation. So, his idea is: don't focus on building a completely new country or city; focus on a moral innovation.
Q. What would be an example of such a moral innovation?
A. An example would be longevity—life is good; death is bad—let's see what we can do to foster progress around that moral innovation and see how we can get legal forks from the existing system that allow us to accelerate progress in that area. There is an increasing realization in the science that there are hallmarks of aging and that aging is a cause of other diseases like cancer, ALS or Alzheimer's. But aging is not recognized as a disease by the FDA in the United States and in most countries around the world, so it's very hard to get scientific funding for biotechnology that would attack the hallmarks of aging and allow us potentially to reverse aging and extend life. This is a significant shortcoming of existing government systems that groups such as the ones that have come together here in Montenegro are now seeking alternatives too. Charter cities and now network states are such alternatives.
Q. Would it not be better to work within the current systems, and try to improve them, rather than abandon them for new experimental jurisdictions?
A. There are numerous failures of public policies. These failures are hard, if not impossible, to reverse, because as soon as you have these policies, you have entrenched interests who benefit from the regulations. The only way to disrupt incumbent industries is with start-ups, but the way the system is set up makes it excessively hard for such start-ups to become big companies. In fact, larger companies are weaponizing the legal system against small companies, because they can afford the lawyers and the fixed cost of compliance.
I don't believe that our institutions in many developed countries are beyond hope. I just think it's easier to change them if you could point at successful examples. ‘Hey, this country or this zone is already doing it very successfully’; if they can extend people’s lifespan by 10 years, if they can reduce maternal mortality, and if they have a massive medical tourism where people come back healthier, then that is just very embarrassing for the FDA.
Q. Perhaps a comparison here would be the relationship between Hong Kong and China?
A. Correct, so having Hong Kong right in front of your door … ‘Hey, this capitalism thing seems to work, why don't we try it here?’ It was due to the very bold leadership by Deng Xiaoping that they experimented with it in the development zone of Shenzhen. It worked really well and then they expanded with more special economic zones that also worked.
Próspera is a private city and special economic zone on the island of Roatán in the Central American state of Honduras.
Q. Tell us about Prospera, the charter city in Honduras, that you are intimately connected with.
A. Honduras is a very poor country. It has a lot of crime, never had a single VC investment, and has a GDP per capita of 2,000 per year. Honduras has suffered tremendously. The goal of these special economic zones is to bring in economic development. That's their sole purpose. It's a homegrown innovation from Honduras that started in 2009 with a very forward-thinking statesman, Octavio Sanchez, who was the chief of staff to the president of Honduras, and then president. He had his own ideas about making Honduras a more decentralized system, where more of the power lies in the municipalities.
Inspired by the ideas of Nobel laureate economist Paul Romer, who gave a famous Ted Talk in 2009 about charter cities, Sanchez initiated a process that lasted for years and eventually led to the creation of a special economic zone legal regime that’s anchored in the Hunduran constitution that provides the highest legal autonomy in the world to these zones. There are today three special economic zones approved by the Honduran government: Prospera, Ciudad Morazan and Orchidea.
Q. How did you become interested and then involved in Prospera?
A. I read about it first in an article by Scott Alexander, a famous rationalist blogger, who wrote a very long article about Prospera, and I thought, this is amazing! Then I came to Prospera and I found it to be one of the most if not the most exciting project in the world going on right now and that it also opened my heart to the country and its people. Most of my friends there are Honduran, they have been working on this for 10 or more years. They want to remake Honduras and put it on the map as the place in the world where this legal and governance innovation started.
Q. To what extent is Prospera autonomous relative to the Honduran government?
A. What's interesting about the Honduran model is that it's anchored within the Honduran constitution, and it has a very clear framework for what's possible and what's not possible, and what's possible ensures the highest degree of legal autonomy anywhere seen in the world. Prospera has really pushed the model furthest in creating a common law-based polycentric legal system. The idea is that you don't have a legislature, instead you have common law and it's based on the best practice common law principles that a legal scholar named Tom W. Bell created.
One of the core ideas is that as a business you're not obligated to follow one regulatory monopoly like the FDA. You have regulatory flexibility so you can choose what you're regulated under. So, you can say: ‘if I do a medical clinic, I do it under Norwegian law here’. And you even have the possibility to amend it a bit. You're still required to have liability insurance, and have to agree to binding arbitration in case there's a legal dispute. And your insurance has to approve you. So, under that model the insurance becomes the regulator and they regulate through prices. The limiting factor is criminal law; Honduran criminal law fully applies. So does immigration law. And we pay taxes.
Q. Is there also an idea of creating a kind of healthy living there, and encourage medical tourism?
A. Yes, we specifically look for legal advantages in autonomy around creating new drugs, doing clinical trials, doing self-medication and experimentation. There is a stem cell clinic here and they're doing clinical trials. The island of Roatán is very easily accessible for American tourists. It's a beautiful island, and it's for regulatory reasons hard to do stem cell therapies in the United States, so they're flying in patients from the United States. Most of them are very savvy and often have PhDs in biotech and are able to assess the risk for themselves of taking drugs and doing clinical trials. We're also going to get a wellness center, and there have been ideas around establishing a peptide clinic and a compound pharmacy and things like that. We are developing a healthcare ecosystem.
Q. This kind of experimental tourism raises some ethical issues. What happens if patients are harmed? And what are the moral implications for society of these new treatments?
A. As a moral principle we believe in medical freedom: people have rights over their bodies, even at the (informed) risk of harm to themselves if no unconsenting third-parties are harmed; this is a fundamental right currently not protected effectively.
What we do differently is not changing ethical norms around safety and efficacy, we’re just changing the institutional setup. Instead of one centralized bureaucracy, like the FDA, we have regulatory pluralism that allows different providers of safety and efficacy to compete under market rules. Like under any legal system, common law in Prospera punishes malpractice, fraud, murder etc. This system will still produce safe and effective drugs, and it will still work with common sense legal notions like informed consent and liability for harm. There are regulations for medical practice, there is liability insurance and things like that. It will just do so more efficiently than the current way of doing things (unless it won’t, in which case it will change and evolve – or fail).
A direct moral benefit ´to what we do is that we increase accessibility. Typical gene therapies on the market cost $1 million dollars in the US. The gene therapy developed in Prospera costs $25,000. As to concern about whether such treatments are problematic, we do not share this perspective. We are for advancing science responsibly and we believe that both individuals and society stand to gain from improving the resiliency of the human body through advanced biotechnology.
Q. How does Prospera relate to the local Honduran population?
A. I think it's very important that our projects deliver local benefits and that they're well anchored in local communities. Because when you go to a new place, you're seen as a foreigner, and you're seen as potentially a danger or a threat. The most important thing for Prospera and Ciudad Morazan is to show we're creating jobs; we're creating employment; we're improving people's lives on the ground. Prospera is directly and indirectly employing 1,100 people. More than 2/3 of the people who are working for Prospera are Honduran. It has a lot of local service workers from the island, and it has educated Hondurans from the mainland for whom it's an alternative to going to the United States.
Q. What makes a good Prosperian citizen?
A. People in Prospera are very entrepreneurial. They're opening companies on a small scale. For example, Vehinia, who is the cook in the kitchen at Prospera, she's from the neighboring village and she started an NGO that is now funding a school where children from the local village can go to instead of a school that's 45 minutes away. There's very much a spirit of ‘let's exchange and trade with each other’. Some people might see that as a bit too commercial, but that's something about the culture that people accept and that people see as a good thing.
Q. Five years from now, if everything goes well, what do we see in Prospera?
A. I think Prospera will have at least 10,000 residents and I think Honduras hopefully will have more zones. There could be zones with a thriving industrial sector and sort of a labor-intensive economy and some that are very strong in pharmaceuticals, there could also be other zones for synthetic biology, and other zones focused on agriculture. The zones of Prospera, Ciudad Morazan and Orchidea are already showing the results we want to see, the results that we will eventually be measured by, and I'm tremendously excited about Honduras.
Through her research and companies, Dr. Picard has developed wearable sensors, algorithms and systems for sensing, recognizing and responding to information about human emotion. Her products are focused on using fitness trackers to advance clinical quality treatments for a range of conditions.
Meanwhile, in just the past few years, numerous fitness tracking companies have released products with their own stress sensors and systems. You may have heard about Fitbit’s Stress Management Score, or Whoop’s Stress Monitor – these features and apps measure things like your heart rhythm and a certain type of invisible sweat to identify stress. They’re designed to raise awareness about forms of stress such as anxieties and anger, and suggest strategies like meditation to relax in real time when stress occurs.
But how well do these off-the-shelf gadgets work? There’s no one more knowledgeable and experienced than Rosalind Picard to explain the science behind these stress features, what they do exactly, how they might be able to help us, and their current shortcomings.
Dr. Picard is a member of the National Academy of Engineering and a Fellow of the National Academy of Inventors, and a popular speaker who’s given over a hundred invited keynote talks and a TED talk with over 2 million views. She holds a Bachelors in Electrical Engineering from Georgia Tech, and Masters and Doctorate degrees in Electrical Engineering and Computer Science from MIT. She lives in Newton, Massachusetts with her husband, where they’ve raised three sons.
In our conversation, we discuss stress scores on fitness trackers to improve well-being. She describes the difference between commercial products that might help people become more mindful of their health and products that are FDA approved and really capable of advancing the science. We also talk about several fascinating findings and concepts discovered in Dr. Picard’s lab including the multiple arousal theory, a phenomenon you’ll want to hear about. And we explore the complexity of stress, one reason it’s so tough to measure. For example, many forms of stress are actually good for us. Can fitness trackers tell the difference between stress that’s healthy and unhealthy?
Show links:
- Dr. Picard’s book, Affective Computing
- Dr. Picard’s bio
- Dr. Picard on Twitter
- Dr. Picard’s company, Empatica - https://www.empatica.com/ - The FDA-cleared Empatica Health Monitoring Platform provides accurate, continuous health insights for researchers and clinicians, collected in the real world
- Empatica Twitter
- Dr. Picard and her team have published hundreds of peer-reviewed articles across AI, Machine Learning, Affective Computing, Digital Health, and Human-computer interaction.
- Dr. Picard’s TED talk
Rosalind Picard