So-Called “Puppy Mills” Are Not All As Bad As We Think, Pioneering Research Suggests
Candace Croney joined the faculty at Purdue University in 2011, thinking her job would focus on the welfare of livestock and poultry in Indiana. With bachelor's, master's, and doctoral degrees in animal sciences, her work until then had centered on sheep, cattle, and pigs. She'd even had the esteemed animal behaviorist Temple Grandin help shape her master's research project.
Croney's research has become the first of its kind in the world—and it's challenging our understanding of how dog breeding is being done.
Then came an email from a new colleague asking Croney to discuss animal welfare with some of Indiana's commercial dog breeders, the kind who produce large quantities of puppies for sale in pet stores.
"I didn't even know the term commercial breeders," Croney says. "I'd heard the term 'puppy millers.' That's pretty much what I knew."
She went to the first few kennels and braced herself for an upsetting experience. She's a dog lover who has fostered shelter mutts and owned one, and she'd seen the stories: large-scale breeders being called cruel and evil, lawmakers trying to ban the sale of commercially bred puppies, and constant encouragement to rescue a dog instead of paying into a greedy, heartless "puppy mill" industry.
But when she got to the kennels, she was surprised. While she encountered a number of things she didn't like about the infrastructure at the older facilities—a lack of ventilation, a lot of noise, bad smells—most of the dogs themselves were clean. The majority didn't have physical problems. No open sores. No battered bodies. Nothing like what she'd seen online.
But still, the way the dogs acted gave her pause.
"Things were, in many regards, better than I thought they would be," Croney says. "Google told me the dogs would be physically a mess, and they weren't, but behaviorally, things were jumping out at me."
While she did note that some of the breeders had play yards for their pups, a number of the dogs feared new people and things like leashes because they hadn't been exposed to enough of them. Some of the dogs also seemed to lack adequate toys, activities, and games to keep them mentally and physically stimulated.
But she was there strictly as a representative of the university to ask questions and offer feedback, no more or less. A few times, she says, she felt like the breeders wanted her to endorse what they were doing, "and I immediately got my back up about that. I did not want my name used to validate things that I could tell I didn't agree with. It was uncomfortable from that perspective."
After sharing the animal-welfare information her colleague had requested, Croney figured that was that. She never expected to be in a commercial kennel again. But six months later, her phone rang. Some of the people she'd met were involved in legislative lobbying, and they were trying to write welfare standards for Indiana's commercial breeders to follow.
In the continuing battle over what is, and is not, a "puppy mill," they wanted somebody with a strong research background to set a baseline standard, somebody who would actually bring objectivity to the breeder-activist conflict without being on one side or the other.
In other words, they wanted Croney's help to figure out not only appropriate enclosure sizes, but also requirements for socialization and enrichment activities—stimulation she knew the dogs desperately needed.
"I thought, crap, how am I not going to help?" she recalls. "And they said, 'Well how long will that take? A couple of weeks? A month?'"
Dr. Croney with Theo, whom she calls "a beloved family member of our research team."
(Photo credit: Purdue University/Vincent Walter)
Six years later, Croney's research remains ongoing. It has become the first of its kind in the world—and it's challenging our understanding of how dog breeding is being done, and how it could and should be done for years to come.
How We Got Here
Americans have been breeding pet dogs in large-scale kennels since World War II. The federal standard that regulates those kennels is the Animal Welfare Act, which President Johnson signed into law in 1966. Back then, people thought it was OK to treat dogs a lot differently than they do today. The law has been updated, but it still allows a dog the size of a Beagle to be kept in a cage the size of a dishwasher all day, every day because for some dogs, when the law was written, having a cage that size meant an improvement in living conditions.
Countless commercial breeders, who are regularly inspected under the Animal Welfare Act, have long believed that as long as they followed the law, they were doing things right. And they've seen sales for their puppies go up and up over the years. About 38 percent of U.S. households now own one or more dogs, the highest rate since the American Veterinary Medical Association began measuring the statistic in 1982.
Consumers now demand eight million dogs per year, which has reinforced breeders' beliefs that despite what activists shout at protests, the breeders are actually running businesses the public supports. As one Ohio commercial breeder—long decried by activists as a "puppy mill" owner—told The Washington Post in 2016, "This is a customer-driven industry. If we weren't satisfying the customer, we'd starve to death. I've never seen prices like the ones we're seeing now, in my whole career."
That breeder, though, is also among leading industry voices who say they understand that public perception of what's acceptable and what's not in a breeding kennel has changed. Regardless of what the laws are, they say, kennels must change along with the public's wishes if the commercial breeding industry is going to survive. The question is how, exactly, to move from the past to the future, at a time when demands for change have reached a fever pitch.
"The Animal Welfare Act, that was gospel. It meant you were taking care of dogs," says Bob Vetere, former head of the American Pet Products Association and now chairman of the Pet Leadership Council. "That was, what, 40 years ago? Things have evolved. People understand much more since then—and back then, there were maybe 20 million dogs in the country. Now, there's 90 million. It's that dramatic. People love their dogs, and everybody is going to get one."
Vetere became an early supporter of Croney's research, which, unbelievably, became the first ever to focus on what it actually means to run a good commercial breeding kennel. At the start of her research, Croney found that the scientific literature underpinning many existing laws and opinions was not just lacking, but outright nonexistent.
"We kept finding it over and over," she says of the literature gaps, citing common but uninformed beliefs about appropriate kennel size as just one example. "I can't find any research about how much space they're supposed to have. People said, 'Yeah, we had a meeting and a bunch of people made some recommendations.'"
She started filling in the research gaps with her team at Purdue, building relationships with dog breeders until she had more than 100 kennels letting her methodically figure out what was actually working for the dogs.
"The measurable successes in animal welfare over the past 50 years began from a foundation in science."
Creating Standards from Scratch
Other industry players soon took notice. One was Ed Sayres, who had served as CEO of the ASPCA for nearly a decade before turning his attention to lobbying efforts regarding the "puppy mill" issue. He recognized that what Croney was doing for commercial breeding mirrored the early work researchers started a half-century ago in the effort that led to better shelters all across America today.
"The measurable successes in animal welfare over the past 50 years began from a foundation in science," Sayres says. "Whether it was the transition to more humane euthanasia methods or how to manage dog and cat overpopulation, we found success from rigorous examination of facts and emerging science."
Sayres, Vetere, and others began pushing for the industry to support Croney's work, moving the goalposts beyond Indiana to the entire United States.
"If you don't have commercial breeding, you have people importing dogs from overseas with no restrictions, or farming in their backyards to make money," Vetere says. "You need commercial breeders with standards—and that's what Candace is trying to create, those standards."
Croney ended up with a $900,000 grant from three industry organizations: the World Pet Association, Pet Food Institute, and the Pet Industry Joint Advisory Council. With their support, she created a nationwide program called Canine Care Certified, like a Good Housekeeping Seal of Approval for a kennel. The program focuses on outcome-based standards, meaning she looks at what the dogs tell her about how well they are doing through their health and behavior. For the most part, beyond baseline requirements, the program lets a breeder achieve those goals in whatever ways work for the dogs.
The approach is different from many legislative efforts, with laws stating a cage must be made three feet larger to be considered humane. Instead, Croney walks through kennels with breeders and points out, for instance, which puppies in a litter seem to be shy or fearful, and then teaches the breeders how to give those puppies better socialization. She helps the breeders find ways to introduce dogs to strangers and objects like umbrellas that may not be part of regular kennel life, but will need to become familiar when the breeding dog retires and gets adopted into a home as a pet. She helps breeders understand that dogs need mental as well as physical stimulation, whether it comes from playing with balls and toys or running up and down slides.
The breeders can't learn fast enough, Croney says, and she remains stunned at how they constantly ask for more information—an attitude that made her stop using the term "puppy mill" to describe them at all.
"Now, full disclosure: Given that all of these kennels had volunteered, the odds were that we were seeing a skewed population, and that it skewed positive," she says. "But if you read what was in the media at the time, we shouldn't have been able to find any. We're told that all these kennels are terrible. Clearly, it was possible to get a positive outcome."
To Buy or Not to Buy?
Today, she says, she's shocked at how quickly some of the kennels have improved. Facilities that appalled her at first sight now have dogs greeting people with wagging tails.
"Not only would I get a dog from them, but would I put my dog there in that kennel temporarily? Yeah, I would."
"The most horrifying thing I learned was that some of these people weren't doing what I'd like to see, not because they didn't care or only wanted money, but because nobody had ever told them," she says. "As it turned out, they didn't know any different, and no one would help them."
For Americans who want to know whether it's OK to get a commercially bred puppy, Croney says she thinks about her own dogs. When she started working with the breeders, there were plenty of kennels that, she says, she would not have wanted to patronize. But now she's changing her mind about more and more of them.
"I'm just speaking as somebody who loves dogs and wants to make sure I'm not subsidizing anything inhumane or cruel," she says. "Not only would I get a dog from them, but would I put my dog there in that kennel temporarily? Yeah, I would."
She says the most important thing is for consumers to find out how a pup was raised, and how the pup's parents were raised. As with most industries, commercial breeders run the gamut, from barely legal to above and beyond.
Not everyone agrees with Croney's take on the situation, or with her approach to improving commercial breeding kennels. In its publication "Puppy Mills and the Animal Welfare Act," the Humane Society of the United States writes that while Croney's Canine Care Certified program supports "common areas of agreement" with animal-welfare lobbyists, her work has been funded by the pet industry—suggesting that it's impure—and a voluntary program is not enough to incentivize breeders to improve.
New laws, the Humane Society states, must be enacted to impose change: "Many commercial dog breeding operators will not raise their standards voluntarily, and even if they were to agree to do so it is not clear whether there would be any independent mechanism for enforcement or transparency for the public's sake. ... The logical conclusion is that improved standards must be codified."
Croney says that type of attitude has long created resentment between breeders and animal-welfare activists, as opposed to actual kennel improvements. Both sides have a point; for years, there have been examples of bottom-of-the-barrel kennels that changed their ways or shut down only after regulators smacked them with violations, or after lawmakers raised operating standards in ways that required improvements for the kennels to remain legally in business.
At the same time, though, powerful organizations including the Humane Society—which had revenue of more than $165 million in 2018 alone—have routinely pushed for bans on stores that sell commercially bred puppies, and have decried "puppy mills" in marketing and fund-raising literature, without offering financial grants or educational programs to kennels that are willing to improve.
Croney believes that the reflexive demonization of all commercial breeders is a mistake. Change is more effective, she says, when breeders "want to do better, want to learn, want to grow, and you treat them as advocates and allies in doing something good for animal welfare, as opposed to treating them like they're your enemies."
"If you're watching undercover videos about people treating animals in bad ways, I'm telling you, change is happening."
She adds that anyone who says all commercial breeders are "puppy mills" needs to take a look at the kennels she's seen and the changes her work has brought—and is continuing to bring.
"The ones we work with are working really, really hard to improve and open their doors so that if somebody wants to get a dog from them, they can be assured that those dogs were treated with a level of care and compassion that wasn't there five or 10 years ago, but that is there now and will be better in a year and will be much better in five years," she says. "If you're watching undercover videos about people treating animals in bad ways, I'm telling you, change is happening. It is so much better than people realize, and it continues to get even better yet."
Send in the Robots: A Look into the Future of Firefighting
April in Paris stood still. Flames engulfed the beloved Notre Dame Cathedral as the world watched, horrified, in 2019. The worst looked inevitable when firefighters were forced to retreat from the out-of-control fire.
But the Paris Fire Brigade had an ace up their sleeve: Colossus, a firefighting robot. The seemingly indestructible tank-like machine ripped through the blaze with its motorized water cannon. It was able to put out flames in places that would have been deadly for firefighters.
Firefighting is entering a new era, driven by necessity. Conventional methods of managing fires have been no match for the fiercer, more expansive fires being triggered by climate change, urban sprawl, and susceptible wooded areas.
Robots have been a game-changer. Inspired by Paris, the Los Angeles Fire Department (LAFD) was the first in the U.S. to deploy a firefighting robot in 2021, the Thermite Robotics System 3 – RS3, for short.
RS3 is a 3,500-pound turbine on a crawler—the size of a Smart car—with a 36.8 horsepower engine that can go for 20 hours without refueling. It can plow through hazardous terrain, move cars from its path, and pull an 8,000-pound object from a fire.
All that while spurting 2,500 gallons of water per minute with a rear exhaust fan clearing the smoke. At a recent trade show, RS3 was billed as equivalent to 10 firefighters. The Los Angeles Times referred to it as “a droid on steroids.”
Robots such as the Thermite RS3 can plow through hazardous terrain and pull an 8,000-pound object from a fire.
Los Angeles Fire Department
The advantage of the robot is obvious. Operated remotely from a distance, it greatly reduces an emergency responder’s exposure to danger, says Wade White, assistant chief of the LAFD. The robot can be sent into airplane fires, nuclear reactors, hazardous areas with carcinogens (think East Palestine, Ohio), or buildings where a roof collapse is imminent.
Advances for firefighters are taking many other forms as well. Fibers have been developed that make the firefighter’s coat lighter and more protective from carcinogens. New wearable devices track firefighters’ biometrics in real time so commanders can monitor their heat stress and exertion levels. A sensor patch is in development which takes readings every four seconds to detect dangerous gases such as methane and carbon dioxide. A sonic fire extinguisher is being explored that uses low frequency soundwaves to remove oxygen from air molecules without unhealthy chemical compounds.
The demand for this technology is only increasing, especially with the recent rise in wildfires. In 2021, fires were responsible for 3,800 deaths and 14,700 injuries of civilians in this country. Last year, 68,988 wildfires burned down 7.6 million acres. Whether the next generation of firefighting can address these new challenges could depend on special cameras, robots of the aerial variety, AI and smart systems.
Fighting fire with cameras
Another key innovation for firefighters is a thermal imaging camera (TIC) that improves visibility through smoke. “At a fire, you might not see your hand in front of your face,” says White. “Using the TIC screen, you can find the door to get out safely or see a victim in the corner.” Since these cameras were introduced in the 1990s, the price has come down enough (from $10,000 or more to about $700) that every LAFD firefighter on duty has been carrying one since 2019, says White.
TICs are about the size of a cell phone. The camera can sense movement and body heat so it is ideal as a search tool for people trapped in buildings. If a firefighter has not moved in 30 seconds, the motion detector picks that up, too, and broadcasts a distress signal and directional information to others.
To enable firefighters to operate the camera hands-free, the newest TICs can attach inside a helmet. The firefighter sees the images inside their mask.
TICs also can be mounted on drones to get a bird’s-eye, 360 degree view of a disaster or scout for hot spots through the smoke. In addition, the camera can take photos to aid arson investigations or help determine the cause of a fire.
More help From above
Firefighters prefer the term “unmanned aerial systems” (UAS) to drones to differentiate them from military use.
A UAS carrying a camera can provide aerial scene monitoring and topography maps to help fire captains deploy resources more efficiently. At night, floodlights from the drone can illuminate the landscape for firefighters. They can drop off payloads of blankets, parachutes, life preservers or radio devices for stranded people to communicate, too. And like the robot, the UAS reduces risks for ground crews and helicopter pilots by limiting their contact with toxic fumes, hazardous chemicals, and explosive materials.
“The nice thing about drones is that they perform multiple missions at once,” says Sean Triplett, team lead of fire and aviation management, tools and technology at the Forest Service.
Experts predict we’ll see swarms of drones dropping water and fire retardant on burning buildings and forests in the near future.
The UAS is especially helpful during wildfires because it can track fires, get ahead of wind currents and warn firefighters of wind shifts in real time. The U.S. Forest Service also uses long endurance, solar-powered drones that can fly for up to 30 days at a time to detect early signs of wildfire. Wildfires are no longer seasonal in California – they are a year-long threat, notes Thanh Nguyen, fire captain at the Orange County Fire Authority.
In March, Nguyen’s crew deployed a drone to scope out a huge landslide following torrential rains in San Clemente, CA. Emergency responders used photos and videos from the drone to survey the evacuated area, enabling them to stay clear of ground on the hillside that was still sliding.
Improvements in drone batteries are enabling them to fly for longer with heavier payloads. Experts predict we’ll see swarms of drones dropping water and fire retardant on burning buildings and forests in the near future.
AI to the rescue
The biggest peril for a firefighter is often what they don’t see coming. Flashovers are a leading cause of firefighter deaths, for example. They occur when flammable materials in an enclosed area ignite almost instantaneously. Or dangerous backdrafts can happen when a firefighter opens a window or door; the air rushing in can ignite a fire without warning.
The Fire Fighting Technology Group at the National Institute of Standards and Technology (NIST) is developing tools and systems to predict these potentially lethal events with computer models and artificial intelligence.
Partnering with other institutions, NIST researchers developed the Flashover Prediction Neural Network (FlashNet) after looking at common house layouts and running sets of scenarios through a machine-learning model. In the lab, FlashNet was able to predict a flashover 30 seconds before it happened with 92.1% success. When ready for release, the technology will be bundled with sensors that are already installed in buildings, says Anthony Putorti, leader of the NIST group.
The NIST team also examined data from hundreds of backdrafts as a basis for a machine-learning model to predict them. In testing chambers the model predicted them correctly 70.8% of the time; accuracy increased to 82.4% when measures of backdrafts were taken in more positions at different heights in the chambers. Developers are working on how to integrate the AI into a small handheld device that can probe the air of a room through cracks around a door or through a created opening, Putorti says. This way, the air can be analyzed with the device to alert firefighters of any significant backdraft risk.
Early wildfire detection technologies based on AI are in the works, too. The Forest Service predicts the acreage burned each year during wildfires will more than triple in the next 80 years. By gathering information on historic fires, weather patterns, and topography, says White, AI can help firefighters manage wildfires before they grow out of control and create effective evacuation plans based on population data and fire patterns.
The future is connectivity
We are in our infancy with “smart firefighting,” says Casey Grant, executive director emeritus of the Fire Protection Research Foundation. Grant foresees a new era of cyber-physical systems for firefighters—a massive integration of wireless networks, advanced sensors, 3D simulations, and cloud services. To enhance teamwork, the system will connect all branches of emergency responders—fire, emergency medical services, law enforcement.
FirstNet (First Responder Network Authority) now provides a nationwide high-speed broadband network with 5G capabilities for first responders through a terrestrial cell network. Battling wildfires, however, the Forest Service needed an alternative because they don’t always have access to a power source. In 2022, they contracted with Aerostar for a high altitude balloon (60,000 feet up) that can extend cell phone power and LTE. “It puts a bubble of connectivity over the fire to hook in the internet,” Triplett explains.
A high altitude balloon, 60,000 feet high, can extend cell phone power and LTE, putting a "bubble" of internet connectivity over fires.
Courtesy of USDA Forest Service
Advances in harvesting, processing and delivering data will improve safety and decision-making for firefighters, Grant sums up. Smart systems may eventually calculate fire flow paths and make recommendations about the best ways to navigate specific fire conditions. NIST’s plan to combine FlashNet with sensors is one example.
The biggest challenge is developing firefighting technology that can work across multiple channels—federal, state, local and tribal systems as well as for fire, police and other emergency services— in any location, says Triplett. “When there’s a wildfire, there are no political boundaries,” he says. “All hands are on deck.”
New device can diagnose concussions using AI
For a long time after Mary Smith hit her head, she was not able to function. Test after test came back normal, so her doctors ruled out the concussion, but she knew something was wrong. Finally, when she took a test with a novel EyeBOX device, recently approved by the FDA, she learned she indeed had been dealing with the aftermath of a concussion.
“I felt like even my husband and doctors thought I was faking it or crazy,” recalls Smith, who preferred not to disclose her real name. “When I took the EyeBOX test it showed that my eyes were not moving together and my BOX score was abnormal.” To her diagnosticians, scientists at the Minneapolis-based company Oculogica who developed the EyeBOX, these markers were concussion signs. “I cried knowing that finally someone could figure out what was wrong with me and help me get better,” she says.
Concussion affects around 42 million people worldwide. While it’s increasingly common in the news because of sports injuries, anything that causes damage to the head, from a fall to a car accident, can result in a concussion. The sudden blow or jolt can disrupt the normal way the brain works. In the immediate aftermath, people may suffer from headaches, lose consciousness and experience dizziness, confusion and vomiting. Some recover but others have side effects that can last for years, particularly affecting memory and concentration.
There is no simple standard-of-care test to confirm a concussion or rule it out. Neither do they appear on MRI and CT scans. Instead, medical professionals use more indirect approaches that test symptoms of concussions, such as assessments of patients’ learning and memory skills, ability to concentrate and problem solving. They also look at balance and coordination. Most tests are in the form of questionnaires or symptom checklists. Consequently, they have limitations, can be biased and may miss a concussion or produce a false positive. Some people suspected of having a concussion may ordinarily have difficulties with literary and problem-solving tests because of language challenges or education levels.
Another problem with current tests is that patients, particularly soldiers who want to return to combat and athletes who would like to keep competing, could try and hide their symptoms to avoid being diagnosed with a brain injury. Trauma physicians who work with concussion patients have the need for a tool that is more objective and consistent.
“This type of assessment doesn’t rely on the patient's education level, willingness to follow instructions or cooperation. You can’t game this.” -- Uzma Samadani, founder of Oculogica
“The importance of having an objective measurement tool for the diagnosis of concussion is of great importance,” says Douglas Powell, associate professor of biomechanics at the University of Memphis, with research interests in sports injury and concussion. “While there are a number of promising systems or metrics, we have yet to develop a system that is portable, accessible and objective for use on the sideline and in the clinic. The EyeBOX may be able to address these issues, though time will be the ultimate test of performance.”
The EyeBOX as a window inside the brain
Using eye movements to diagnose a concussion has emerged as a promising technique since around 2010. Oculogica combined eye movements with AI to develop the EyeBOX to develop an unbiased objective diagnostic tool.
“What’s so great about this type of assessment is it doesn’t rely on the patient's education level, willingness to follow instructions or cooperation,” says Uzma Samadani, a neurosurgeon and brain injury researcher at the University of Minnesota, who founded Oculogica. “You can’t game this. It assesses functions that are prompted by your brain.”
In 2010, Samadani was working on a clinical trial to improve the outcome of brain injuries. The team needed some way to measure if seriously brain injured patients were improving. One thing patients could do was watch TV. So Samadani designed and patented an AI-based algorithm that tracks the relationship between eye movement and concussion.
The EyeBOX test requires patients to watch movie or music clips for 220 seconds. An eye tracking camera records subconscious eye movements, tracking eye positions 500 times per seconds as patients watch the video. It collects over 100,000 data points. The device then uses AI to assess whether there’s any disruptions from the normal way the eyes move.
Cranial nerves are responsible for transmitting information between the brain and the body. Many are involved in eye movement. Pressure caused by a concussion can affect how these nerves work. So tracking how the eyes move can indicate if there’s anything wrong with the cranial nerves and where the problem lies.
If someone is healthy, their eyes should be able to focus on an object, follow movement and both eyes should be coordinated with each other. The EyeBox can detect abnormalities. For example, if a patient’s eyes are coordinated but they are not moving as they should, that indicates issues in the central brain stem, whilst only one eye moving abnormally suggests that a particular nerve section is affected.
Uzma Samadani with the EyeBOX device
Courtesy Oculogica
“The EyeBOX is a monitor for cranial nerves,” says Samadani. “Essentially it’s a form of digital neurological exam. “Several other eye-tracking techniques already exist, but they rely on subjective self-reported symptoms. Many also require a baseline, a measure of how patients reacted when they were healthy, which often isn’t available.
VOMS (Vestibular Ocular Motor Screen) is one of the most accurate diagnostic tests used in clinics in combination with other tests, but it is subjective. It involves a therapist getting patients to move their head or eyes as they focus or follow a particular object. Patients then report their symptoms.
The King-Devick test measures how fast patients can read numbers and compares it to a baseline. Since it is mainly used for athletes, the initial test is completed before the season starts. But participants can manipulate it. It also cannot be used in emergency rooms because the majority of patients wouldn’t have prior baseline tests.
Unlike these tests, EyeBOX doesn’t use a baseline and is objective because it doesn’t rely on patients’ answers. “It shows great promise,” says Thomas Wilcockson, a senior lecturer of psychology in Loughborough University, who is an expert in using eye tracking techniques in neurological disorders. “Baseline testing of eye movements is not always possible. Alternative measures of concussion currently in development, including work with VR headsets, seem to currently require it. Therefore the EyeBOX may have an advantage.”
A technology that’s still evolving
In their last clinical trial, Oculogica used the EyeBOX to test 46 patients who had concussion and 236 patients who did not. The sensitivity of the EyeBOX, or the probability of it correctly identifying the patient’s concussion, was 80.4 percent. Meanwhile, the test accurately ruled out a concussion in 66.1 percent of cases. This is known as its specificity score.
While the team is working on improving the numbers, experts who treat concussion patients find the device promising. “I strongly support their use of eye tracking for diagnostic decision making,” says Douglas Powell. “But for diagnostic tests, we would prefer at least one of the sensitivity or specificity values to be greater than 90 percent. Powell compares EyeBOX with the Buffalo Concussion Treadmill Test, which has sensitivity and specificity values of 73 and 78 percent, respectively. The VOMS also has shown greater accuracy than the EyeBOX, at least for now. Still, EyeBOX is competitive with the best diagnostic testing available for concussion and Powell hopes that its detection prowess will improve. “I anticipate that the algorithms being used by Oculogica will be under continuous revision and expect the results will improve within the next several years.”
“The color of your skin can have a huge impact in how quickly you are triaged and managed for brain injury. People of color have significantly worse outcomes after traumatic brain injury than people who are white.” -- Uzma Samadani, founder of Oculogica
Powell thinks the EyeBOX could be an important complement to other concussion assessments.
“The Oculogica product is a viable diagnostic tool that supports clinical decision making. However, concussion is an injury that can present with a wide array of symptoms, and the use of technology such as the Oculogica should always be a supplement to patient interaction.”
Ioannis Mavroudis, a consultant neurologist at Leeds Teaching Hospital, agrees that the EyeBOX has promise, but cautions that concussions are too complex to rely on the device alone. For example, not all concussions affect how eyes move. “I believe that it can definitely help, however not all concussions show changes in eye movements. I believe that if this could be combined with a cognitive assessment the results would be impressive.”
The Oculogica team submitted their clinical data for FDA approval and received it in 2018. Now, they’re working to bring the test to the commercial market and using the device clinically to help diagnose concussions for clients. They also want to look at other areas of brain health in the next few years. Samadani believes that the EyeBOX could possibly be used to detect diseases like multiple sclerosis or other neurological conditions. “It’s a completely new way of figuring out what someone’s neurological exam is and we’re only beginning to realize the potential,” says Samadani.
One of Samadani’s biggest aspirations is to help reduce inequalities in healthcare because of skin color and other factors like money or language barriers. From that perspective, the EyeBOX’s greatest potential could be in emergency rooms. It can help diagnose concussions in addition to the questionnaires, assessments and symptom checklists, currently used in the emergency departments. Unlike these more subjective tests, EyeBOX can produce an objective analysis of brain injury through AI when patients are admitted and assessed, unrelated to their socioeconomic status, education, or language abilities. Studies suggest that there are racial disparities in how patients with brain injuries are treated, such as how quickly they're assessed and get a treatment plan.
“The color of your skin can have a huge impact in how quickly you are triaged and managed for brain injury,” says Samadani. “As a result of that, people of color have significantly worse outcomes after traumatic brain injury than people who are white. The EyeBOX has the potential to reduce inequalities,” she explains.
“If you had a digital neurological tool that you could screen and triage patients on admission to the emergency department you would potentially be able to make sure that everybody got the same standard of care,” says Samadani. “My goal is to change the way brain injury is diagnosed and defined.”