In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Dave Arnold retired in his 60s and began spending time volunteering in local schools. But then he started misplacing items, forgetting appointments and losing his sense of direction. Eventually he was diagnosed with early stage Alzheimer’s.
“Hearing the diagnosis made me very emotional and tearful,” he said. “I immediately thought of all my mom had experienced.” His mother suffered with the condition for years before passing away. Over the last year, Arnold has worked for the Alzheimer’s Association as one of its early stage advisors, sharing his insights to help others in the initial stages of the disease.
Arnold was diagnosed sooner than many others. It's important to find out early, when interventions can make the most difference. One promising avenue is looking at how people talk. Research has shown that Alzheimer’s affects a part of the brain that controls speech, resulting in small changes before people show other signs of the disease.
Now, Canary Speech, a company based in Utah, is using AI to examine elements like the pitch of a person’s voice and their pauses. In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Developing the AI model
Canary Speech’s CEO, Henry O’Connell, met cofounder Jeff Adams about 40 years before they started the company. Back when they first crossed paths, they were both living in Bethesda, Maryland; O’Connell was a research fellow at the National Institutes of Health studying rare neurological diseases, while Adams was working to decode spy messages. Later on, Adams would specialize in building mathematical models to analyze speech and sound as a team leader in developing Amazon's Alexa.
It wasn't until 2015 that they decided to make use of the fit between their backgrounds. ““We established Canary Speech in 2017 to build a product that could be used in multiple languages in clinical environments,” O'Connell says.
The need is growing. About 55 million people worldwide currently live with Alzheimer’s, a number that is expected to double by 2050. Some scientists think the disease results from a buildup of plaque in the brain. It causes mild memory loss at first and, over time, this issue get worse while other symptoms, such as disorientation and hallucinations, can develop. Treatment to manage the disease is more effective in the earlier stages, but detection is difficult since mild symptoms are often attributed to the normal aging process.
O’Connell and Adams specialize in the complex ways that Alzheimer’s effects how people speak. Using AI, their mathematical model analyzes 15 million data points every minute, focusing on certain features of speech such as pitch, pauses and elongation of words. It also pays attention to how the vibrations of vocal cords change in different stages of the disease.
To create their model, the team used a type of machine learning called deep neural nets, which looks at multiple layers of data - in this case, the multiple features of a person’s speech patterns.
“Deep neural nets allow us to look at much, much larger data sets built out of millions of elements,” O’Connell explained. “Through machine learning and AI, we’ve identified features that are very sensitive to an Alzheimer’s patient versus [people without the disease] and also very sensitive to mild cognitive impairment, early stage and moderate Alzheimer's.” Based on their learnings, Canary is able to classify the disease stage very quickly, O’Connell said.
“When we’re listening to sublanguage elements, we’re really analyzing the direct result of changes in the brain in the physical body,” O’Connell said. “The brain controls your vocal cords: how fast they vibrate, the expansion of them, the contraction.” These factors, along with where people put their tongues when talking, function subconsciously and result in subtle changes in the sounds of speech.
Further testing is needed
In an initial trial, Canary analyzed speech recordings from phone calls to a large U.S. health insurer. They looked at the audio recordings of 651 policyholders who had early stage Alzheimer’s and 1018 who did not have the condition, aiming for a representative sample of age, gender and race. They used this data to create their first diagnostic model and found that it was 96 percent accurate in identifying Alzheimer’s.
Christian Herff, an assistant professor of neuroscience at Maastricht University in the Netherlands, praised this approach while adding that further testing is needed to assess its effectiveness.
“I think the general idea of identifying increased risk for cognitive impairment based on speech characteristics is very feasible, particularly when change in a user’s voice is monitored, for example, by recording speech every year,” Herff said. He noted that this can only be a first indication, not a full diagnosis. The accuracy still needs to be validated in studies that follows individuals over a period of time, he said.
Toby Walsh, a professor of artificial intelligence at the University of New South Wales, also thinks Canary’s tool has potential but highlights that Canary could diagnose some people who don’t really have the disease. “This is an interesting and promising application of AI,” he said, “but these tools need to be used carefully. Imagine the anxiety of being misdiagnosed with Alzheimer’s.”
As with many other AI tools, privacy and bias are additional issues to monitor closely, Walsh said.
Other languages
A related issue is that not everyone is fluent in English. Mahnaz Arvaneh, a senior lecturer in automatic control and systems engineering at the University of Sheffield, said this could be a blind spot.
“The system may not be very accurate for those who have English as their second language as their speaking patterns would be different, and any issue might be because of language deficiency rather than cognitive issues,” Arvaneh said.
The team is expanding to multiple languages starting with Japanese and Spanish. The elements of the model that make up the algorithm are very similar, but they need to be validated and retrained in a different language, which will require access to more data.
Recently, Canary analyzed the phone calls of 233 Japanese patients who had mild cognitive impairment and 704 healthy people. Using an English model they were able to identify the Japanese patients who had mild cognitive impairment with 78 percent accuracy. They also developed a model in Japanese that was 45 percent accurate, and they’re continuing to train it with more data.
The future
Canary is using their model to look at other diseases like Huntington’s and Parkinson’s. They’re also collaborating with pharmaceuticals to validate potential therapies for Alzheimer’s. By looking at speech patterns over time, Canary can get an indication of how well these drugs are working.
Dave Arnold and his wife dance at his nephew’s wedding in Rochester, New York, ten years ago, before his Alzheimer's diagnosis.
Dave Arnold
Ultimately, they want to integrate their tool into everyday life. “We want it to be used in a smartphone, or a teleconference call so that individuals could be examined in their home,” O’Connell said. “We could follow them over time and work with clinical teams and hospitals to improve the evaluation of patients and contribute towards an accurate diagnosis.”
Arnold, the patient with early stage Alzheimer’s, sees great promise. “The process of getting a diagnosis is already filled with so much anxiety,” he said. “Anything that can be done to make it easier and less stressful would be a good thing, as long as it’s proven accurate.”
On today’s podcast episode, Leaps.org spoke with Shai Efrati, a physician and professor in the schools of medicine and neuroscience at Tel Aviv University, about the potential health benefits of hyperbaric oxygen therapy.
We talk about what’s going in on the body during hyperbaric oxygen therapy that could possibly lead to transformative benefits for patients, some of whom had searched for treatments previously and come up empty. We also discuss exactly where Efrati is with this line of inquiry, both what his studies have shown and the great deal of additional research that’s needed before the healthcare system can and should fully embrace hyperbaric oxygen therapy.
Efrati and I talk about why you can’t just go on Amazon and buy something that says hyperbaric – the only way it can have a positive effect is if you access the real version of the chamber and use it correctly under the supervision of a knowledgeable physician.
I also ask Efrati what we know about the short- and long-term risks for those who follow the research-based protocol on a regular basis. And what about accessibility to people without a lot of extra cash to spend on their health? Efrati is already rolling out this therapy at a small number of specialized clinics in places like the Villages retirement community in Florida.
Shai Efrati
Hiking is one of Marci Flory's favorite activities, but her chronic Lyme disease sometimes renders her unable to walk. Biotech companies Pfizer and Valneva are testing a vaccine for Lyme disease in a Phase III clinical trial.
“Initially doctors thought I had ALS, or less likely, multiple sclerosis,” she says. “But after repeated MRI scans for a year, they concluded I had a rare neurological condition called acute transverse myelitis.”
But Flory was not convinced. After ordering a variety of private blood tests, she discovered she was infected with a range of bacteria in the genus Borrelia that live in the guts of ticks, the infectious agents responsible for Lyme disease.
“It made sense,” she says. “Looking back, I was bitten in high school and misdiagnosed with mononucleosis. This was probably the start, and my immune system kept it under wraps for a while. The Lyme bacteria can burrow into every tissue in the body, go into cyst form and become dormant before reactivating.”
The reason why cases of Lyme disease are increasing is down to changing weather patterns, triggered by climate change, meaning that ticks are now found across a much wider geographic range than ever before.
When these species of bacteria are transmitted to humans, they can attack the nervous system, joints and even internal organs which can lead to serious health complications such as arthritis, meningitis and even heart failure. While Lyme disease can sometimes be successfully treated with antibiotics if spotted early on, not everyone responds to these drugs, and for patients who have developed chronic symptoms, there is no known cure. Flory says she knows of fellow Lyme disease patients who have spent hundreds of thousands of dollars seeking treatments.
Concerningly, statistics show that Lyme and other tick-borne diseases are on the rise. Recently released estimates based on health insurance records suggest that at least 476,000 Americans are diagnosed with Lyme disease every year, and many experts believe the true figure is far higher.
The reason why the numbers are growing is down to changing weather patterns, triggered by climate change, meaning that ticks are now found across a much wider geographic range than ever before. Health insurance data shows that cases of Lyme disease have increased fourfold in rural parts of the U.S. over the last 15 years, and 65 percent in urban regions.
As a result, many scientists who have studied Lyme disease feel that it is paramount to bring some form of protective vaccine to market which can be offered to people living in the most at-risk areas.
“Even the increased awareness for Lyme disease has not stopped the cases,” says Eva Sapi, professor of cellular and molecular biology at the University of New Haven. “Some of these patients are looking for answers for years, running from one doctor to another, so that is obviously a very big cost for our society at so many levels.”
Emerging vaccines – and backlash
But with the rising case numbers, interest has grown among the pharmaceutical industry and research communities. Vienna-based biotech Valneva have partnered with Pfizer to take their vaccine – a seasonal jab which offers protection against the six most common strains of Lyme disease in the northern hemisphere – into a Phase III clinical trial which began in August. Involving 6,000 participants in a number of U.S. states and northern Europe where Lyme disease is endemic, it could lead to a licensed vaccine by 2025, if it proves successful.
“For many years Lyme was considered a small market vaccine,” explains Monica E. Embers, assistant professor of parasitology at Tulane University in New Orleans. “Now we know that this is a much bigger problem, Pfizer has stepped up to invest in preventing this disease and other pharmaceutical companies may as well.”
Despite innovations, patient communities and their representatives remain ambivalent about the idea of a vaccine. Some of this skepticism dates back to the failed LYMErix vaccine which was developed in the late 1990s before being withdrawn from the market.
At the same time, scientists at Yale University are developing a messenger RNA vaccine which aims to train the immune system to respond to tick bites by exposing it to 19 proteins found in tick saliva. Whereas the Valneva vaccine targets the bacteria within ticks, the Yale vaccine attempts to provoke an instant and aggressive immune response at the site of the bite. This causes the tick to fall off and limits the potential for transmitting dangerous infections.
But despite these innovations, patient communities and their representatives remain ambivalent about the idea of a vaccine. Some of this skepticism dates back to the failed LYMErix vaccine which was developed in the late 1990s before being withdrawn from the market in 2002 after concerns were raised that it might induce autoimmune reactions in humans.
While this theory was ultimately disproved, the lingering stigma attached to LYMErix meant that most vaccine manufacturers chose to stay away from the disease for many years, something which Gregory Poland, head of the Mayo Clinic’s Vaccine Research Group in Minnesota, describes as a tragedy.
“Since 2002, we have not had a human Lyme vaccine in the U.S. despite the increasing number of cases,” says Poland. “Pretty much everyone in the field thinks they’re ten times higher than the official numbers, so you’re probably talking at least 400,000 each year. It’s an incredible burden but because of concerns about anti-vax protestors, until very recently, no manufacturer has wanted to touch this.”
Such was the backlash surrounding the failed LYMErix program that scientists have even explored the most creative of workarounds for protecting people in tick-populated regions, without needing to actually vaccinate them. One research program at the University of Tennessee came up with the idea of leaving food pellets containing a vaccine in woodland areas with the idea that rodents would eat the pellets, and the vaccine would then kill Borrelia bacteria within any ticks which subsequently fed on the animals.
Even the Pfizer-Valneva vaccine has been cautiously designed to try and allay any lingering concerns, two decades after LYMErix. “The concept is the same as the original LYMErix vaccine, but it has been made safer by removing regions that had the potential to induce autoimmunity,” says Embers. “There will always be individuals who oppose vaccines, Lyme or otherwise, but it will be a tremendous boost to public health to have the option.”
Vaccine alternatives
Researchers are also considering alternative immunization approaches in case sufficiently large numbers of people choose to reject any Lyme vaccine which gets approved. Researchers at UMass Chan Medical School have developed an artificially generated antibody, administered via an annual injection, which is capable of killing Borrelia bacteria in the guts of ticks before they can get into the human host.
So far animal studies have shown it to be 100 percent effective, while the scientists have completed a Phase I trial in which they tested it for safety on 48 volunteers in Nebraska. Because this approach provides the antibody directly, rather than triggering the human immune system to produce the antibody like a vaccine would, Embers predicts that it could be a viable alternative for the vaccine hesitant as well as providing an option for immunocompromised individuals who cannot produce enough of their own antibodies.
At the same time, many patient groups still raise concerns over the fact that numerous diagnostic tests for Lyme disease have been reported to have a poor accuracy. Without this, they argue that it is difficult to prove whether vaccines or any other form of immunization actually work. “If the disease is not understood enough to create a more accurate test and a universally accepted treatment protocol, particularly for those who weren’t treated promptly, how can we be sure about the efficacy of a vaccine?” says Natasha Metcalf, co-founder of the organization Lyme Disease UK.
Flory points out that there are so many different types of Borrelia bacteria which cause Lyme disease, that the immunizations being developed may only stop a proportion of cases. In addition, she says that chronic Lyme patients often report a whole myriad of co-infections which remain poorly understood and are likely to also be involved in the disease process.
Marci Flory undergoes an infusion in an attempt to treat her Lyme disease symptoms.
Marci Flory
“I would love to see an effective Lyme vaccine but I have my reservations,” she says. “I am infected with four types of Borrelia bacteria, plus many co-infections – Babesia, Bartonella, Erlichiosis, Rickettsia, and Mycoplasma – all from a single Douglas County Kansas tick bite. Lyme never travels alone and the vaccine won’t protect against all the many strains of Borrelia and co-infections.”
Valneva CEO Thomas Lingelbach admits that the Pfizer-Valneva vaccine is not perfect, but predicts that it will still have significant impact if approved.
“We expect the vaccine to have 75 percent plus efficacy,” he says. “There is this legacy around the old Lyme vaccines, but the world is very, very different today. The number of clinical manifestations known to be caused by infection with Lyme Borreliosis has significantly increased, and the understanding around severity has certainly increased.”
Embers agrees that while it will still be important for doctors to monitor for other tick-borne infections which are not necessarily covered by the vaccine, having any clinically approved jab would still represent a major step forward in the fight against the disease.
“I think that any vaccine must be properly vetted, and these companies are performing extensive clinical trials to do just that,” she says. “Lyme is the most common tick-borne disease in the U.S. so the public health impact could be significant. However, clinicians and the general public must remain aware of all of the other tick-borne diseases such as Babesia and Anaplasma, and continue to screen for those when a tick bite is suspected.”