In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Dave Arnold retired in his 60s and began spending time volunteering in local schools. But then he started misplacing items, forgetting appointments and losing his sense of direction. Eventually he was diagnosed with early stage Alzheimer’s.
“Hearing the diagnosis made me very emotional and tearful,” he said. “I immediately thought of all my mom had experienced.” His mother suffered with the condition for years before passing away. Over the last year, Arnold has worked for the Alzheimer’s Association as one of its early stage advisors, sharing his insights to help others in the initial stages of the disease.
Arnold was diagnosed sooner than many others. It's important to find out early, when interventions can make the most difference. One promising avenue is looking at how people talk. Research has shown that Alzheimer’s affects a part of the brain that controls speech, resulting in small changes before people show other signs of the disease.
Now, Canary Speech, a company based in Utah, is using AI to examine elements like the pitch of a person’s voice and their pauses. In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Developing the AI model
Canary Speech’s CEO, Henry O’Connell, met cofounder Jeff Adams about 40 years before they started the company. Back when they first crossed paths, they were both living in Bethesda, Maryland; O’Connell was a research fellow at the National Institutes of Health studying rare neurological diseases, while Adams was working to decode spy messages. Later on, Adams would specialize in building mathematical models to analyze speech and sound as a team leader in developing Amazon's Alexa.
It wasn't until 2015 that they decided to make use of the fit between their backgrounds. ““We established Canary Speech in 2017 to build a product that could be used in multiple languages in clinical environments,” O'Connell says.
The need is growing. About 55 million people worldwide currently live with Alzheimer’s, a number that is expected to double by 2050. Some scientists think the disease results from a buildup of plaque in the brain. It causes mild memory loss at first and, over time, this issue get worse while other symptoms, such as disorientation and hallucinations, can develop. Treatment to manage the disease is more effective in the earlier stages, but detection is difficult since mild symptoms are often attributed to the normal aging process.
O’Connell and Adams specialize in the complex ways that Alzheimer’s effects how people speak. Using AI, their mathematical model analyzes 15 million data points every minute, focusing on certain features of speech such as pitch, pauses and elongation of words. It also pays attention to how the vibrations of vocal cords change in different stages of the disease.
To create their model, the team used a type of machine learning called deep neural nets, which looks at multiple layers of data - in this case, the multiple features of a person’s speech patterns.
“Deep neural nets allow us to look at much, much larger data sets built out of millions of elements,” O’Connell explained. “Through machine learning and AI, we’ve identified features that are very sensitive to an Alzheimer’s patient versus [people without the disease] and also very sensitive to mild cognitive impairment, early stage and moderate Alzheimer's.” Based on their learnings, Canary is able to classify the disease stage very quickly, O’Connell said.
“When we’re listening to sublanguage elements, we’re really analyzing the direct result of changes in the brain in the physical body,” O’Connell said. “The brain controls your vocal cords: how fast they vibrate, the expansion of them, the contraction.” These factors, along with where people put their tongues when talking, function subconsciously and result in subtle changes in the sounds of speech.
Further testing is needed
In an initial trial, Canary analyzed speech recordings from phone calls to a large U.S. health insurer. They looked at the audio recordings of 651 policyholders who had early stage Alzheimer’s and 1018 who did not have the condition, aiming for a representative sample of age, gender and race. They used this data to create their first diagnostic model and found that it was 96 percent accurate in identifying Alzheimer’s.
Christian Herff, an assistant professor of neuroscience at Maastricht University in the Netherlands, praised this approach while adding that further testing is needed to assess its effectiveness.
“I think the general idea of identifying increased risk for cognitive impairment based on speech characteristics is very feasible, particularly when change in a user’s voice is monitored, for example, by recording speech every year,” Herff said. He noted that this can only be a first indication, not a full diagnosis. The accuracy still needs to be validated in studies that follows individuals over a period of time, he said.
Toby Walsh, a professor of artificial intelligence at the University of New South Wales, also thinks Canary’s tool has potential but highlights that Canary could diagnose some people who don’t really have the disease. “This is an interesting and promising application of AI,” he said, “but these tools need to be used carefully. Imagine the anxiety of being misdiagnosed with Alzheimer’s.”
As with many other AI tools, privacy and bias are additional issues to monitor closely, Walsh said.
Other languages
A related issue is that not everyone is fluent in English. Mahnaz Arvaneh, a senior lecturer in automatic control and systems engineering at the University of Sheffield, said this could be a blind spot.
“The system may not be very accurate for those who have English as their second language as their speaking patterns would be different, and any issue might be because of language deficiency rather than cognitive issues,” Arvaneh said.
The team is expanding to multiple languages starting with Japanese and Spanish. The elements of the model that make up the algorithm are very similar, but they need to be validated and retrained in a different language, which will require access to more data.
Recently, Canary analyzed the phone calls of 233 Japanese patients who had mild cognitive impairment and 704 healthy people. Using an English model they were able to identify the Japanese patients who had mild cognitive impairment with 78 percent accuracy. They also developed a model in Japanese that was 45 percent accurate, and they’re continuing to train it with more data.
The future
Canary is using their model to look at other diseases like Huntington’s and Parkinson’s. They’re also collaborating with pharmaceuticals to validate potential therapies for Alzheimer’s. By looking at speech patterns over time, Canary can get an indication of how well these drugs are working.
Dave Arnold and his wife dance at his nephew’s wedding in Rochester, New York, ten years ago, before his Alzheimer's diagnosis.
Dave Arnold
Ultimately, they want to integrate their tool into everyday life. “We want it to be used in a smartphone, or a teleconference call so that individuals could be examined in their home,” O’Connell said. “We could follow them over time and work with clinical teams and hospitals to improve the evaluation of patients and contribute towards an accurate diagnosis.”
Arnold, the patient with early stage Alzheimer’s, sees great promise. “The process of getting a diagnosis is already filled with so much anxiety,” he said. “Anything that can be done to make it easier and less stressful would be a good thing, as long as it’s proven accurate.”
As gene therapies and small molecule drugs are being studied in clinical trials, companies increasingly see the value in hiring patients to help explain the potential benefits.
Biomedical corporations and government research agencies are now incorporating patient advocacy more than ever, says Alice Lara, president and CEO of the Sudden Arrhythmia Death Syndromes Foundation in Salt Lake City, Utah. These organizations have seen the effectiveness of including patient voices to communicate and exemplify the benefits that key academic research institutions have shown in their medical studies.
“From our side of the aisle,” Lara says, “what we know as patient advocacy organizations is that educated patients do a lot better. They have a better course in their therapy and their condition, and understanding the genetics is important because all of our conditions are genetic.”
Founded in 2016, Tenaya is advancing gene therapies and small molecule drugs in clinical trials for both prevalent and rare forms of heart disease, says Ali, the CEO.
The firm's first small molecule, now in a Phase 1 clinical trial, is intended to treat heart failure with preserved ejection fraction, where the amount of blood pumped by the heart is reduced due to the heart chambers becoming weak or stiff. The condition accounts for half or more of all heart failure in the U.S., according to Ali, and is growing quickly because it's closely associated with diabetes. It’s also linked with metabolic syndrome, or a cluster of conditions including high blood pressure, high blood sugar, excess body fat around the waist, and abnormal cholesterol levels.
“We have a novel molecule that is first in class and, to our knowledge, best in class to tackle that, so we’re very excited about the clinical trial,” Ali says.
The first phase of the trial is being performed with healthy participants, rather than people with the disease, to establish safety and tolerability. The researchers can also look for the drug in blood samples, which could tell them whether it's reaching its target. Ali estimates that, if the company can establish safety and that it engages the right parts of the body, it will likely begin dosing patients with the disease in 2024.
Tenaya’s therapy delivers a healthy copy of the gene so that it makes a copy of the protein missing from the patients' hearts because of their mutation. The study will start with adult patients, then pivot potentially to children and even newborns, Ali says, “where there is an even greater unmet need because the disease progresses so fast that they have no options.”
Although this work still has a long way to go, Ali is excited about the potential because the gene therapy achieved positive results in the preclinical mouse trial. This animal trial demonstrated that the treatment reduced enlarged hearts, reversed electrophysiological abnormalities, and improved the functioning of the heart by increasing the ejection fraction after the single-dose of gene therapy. That measurement remained stable to the end of the animals’ lives, roughly 18 months, Ali says.
He’s also energized by the fact that heart disease has “taken a page out of the oncology playbook” by leveraging genetic research to develop more precise and targeted drugs and gene therapies.
“Now we are talking about a potential cure of a disease for which there was no cure and using a very novel concept,” says Melind Desai of the Cleveland Clinic.
Tenaya’s second program focuses on developing a gene therapy to mitigate the leading cause of hypertrophic cardiomyopathy through a specific gene called MYPBC3. The disease affects approximately 600,000 patients in the U.S. This particular genetic form, Ali explains, affects about 115,000 in the U.S. alone, so it is considered a rare disease.
“There are infants who are dying within the first weeks to months of life as a result of this mutation,” he says. “There are also adults who start having symptoms in their 20s, 30s and 40s with early morbidity and mortality.” Tenaya plans to apply before the end of this year to get the FDA’s approval to administer an investigational drug for this disease humans. If approved, the company will begin to dose patients in 2023.
“We now understand the genetics of the heart much better,” he says. “We now understand the leading genetic causes of hypertrophic myopathy, dilated cardiomyopathy and others, so that gives us the ability to take these large populations and stratify them rationally into subpopulations.”
Melind Desai, MD, who directs Cleveland Clinic’s Hypertrophic Cardiomyopathy Center, says that the goal of Tenaya’s second clinical study is to help improve the basic cardiac structure in patients with hypertrophic cardiomyopathy related to the MYPBC3 mutation.
“Now we are talking about a potential cure of a disease for which there was no cure and using a very novel concept,” he says. “So this is an exciting new frontier of therapeutic investigation for MYPBC3 gene-positive patients with a chance for a cure.
Neither of Tenaya’s two therapies address the gene mutation that has affected Borsari and her family. But Ali sees opportunity down the road to develop a gene therapy for her particular gene mutation, since it is the second leading cause of cardiomyopathy. Treating the MYH7 gene is especially challenging because it requires gene editing or silencing, instead of just replacing the gene.
Wendy Borsari was diagnosed at age 24 with a commonly inherited heart disease. She joined Tenaya as a patient advocate in 2021.
Wendy Borsari
“If you add a healthy gene it will produce healthy copies,” Ali explains, “but it won’t stop the bad effects of the mutant protein the gene produces. You can only do that by silencing the gene or editing it out, which is a different, more complicated approach.”
Euan Ashley, professor of medicine and genetics at Stanford University and founding director of its Center for Inherited Cardiovascular Disease, is confident that we will see genetic therapies for heart disease within the next decade.
“We are at this really exciting moment in time where we have diseases that have been under-recognized and undervalued now being attacked by multiple companies with really modern tools,” says Ashley, author of The Genome Odyssey. “Gene therapies are unusual in the sense that they can reverse the cause of the disease, so we have the enticing possibility of actually reversing or maybe even curing these diseases.”
Although no one is doing extensive research into a gene therapy for her particular mutation yet, Borsari remains hopeful, knowing that companies such as Tenaya are moving in that direction.
“I know that’s now on the horizon,” she says. “It’s not just some pipe dream, but will happen hopefully in my lifetime or my kids’ lifetime to help them.”
