Small changes in how a person talks could reveal Alzheimer’s earlier
Dave Arnold retired in his 60s and began spending time volunteering in local schools. But then he started misplacing items, forgetting appointments and losing his sense of direction. Eventually he was diagnosed with early stage Alzheimer’s.
“Hearing the diagnosis made me very emotional and tearful,” he said. “I immediately thought of all my mom had experienced.” His mother suffered with the condition for years before passing away. Over the last year, Arnold has worked for the Alzheimer’s Association as one of its early stage advisors, sharing his insights to help others in the initial stages of the disease.
Arnold was diagnosed sooner than many others. It's important to find out early, when interventions can make the most difference. One promising avenue is looking at how people talk. Research has shown that Alzheimer’s affects a part of the brain that controls speech, resulting in small changes before people show other signs of the disease.
Now, Canary Speech, a company based in Utah, is using AI to examine elements like the pitch of a person’s voice and their pauses. In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Developing the AI model
Canary Speech’s CEO, Henry O’Connell, met cofounder Jeff Adams about 40 years before they started the company. Back when they first crossed paths, they were both living in Bethesda, Maryland; O’Connell was a research fellow at the National Institutes of Health studying rare neurological diseases, while Adams was working to decode spy messages. Later on, Adams would specialize in building mathematical models to analyze speech and sound as a team leader in developing Amazon's Alexa.
It wasn't until 2015 that they decided to make use of the fit between their backgrounds. ““We established Canary Speech in 2017 to build a product that could be used in multiple languages in clinical environments,” O'Connell says.
The need is growing. About 55 million people worldwide currently live with Alzheimer’s, a number that is expected to double by 2050. Some scientists think the disease results from a buildup of plaque in the brain. It causes mild memory loss at first and, over time, this issue get worse while other symptoms, such as disorientation and hallucinations, can develop. Treatment to manage the disease is more effective in the earlier stages, but detection is difficult since mild symptoms are often attributed to the normal aging process.
O’Connell and Adams specialize in the complex ways that Alzheimer’s effects how people speak. Using AI, their mathematical model analyzes 15 million data points every minute, focusing on certain features of speech such as pitch, pauses and elongation of words. It also pays attention to how the vibrations of vocal cords change in different stages of the disease.
To create their model, the team used a type of machine learning called deep neural nets, which looks at multiple layers of data - in this case, the multiple features of a person’s speech patterns.
“Deep neural nets allow us to look at much, much larger data sets built out of millions of elements,” O’Connell explained. “Through machine learning and AI, we’ve identified features that are very sensitive to an Alzheimer’s patient versus [people without the disease] and also very sensitive to mild cognitive impairment, early stage and moderate Alzheimer's.” Based on their learnings, Canary is able to classify the disease stage very quickly, O’Connell said.
“When we’re listening to sublanguage elements, we’re really analyzing the direct result of changes in the brain in the physical body,” O’Connell said. “The brain controls your vocal cords: how fast they vibrate, the expansion of them, the contraction.” These factors, along with where people put their tongues when talking, function subconsciously and result in subtle changes in the sounds of speech.
Further testing is needed
In an initial trial, Canary analyzed speech recordings from phone calls to a large U.S. health insurer. They looked at the audio recordings of 651 policyholders who had early stage Alzheimer’s and 1018 who did not have the condition, aiming for a representative sample of age, gender and race. They used this data to create their first diagnostic model and found that it was 96 percent accurate in identifying Alzheimer’s.
Christian Herff, an assistant professor of neuroscience at Maastricht University in the Netherlands, praised this approach while adding that further testing is needed to assess its effectiveness.
“I think the general idea of identifying increased risk for cognitive impairment based on speech characteristics is very feasible, particularly when change in a user’s voice is monitored, for example, by recording speech every year,” Herff said. He noted that this can only be a first indication, not a full diagnosis. The accuracy still needs to be validated in studies that follows individuals over a period of time, he said.
Toby Walsh, a professor of artificial intelligence at the University of New South Wales, also thinks Canary’s tool has potential but highlights that Canary could diagnose some people who don’t really have the disease. “This is an interesting and promising application of AI,” he said, “but these tools need to be used carefully. Imagine the anxiety of being misdiagnosed with Alzheimer’s.”
As with many other AI tools, privacy and bias are additional issues to monitor closely, Walsh said.
Other languages
A related issue is that not everyone is fluent in English. Mahnaz Arvaneh, a senior lecturer in automatic control and systems engineering at the University of Sheffield, said this could be a blind spot.
“The system may not be very accurate for those who have English as their second language as their speaking patterns would be different, and any issue might be because of language deficiency rather than cognitive issues,” Arvaneh said.
The team is expanding to multiple languages starting with Japanese and Spanish. The elements of the model that make up the algorithm are very similar, but they need to be validated and retrained in a different language, which will require access to more data.
Recently, Canary analyzed the phone calls of 233 Japanese patients who had mild cognitive impairment and 704 healthy people. Using an English model they were able to identify the Japanese patients who had mild cognitive impairment with 78 percent accuracy. They also developed a model in Japanese that was 45 percent accurate, and they’re continuing to train it with more data.
The future
Canary is using their model to look at other diseases like Huntington’s and Parkinson’s. They’re also collaborating with pharmaceuticals to validate potential therapies for Alzheimer’s. By looking at speech patterns over time, Canary can get an indication of how well these drugs are working.
Dave Arnold and his wife dance at his nephew’s wedding in Rochester, New York, ten years ago, before his Alzheimer's diagnosis.
Dave Arnold
Ultimately, they want to integrate their tool into everyday life. “We want it to be used in a smartphone, or a teleconference call so that individuals could be examined in their home,” O’Connell said. “We could follow them over time and work with clinical teams and hospitals to improve the evaluation of patients and contribute towards an accurate diagnosis.”
Arnold, the patient with early stage Alzheimer’s, sees great promise. “The process of getting a diagnosis is already filled with so much anxiety,” he said. “Anything that can be done to make it easier and less stressful would be a good thing, as long as it’s proven accurate.”
In recent years, researchers of Alzheimer’s have made progress in figuring out the complex factors that lead to the disease. Yet, the root cause, or causes, of Alzheimer’s are still pretty much a mystery.
In fact, many people get Alzheimer’s even though they lack the gene variant we know can play a role in the disease. This is a critical knowledge gap for research to address because the vast majority of Alzheimer’s patients don’t have this variant.
A new study provides key insights into what’s causing the disease. The research, published in Nature Communications, points to a breakdown over time in the brain’s system for clearing waste, an issue that seems to happen in some people as they get older.
Michael Glickman, a biologist at Technion – Israel Institute of Technology, helped lead this research. I asked him to tell me about his approach to studying how this breakdown occurs in the brain, and how he tested a treatment that has potential to fix the problem at its earliest stages.
Dr. Michael Glickman is internationally renowned for his research on the ubiquitin-proteasome system (UPS), the brain's system for clearing the waste that is involved in diseases such as Huntington's, Alzheimer's, and Parkinson's. He is the head of the Lab for Protein Characterization in the Faculty of Biology at the Technion – Israel Institute of Technology. In the lab, Michael and his team focus on protein recycling and the ubiquitin-proteasome system, which protects against serious diseases like Alzheimer’s, Parkinson’s, cystic fibrosis, and diabetes. After earning his PhD at the University of California at Berkeley in 1994, Michael joined the Technion as a Senior Lecturer in 1998 and has served as a full professor since 2009.
Dr. Michael Glickman
Nobel Prize goes to technology for mRNA vaccines
When Drew Weissman received a call from Katalin Karikó in the early morning hours this past Monday, he assumed his longtime research partner was calling to share a nascent, nagging idea. Weissman, a professor of medicine at the Perelman School of Medicine at the University of Pennsylvania, and Karikó, a professor at Szeged University and an adjunct professor at UPenn, both struggle with sleep disturbances. Thus, middle-of-the-night discourses between the two, often over email, has been a staple of their friendship. But this time, Karikó had something more pressing and exciting to share: They had won the 2023 Nobel Prize in Physiology or Medicine.
The work for which they garnered the illustrious award and its accompanying $1,000,000 cash windfall was completed about two decades ago, wrought through long hours in the lab over many arduous years. But humanity collectively benefited from its life-saving outcome three years ago, when both Moderna and Pfizer/BioNTech’s mRNA vaccines against COVID were found to be safe and highly effective at preventing severe disease. Billions of doses have since been given out to protect humans from the upstart viral scourge.
“I thought of going somewhere else, or doing something else,” said Katalin Karikó. “I also thought maybe I’m not good enough, not smart enough. I tried to imagine: Everything is here, and I just have to do better experiments.”
Unlocking the power of mRNA
Weissman and Karikó unlocked mRNA vaccines for the world back in the early 2000s when they made a key breakthrough. Messenger RNA molecules are essentially instructions for cells’ ribosomes to make specific proteins, so in the 1980s and 1990s, researchers started wondering if sneaking mRNA into the body could trigger cells to manufacture antibodies, enzymes, or growth agents for protecting against infection, treating disease, or repairing tissues. But there was a big problem: injecting this synthetic mRNA triggered a dangerous, inflammatory immune response resulting in the mRNA’s destruction.
While most other researchers chose not to tackle this perplexing problem to instead pursue more lucrative and publishable exploits, Karikó stuck with it. The choice sent her academic career into depressing doldrums. Nobody would fund her work, publications dried up, and after six years as an assistant professor at the University of Pennsylvania, Karikó got demoted. She was going backward.
“I thought of going somewhere else, or doing something else,” Karikó told Stat in 2020. “I also thought maybe I’m not good enough, not smart enough. I tried to imagine: Everything is here, and I just have to do better experiments.”
A tale of tenacity
Collaborating with Drew Weissman, a new professor at the University of Pennsylvania, in the late 1990s helped provide Karikó with the tenacity to continue. Weissman nurtured a goal of developing a vaccine against HIV-1, and saw mRNA as a potential way to do it.
“For the 20 years that we’ve worked together before anybody knew what RNA is, or cared, it was the two of us literally side by side at a bench working together,” Weissman said in an interview with Adam Smith of the Nobel Foundation.
In 2005, the duo made their 2023 Nobel Prize-winning breakthrough, detailing it in a relatively small journal, Immunity. (Their paper was rejected by larger journals, including Science and Nature.) They figured out that chemically modifying the nucleoside bases that make up mRNA allowed the molecule to slip past the body’s immune defenses. Karikó and Weissman followed up that finding by creating mRNA that’s more efficiently translated within cells, greatly boosting protein production. In 2020, scientists at Moderna and BioNTech (where Karikó worked from 2013 to 2022) rushed to craft vaccines against COVID, putting their methods to life-saving use.
The future of vaccines
Buoyed by the resounding success of mRNA vaccines, scientists are now hurriedly researching ways to use mRNA medicine against other infectious diseases, cancer, and genetic disorders. The now ubiquitous efforts stand in stark contrast to Karikó and Weissman’s previously unheralded struggles years ago as they doggedly worked to realize a shared dream that so many others shied away from. Katalin Karikó and Drew Weissman were brave enough to walk a scientific path that very well could have ended in a dead end, and for that, they absolutely deserve their 2023 Nobel Prize.
This article originally appeared on Big Think, home of the brightest minds and biggest ideas of all time.