In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Dave Arnold retired in his 60s and began spending time volunteering in local schools. But then he started misplacing items, forgetting appointments and losing his sense of direction. Eventually he was diagnosed with early stage Alzheimer’s.
“Hearing the diagnosis made me very emotional and tearful,” he said. “I immediately thought of all my mom had experienced.” His mother suffered with the condition for years before passing away. Over the last year, Arnold has worked for the Alzheimer’s Association as one of its early stage advisors, sharing his insights to help others in the initial stages of the disease.
Arnold was diagnosed sooner than many others. It's important to find out early, when interventions can make the most difference. One promising avenue is looking at how people talk. Research has shown that Alzheimer’s affects a part of the brain that controls speech, resulting in small changes before people show other signs of the disease.
Now, Canary Speech, a company based in Utah, is using AI to examine elements like the pitch of a person’s voice and their pauses. In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Developing the AI model
Canary Speech’s CEO, Henry O’Connell, met cofounder Jeff Adams about 40 years before they started the company. Back when they first crossed paths, they were both living in Bethesda, Maryland; O’Connell was a research fellow at the National Institutes of Health studying rare neurological diseases, while Adams was working to decode spy messages. Later on, Adams would specialize in building mathematical models to analyze speech and sound as a team leader in developing Amazon's Alexa.
It wasn't until 2015 that they decided to make use of the fit between their backgrounds. ““We established Canary Speech in 2017 to build a product that could be used in multiple languages in clinical environments,” O'Connell says.
The need is growing. About 55 million people worldwide currently live with Alzheimer’s, a number that is expected to double by 2050. Some scientists think the disease results from a buildup of plaque in the brain. It causes mild memory loss at first and, over time, this issue get worse while other symptoms, such as disorientation and hallucinations, can develop. Treatment to manage the disease is more effective in the earlier stages, but detection is difficult since mild symptoms are often attributed to the normal aging process.
O’Connell and Adams specialize in the complex ways that Alzheimer’s effects how people speak. Using AI, their mathematical model analyzes 15 million data points every minute, focusing on certain features of speech such as pitch, pauses and elongation of words. It also pays attention to how the vibrations of vocal cords change in different stages of the disease.
To create their model, the team used a type of machine learning called deep neural nets, which looks at multiple layers of data - in this case, the multiple features of a person’s speech patterns.
“Deep neural nets allow us to look at much, much larger data sets built out of millions of elements,” O’Connell explained. “Through machine learning and AI, we’ve identified features that are very sensitive to an Alzheimer’s patient versus [people without the disease] and also very sensitive to mild cognitive impairment, early stage and moderate Alzheimer's.” Based on their learnings, Canary is able to classify the disease stage very quickly, O’Connell said.
“When we’re listening to sublanguage elements, we’re really analyzing the direct result of changes in the brain in the physical body,” O’Connell said. “The brain controls your vocal cords: how fast they vibrate, the expansion of them, the contraction.” These factors, along with where people put their tongues when talking, function subconsciously and result in subtle changes in the sounds of speech.
Further testing is needed
In an initial trial, Canary analyzed speech recordings from phone calls to a large U.S. health insurer. They looked at the audio recordings of 651 policyholders who had early stage Alzheimer’s and 1018 who did not have the condition, aiming for a representative sample of age, gender and race. They used this data to create their first diagnostic model and found that it was 96 percent accurate in identifying Alzheimer’s.
Christian Herff, an assistant professor of neuroscience at Maastricht University in the Netherlands, praised this approach while adding that further testing is needed to assess its effectiveness.
“I think the general idea of identifying increased risk for cognitive impairment based on speech characteristics is very feasible, particularly when change in a user’s voice is monitored, for example, by recording speech every year,” Herff said. He noted that this can only be a first indication, not a full diagnosis. The accuracy still needs to be validated in studies that follows individuals over a period of time, he said.
Toby Walsh, a professor of artificial intelligence at the University of New South Wales, also thinks Canary’s tool has potential but highlights that Canary could diagnose some people who don’t really have the disease. “This is an interesting and promising application of AI,” he said, “but these tools need to be used carefully. Imagine the anxiety of being misdiagnosed with Alzheimer’s.”
As with many other AI tools, privacy and bias are additional issues to monitor closely, Walsh said.
Other languages
A related issue is that not everyone is fluent in English. Mahnaz Arvaneh, a senior lecturer in automatic control and systems engineering at the University of Sheffield, said this could be a blind spot.
“The system may not be very accurate for those who have English as their second language as their speaking patterns would be different, and any issue might be because of language deficiency rather than cognitive issues,” Arvaneh said.
The team is expanding to multiple languages starting with Japanese and Spanish. The elements of the model that make up the algorithm are very similar, but they need to be validated and retrained in a different language, which will require access to more data.
Recently, Canary analyzed the phone calls of 233 Japanese patients who had mild cognitive impairment and 704 healthy people. Using an English model they were able to identify the Japanese patients who had mild cognitive impairment with 78 percent accuracy. They also developed a model in Japanese that was 45 percent accurate, and they’re continuing to train it with more data.
The future
Canary is using their model to look at other diseases like Huntington’s and Parkinson’s. They’re also collaborating with pharmaceuticals to validate potential therapies for Alzheimer’s. By looking at speech patterns over time, Canary can get an indication of how well these drugs are working.
Dave Arnold and his wife dance at his nephew’s wedding in Rochester, New York, ten years ago, before his Alzheimer's diagnosis.
Dave Arnold
Ultimately, they want to integrate their tool into everyday life. “We want it to be used in a smartphone, or a teleconference call so that individuals could be examined in their home,” O’Connell said. “We could follow them over time and work with clinical teams and hospitals to improve the evaluation of patients and contribute towards an accurate diagnosis.”
Arnold, the patient with early stage Alzheimer’s, sees great promise. “The process of getting a diagnosis is already filled with so much anxiety,” he said. “Anything that can be done to make it easier and less stressful would be a good thing, as long as it’s proven accurate.”
Sparklers produce a beautiful display of light and heat by burning metal dust, which contains iron. The recent work of Canadian and Dutch researchers suggests we can use iron as a cheap, carbon-free fuel.
Iron as a fuel
Iron is abundantly available and cheap. More importantly, the byproduct of burning iron is rust (iron oxide), a solid material that is easy to collect and recycle. Neither burning iron nor converting its oxide back produces any carbon in the process.
Iron oxide is potentially renewable by reacting with electricity or hydrogen to become iron again.
Iron has a high energy density: it requires almost the same volume as gasoline to produce the same amount of energy. However, iron has poor specific energy: it’s a lot heavier than gas to produce the same amount of energy. (Think of picking up a jug of gasoline, and then imagine trying to pick up a similar sized chunk of iron.) Therefore, its weight is prohibitive for many applications. Burning iron to run a car isn’t very practical if the iron fuel weighs as much as the car itself.
In its powdered form, however, iron offers more promise as a high-density energy carrier or storage system. Iron-burning furnaces could provide direct heat for industry, home heating, or to generate electricity.
Plus, iron oxide is potentially renewable by reacting with electricity or hydrogen to become iron again (as long as you’ve got a source of clean electricity or green hydrogen). When there’s excess electricity available from renewables like solar and wind, for example, rust could be converted back into iron powder, and then burned on demand to release that energy again.
However, these methods of recycling rust are very energy intensive and inefficient, currently, so improvements to the efficiency of burning iron itself may be crucial to making such a circular system viable.
The science of discrete burning
Powdered particles have a high surface area to volume ratio, which means it is easier to ignite them. This is true for metals as well.
Under the right circumstances, powdered iron can burn in a manner known as discrete burning. In its most ideal form, the flame completely consumes one particle before the heat radiating from it combusts other particles in its vicinity. By studying this process, researchers can better understand and model how iron combusts, allowing them to design better iron-burning furnaces.
Discrete burning is difficult to achieve on Earth. Perfect discrete burning requires a specific particle density and oxygen concentration. When the particles are too close and compacted, the fire jumps to neighboring particles before fully consuming a particle, resulting in a more chaotic and less controlled burn.
Presently, the rate at which powdered iron particles burn or how they release heat in different conditions is poorly understood. This hinders the development of technologies to efficiently utilize iron as a large-scale fuel.
Burning metal in microgravity
In April, the European Space Agency (ESA) launched a suborbital “sounding” rocket, carrying three experimental setups. As the rocket traced its parabolic trajectory through the atmosphere, the experiments got a few minutes in free fall, simulating microgravity.
One of the experiments on this mission studied how iron powder burns in the absence of gravity.
In microgravity, particles float in a more uniformly distributed cloud. This allows researchers to model the flow of iron particles and how a flame propagates through a cloud of iron particles in different oxygen concentrations.
Existing fossil fuel power plants could potentially be retrofitted to run on iron fuel.
Insights into how flames propagate through iron powder under different conditions could help design much more efficient iron-burning furnaces.
Clean and carbon-free energy on Earth
Various businesses are looking at ways to incorporate iron fuels into their processes. In particular, it could serve as a cleaner way to supply industrial heat by burning iron to heat water.
For example, Dutch brewery Swinkels Family Brewers, in collaboration with the Eindhoven University of Technology, switched to iron fuel as the heat source to power its brewing process, accounting for 15 million glasses of beer annually. Dutch startup RIFT is running proof-of-concept iron fuel power plants in Helmond and Arnhem.
As researchers continue to improve the efficiency of burning iron, its applicability will extend to other use cases as well. But is the infrastructure in place for this transition?
Often, the transition to new energy sources is slowed by the need to create new infrastructure to utilize them. Fortunately, this isn’t the case with switching from fossil fuels to iron. Since the ideal temperature to burn iron is similar to that for hydrocarbons, existing fossil fuel power plants could potentially be retrofitted to run on iron fuel.
This article originally appeared on Freethink, home of the brightest minds and biggest ideas of all time.
Leaps.org talks with Dr. Tom Oxley, founding CEO of Synchron, a company that's taking a unique - and less invasive - approach to "brain-computer interfaces" for patients with ALS and other mobility challenges.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
In our conversation, Dr. Oxley talks about “Bluetooth brain”; the critical role of AI in the present and future of BCIs; how BCIs compare to voice command technology; regulatory frameworks for revolutionary technologies; specific people with paralysis who’ve been able to regain some independence thanks to the Stentrode; what it means to be a neurointerventionist; how to scale BCIs for more people to use them; the risks of BCIs malfunctioning; organic implants; and how BCIs help us understand the brain, among other topics.
Dr. Oxley received his PhD in neuro engineering from the University of Melbourne in Australia. He is the founding CEO of Synchron and an associate professor and the head of the vascular bionics laboratory at the University of Melbourne. He’s also a clinical instructor in the Deepartment of Neurosurgery at Mount Sinai Hospital. Dr. Oxley has completed more than 1,600 endovascular neurosurgical procedures on patients, including people with aneurysms and strokes, and has authored over 100 peer reviewed articles.
Links:
Synchron website - https://synchron.com/
Assessment of Safety of a Fully Implanted Endovascular Brain-Computer Interface for Severe Paralysis in 4 Patients (paper co-authored by Tom Oxley) - https://jamanetwork.com/journals/jamaneurology/art...
More research related to Synchron's work - https://synchron.com/research
Tom Oxley on LinkedIn - https://www.linkedin.com/in/tomoxl
Tom Oxley on Twitter - https://twitter.com/tomoxl?lang=en
Tom Oxley TED - https://www.ted.com/talks/tom_oxley_a_brain_implant_that_turns_your_thoughts_into_text?language=en
Tom Oxley website - https://tomoxl.com/
Novel brain implant helps paralyzed woman speak using digital avatar - https://engineering.berkeley.edu/news/2023/08/novel-brain-implant-helps-paralyzed-woman-speak-using-a-digital-avatar/
Edward Chang lab - https://changlab.ucsf.edu/
BCIs convert brain activity into text at 62 words per minute - https://med.stanford.edu/neurosurgery/news/2023/he...
Leaps.org: The Mind-Blowing Promise of Neural Implants - https://leaps.org/the-mind-blowing-promise-of-neural-implants/
Tom Oxley