In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Dave Arnold retired in his 60s and began spending time volunteering in local schools. But then he started misplacing items, forgetting appointments and losing his sense of direction. Eventually he was diagnosed with early stage Alzheimer’s.
“Hearing the diagnosis made me very emotional and tearful,” he said. “I immediately thought of all my mom had experienced.” His mother suffered with the condition for years before passing away. Over the last year, Arnold has worked for the Alzheimer’s Association as one of its early stage advisors, sharing his insights to help others in the initial stages of the disease.
Arnold was diagnosed sooner than many others. It's important to find out early, when interventions can make the most difference. One promising avenue is looking at how people talk. Research has shown that Alzheimer’s affects a part of the brain that controls speech, resulting in small changes before people show other signs of the disease.
Now, Canary Speech, a company based in Utah, is using AI to examine elements like the pitch of a person’s voice and their pauses. In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Developing the AI model
Canary Speech’s CEO, Henry O’Connell, met cofounder Jeff Adams about 40 years before they started the company. Back when they first crossed paths, they were both living in Bethesda, Maryland; O’Connell was a research fellow at the National Institutes of Health studying rare neurological diseases, while Adams was working to decode spy messages. Later on, Adams would specialize in building mathematical models to analyze speech and sound as a team leader in developing Amazon's Alexa.
It wasn't until 2015 that they decided to make use of the fit between their backgrounds. ““We established Canary Speech in 2017 to build a product that could be used in multiple languages in clinical environments,” O'Connell says.
The need is growing. About 55 million people worldwide currently live with Alzheimer’s, a number that is expected to double by 2050. Some scientists think the disease results from a buildup of plaque in the brain. It causes mild memory loss at first and, over time, this issue get worse while other symptoms, such as disorientation and hallucinations, can develop. Treatment to manage the disease is more effective in the earlier stages, but detection is difficult since mild symptoms are often attributed to the normal aging process.
O’Connell and Adams specialize in the complex ways that Alzheimer’s effects how people speak. Using AI, their mathematical model analyzes 15 million data points every minute, focusing on certain features of speech such as pitch, pauses and elongation of words. It also pays attention to how the vibrations of vocal cords change in different stages of the disease.
To create their model, the team used a type of machine learning called deep neural nets, which looks at multiple layers of data - in this case, the multiple features of a person’s speech patterns.
“Deep neural nets allow us to look at much, much larger data sets built out of millions of elements,” O’Connell explained. “Through machine learning and AI, we’ve identified features that are very sensitive to an Alzheimer’s patient versus [people without the disease] and also very sensitive to mild cognitive impairment, early stage and moderate Alzheimer's.” Based on their learnings, Canary is able to classify the disease stage very quickly, O’Connell said.
“When we’re listening to sublanguage elements, we’re really analyzing the direct result of changes in the brain in the physical body,” O’Connell said. “The brain controls your vocal cords: how fast they vibrate, the expansion of them, the contraction.” These factors, along with where people put their tongues when talking, function subconsciously and result in subtle changes in the sounds of speech.
Further testing is needed
In an initial trial, Canary analyzed speech recordings from phone calls to a large U.S. health insurer. They looked at the audio recordings of 651 policyholders who had early stage Alzheimer’s and 1018 who did not have the condition, aiming for a representative sample of age, gender and race. They used this data to create their first diagnostic model and found that it was 96 percent accurate in identifying Alzheimer’s.
Christian Herff, an assistant professor of neuroscience at Maastricht University in the Netherlands, praised this approach while adding that further testing is needed to assess its effectiveness.
“I think the general idea of identifying increased risk for cognitive impairment based on speech characteristics is very feasible, particularly when change in a user’s voice is monitored, for example, by recording speech every year,” Herff said. He noted that this can only be a first indication, not a full diagnosis. The accuracy still needs to be validated in studies that follows individuals over a period of time, he said.
Toby Walsh, a professor of artificial intelligence at the University of New South Wales, also thinks Canary’s tool has potential but highlights that Canary could diagnose some people who don’t really have the disease. “This is an interesting and promising application of AI,” he said, “but these tools need to be used carefully. Imagine the anxiety of being misdiagnosed with Alzheimer’s.”
As with many other AI tools, privacy and bias are additional issues to monitor closely, Walsh said.
Other languages
A related issue is that not everyone is fluent in English. Mahnaz Arvaneh, a senior lecturer in automatic control and systems engineering at the University of Sheffield, said this could be a blind spot.
“The system may not be very accurate for those who have English as their second language as their speaking patterns would be different, and any issue might be because of language deficiency rather than cognitive issues,” Arvaneh said.
The team is expanding to multiple languages starting with Japanese and Spanish. The elements of the model that make up the algorithm are very similar, but they need to be validated and retrained in a different language, which will require access to more data.
Recently, Canary analyzed the phone calls of 233 Japanese patients who had mild cognitive impairment and 704 healthy people. Using an English model they were able to identify the Japanese patients who had mild cognitive impairment with 78 percent accuracy. They also developed a model in Japanese that was 45 percent accurate, and they’re continuing to train it with more data.
The future
Canary is using their model to look at other diseases like Huntington’s and Parkinson’s. They’re also collaborating with pharmaceuticals to validate potential therapies for Alzheimer’s. By looking at speech patterns over time, Canary can get an indication of how well these drugs are working.
Dave Arnold and his wife dance at his nephew’s wedding in Rochester, New York, ten years ago, before his Alzheimer's diagnosis.
Dave Arnold
Ultimately, they want to integrate their tool into everyday life. “We want it to be used in a smartphone, or a teleconference call so that individuals could be examined in their home,” O’Connell said. “We could follow them over time and work with clinical teams and hospitals to improve the evaluation of patients and contribute towards an accurate diagnosis.”
Arnold, the patient with early stage Alzheimer’s, sees great promise. “The process of getting a diagnosis is already filled with so much anxiety,” he said. “Anything that can be done to make it easier and less stressful would be a good thing, as long as it’s proven accurate.”
NASA astronaut Frank Rubio floats by the International Space Station’s “window to the world.” Yesterday, he returned from the longest single spaceflight by a U.S. astronaut on record - over one year. Exploring deep space will require even longer missions.
Yesterday, NASA astronaut Frank Rubio returned to Earth after over one year, the longest single spaceflight for a U.S. astronaut. But this is just the start; longer and more complex missions into deep space loom ahead, from returning to the moon in 2025 to eventually sending humans to Mars. To ensure that these missions succeed, NASA is increasing efforts to study the biological effects and prevent harm.
The dangers of microgravity are real
A NASA report published in 2016 details a long list of incidents and near-misses caused – at least partly – by space-induced changes in astronauts’ vision and coordination. These issues make it harder to move with precision and to judge distance and velocity.
According to the report, in 1997, a resupply ship collided with the Mir space station, possibly because a crew member bumped into the commander during the final docking maneuver. This mishap caused significant damage to the space station.
Returns to Earth suffered from problems, too. The same report notes that touchdown speeds during the first 100 space shuttle landings were “outside acceptable limits. The fastest landing on record – 224 knots (258 miles) per hour – was linked to the commander’s momentary spatial disorientation.” Earlier, each of the six Apollo crews that landed on the moon had difficulty recognizing moon landmarks and estimating distances. For example, Apollo 15 landed in an unplanned area, ultimately straddling the rim of a five-foot deep crater on the moon, harming one of its engines.
Spaceflight causes unique stresses on astronauts’ brains and central nervous systems. NASA is working to reduce these harmful effects.
NASA
Space messes up your brain
In space, astronauts face the challenges of microgravity, ionizing radiation, social isolation, high workloads, altered circadian rhythms, monotony, confined living quarters and a high-risk environment. Among these issues, microgravity is one of the most consequential in terms of physiological changes. It changes the brain’s structure and its functioning, which can hurt astronauts’ performance.
The brain shifts upwards within the skull, displacing the cerebrospinal fluid, which reduces the brain’s cushioning. Essentially, the brain becomes crowded inside the skull like a pair of too-tight shoes.
That’s partly because of how being in space alters blood flow. On Earth, gravity pulls our blood and other internal fluids toward our feet, but our circulatory valves ensure that the fluids are evenly distributed throughout the body. In space, there’s not enough gravity to pull the fluids down, and they shift up, says Rachael D. Seidler, a physiologist specializing in spaceflight at the University of Florida and principal investigator on many space-related studies. The head swells and legs appear thinner, causing what astronauts call “puffy face chicken legs.”
“The brain changes at the structural and functional level,” says Steven Jillings, equilibrium and aerospace researcher at the University of Antwerp in Belgium. “The brain shifts upwards within the skull,” displacing the cerebrospinal fluid, which reduces the brain’s cushioning. Essentially, the brain becomes crowded inside the skull like a pair of too-tight shoes. Some of the displaced cerebrospinal fluid goes into cavities within the brain, called ventricles, enlarging them. “The remaining fluids pool near the chest and heart,” explains Jillings. After 12 consecutive months in space, one astronaut had a ventricle that was 25 percent larger than before the mission.
Some changes reverse themselves while others persist for a while. An example of a longer-lasting problem is spaceflight-induced neuro-ocular syndrome, which results in near-sightedness and pressure inside the skull. A study of approximately 300 astronauts shows near-sightedness affects about 60 percent of astronauts after long missions on the International Space Station (ISS) and more than 25 percent after spaceflights of only a few weeks.
Another long-term change could be the decreased ability of cerebrospinal fluid to clear waste products from the brain, Seidler says. That’s because compressing the brain also compresses its waste-removing glymphatic pathways, resulting in inflammation, vulnerability to injuries and worsening its overall health.
The effects of long space missions were best demonstrated on astronaut twins Scott and Mark Kelly. This NASA Twins Study showed multiple, perhaps permanent, changes in Scott after his 340-day mission aboard the ISS, compared to Mark, who remained on Earth. The differences included declines in Scott’s speed, accuracy and cognitive abilities that persisted longer than six months after returning to Earth in March 2016.
By the end of 2020, Scott’s cognitive abilities improved, but structural and physiological changes to his eyes still remained, he said in a BBC interview.
“It seems clear that the upward shift of the brain and compression of the surrounding tissues with ventricular expansion might not be a good thing,” Seidler says. “But, at this point, the long-term consequences to brain health and human performance are not really known.”
NASA astronaut Kate Rubins conducts a session for the Neuromapping investigation.
NASA
Staying sharp in space
To investigate how prolonged space travel affects the brain, NASA launched a new initiative called the Complement of Integrated Protocols for Human Exploration Research (CIPHER). “CIPHER investigates how long-duration spaceflight affects both brain structure and function,” says neurobehavioral scientist Mathias Basner at the University of Pennsylvania, a principal investigator for several NASA studies. “Through it, we can find out how the brain adapts to the spaceflight environment and how certain brain regions (behave) differently after – relative to before – the mission.”
To do this, he says, “Astronauts will perform NASA’s cognition test battery before, during and after six- to 12-month missions, and will also perform the same test battery in an MRI scanner before and after the mission. We have to make sure we better understand the functional consequences of spaceflight on the human brain before we can send humans safely to the moon and, especially, to Mars.”
As we go deeper into space, astronauts cognitive and physical functions will be even more important. “A trip to Mars will take about one year…and will introduce long communication delays,” Seidler says. “If you are on that mission and have a problem, it may take eight to 10 minutes for your message to reach mission control, and another eight to 10 minutes for the response to get back to you.” In an emergency situation, that may be too late for the response to matter.
“On a mission to Mars, astronauts will be exposed to stressors for unprecedented amounts of time,” Basner says. To counter them, NASA is considering the continuous use of artificial gravity during the journey, and Seidler is studying whether artificial gravity can reduce the harmful effects of microgravity. Some scientists are looking at precision brain stimulation as a way to improve memory and reduce anxiety due to prolonged exposure to radiation in space.
Other scientists are exploring how to protect neural stem cells (which create brain cells) from radiation damage, developing drugs to repair damaged brain cells and protect cells from radiation.
To boldly go where no astronauts have gone before, they must have optimal reflexes, vision and decision-making. In the era of deep space exploration, the brain—without a doubt—is the final frontier.
Additionally, NASA is scrutinizing each aspect of the mission, including astronaut exercise, nutrition and intellectual engagement. “We need to give astronauts meaningful work. We need to stimulate their sensory, cognitive and other systems appropriately,” Basner says, especially given their extreme confinement and isolation. The scientific experiments performed on the ISS – like studying how microgravity affects the ability of tissue to regenerate is a good example.
“We need to keep them engaged socially, too,” he continues. The ISS crew, for example, regularly broadcasts from space and answers prerecorded questions from students on Earth, and can engage with social media in real time. And, despite tight quarters, NASA is ensuring the crew capsule and living quarters on the moon or Mars include private space, which is critical for good mental health.
Exploring deep space builds on a foundation that began when astronauts first left the planet. With each mission, scientists learn more about spaceflight effects on astronauts’ bodies. NASA will be using these lessons to succeed with its plans to build science stations on the moon and, eventually, Mars.
“Through internally and externally led research, investigations implemented in space and in spaceflight simulations on Earth, we are striving to reduce the likelihood and potential impacts of neurostructural changes in future, extended spaceflight,” summarizes NASA scientist Alexandra Whitmire. To boldly go where no astronauts have gone before, they must have optimal reflexes, vision and decision-making. In the era of deep space exploration, the brain—without a doubt—is the final frontier.
Swiss researchers have found a type of brain cell that appears to be a hybrid of the two other main types — and it could lead to new treatments for brain disorders.
A new brain cell: Researchers at the Wyss Center for Bio and Neuroengineering and the University of Lausanne believe they’ve definitively proven that some astrocytes do actively participate in neurotransmission, making them a sort of hybrid of neurons and glial cells.
According to the researchers, this third type of brain cell, which they call a “glutamatergic astrocyte,” could offer a way to treat Alzheimer’s, Parkinson’s, and other disorders of the nervous system.
“Its discovery opens up immense research prospects,” said study co-director Andrea Volterra.
The study: Neurotransmission starts with a neuron releasing a chemical called a neurotransmitter, so the first thing the researchers did in their study was look at whether astrocytes can release the main neurotransmitter used by neurons: glutamate.
By analyzing astrocytes taken from the brains of mice, they discovered that certain astrocytes in the brain’s hippocampus did include the “molecular machinery” needed to excrete glutamate. They found evidence of the same machinery when they looked at datasets of human glial cells.
Finally, to demonstrate that these hybrid cells are actually playing a role in brain signaling, the researchers suppressed their ability to secrete glutamate in the brains of mice. This caused the rodents to experience memory problems.
“Our next studies will explore the potential protective role of this type of cell against memory impairment in Alzheimer’s disease, as well as its role in other regions and pathologies than those explored here,” said Andrea Volterra, University of Lausanne.
But why? The researchers aren’t sure why the brain needs glutamatergic astrocytes when it already has neurons, but Volterra suspects the hybrid brain cells may help with the distribution of signals — a single astrocyte can be in contact with thousands of synapses.
“Often, we have neuronal information that needs to spread to larger ensembles, and neurons are not very good for the coordination of this,” researcher Ludovic Telley told New Scientist.
Looking ahead: More research is needed to see how the new brain cell functions in people, but the discovery that it plays a role in memory in mice suggests it might be a worthwhile target for Alzheimer’s disease treatments.
The researchers also found evidence during their study that the cell might play a role in brain circuits linked to seizures and voluntary movements, meaning it’s also a new lead in the hunt for better epilepsy and Parkinson’s treatments.
“Our next studies will explore the potential protective role of this type of cell against memory impairment in Alzheimer’s disease, as well as its role in other regions and pathologies than those explored here,” said Volterra.
