In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Dave Arnold retired in his 60s and began spending time volunteering in local schools. But then he started misplacing items, forgetting appointments and losing his sense of direction. Eventually he was diagnosed with early stage Alzheimer’s.
“Hearing the diagnosis made me very emotional and tearful,” he said. “I immediately thought of all my mom had experienced.” His mother suffered with the condition for years before passing away. Over the last year, Arnold has worked for the Alzheimer’s Association as one of its early stage advisors, sharing his insights to help others in the initial stages of the disease.
Arnold was diagnosed sooner than many others. It's important to find out early, when interventions can make the most difference. One promising avenue is looking at how people talk. Research has shown that Alzheimer’s affects a part of the brain that controls speech, resulting in small changes before people show other signs of the disease.
Now, Canary Speech, a company based in Utah, is using AI to examine elements like the pitch of a person’s voice and their pauses. In an initial study, Canary analyzed speech recordings with AI and identified early stage Alzheimer’s with 96 percent accuracy.
Developing the AI model
Canary Speech’s CEO, Henry O’Connell, met cofounder Jeff Adams about 40 years before they started the company. Back when they first crossed paths, they were both living in Bethesda, Maryland; O’Connell was a research fellow at the National Institutes of Health studying rare neurological diseases, while Adams was working to decode spy messages. Later on, Adams would specialize in building mathematical models to analyze speech and sound as a team leader in developing Amazon's Alexa.
It wasn't until 2015 that they decided to make use of the fit between their backgrounds. ““We established Canary Speech in 2017 to build a product that could be used in multiple languages in clinical environments,” O'Connell says.
The need is growing. About 55 million people worldwide currently live with Alzheimer’s, a number that is expected to double by 2050. Some scientists think the disease results from a buildup of plaque in the brain. It causes mild memory loss at first and, over time, this issue get worse while other symptoms, such as disorientation and hallucinations, can develop. Treatment to manage the disease is more effective in the earlier stages, but detection is difficult since mild symptoms are often attributed to the normal aging process.
O’Connell and Adams specialize in the complex ways that Alzheimer’s effects how people speak. Using AI, their mathematical model analyzes 15 million data points every minute, focusing on certain features of speech such as pitch, pauses and elongation of words. It also pays attention to how the vibrations of vocal cords change in different stages of the disease.
To create their model, the team used a type of machine learning called deep neural nets, which looks at multiple layers of data - in this case, the multiple features of a person’s speech patterns.
“Deep neural nets allow us to look at much, much larger data sets built out of millions of elements,” O’Connell explained. “Through machine learning and AI, we’ve identified features that are very sensitive to an Alzheimer’s patient versus [people without the disease] and also very sensitive to mild cognitive impairment, early stage and moderate Alzheimer's.” Based on their learnings, Canary is able to classify the disease stage very quickly, O’Connell said.
“When we’re listening to sublanguage elements, we’re really analyzing the direct result of changes in the brain in the physical body,” O’Connell said. “The brain controls your vocal cords: how fast they vibrate, the expansion of them, the contraction.” These factors, along with where people put their tongues when talking, function subconsciously and result in subtle changes in the sounds of speech.
Further testing is needed
In an initial trial, Canary analyzed speech recordings from phone calls to a large U.S. health insurer. They looked at the audio recordings of 651 policyholders who had early stage Alzheimer’s and 1018 who did not have the condition, aiming for a representative sample of age, gender and race. They used this data to create their first diagnostic model and found that it was 96 percent accurate in identifying Alzheimer’s.
Christian Herff, an assistant professor of neuroscience at Maastricht University in the Netherlands, praised this approach while adding that further testing is needed to assess its effectiveness.
“I think the general idea of identifying increased risk for cognitive impairment based on speech characteristics is very feasible, particularly when change in a user’s voice is monitored, for example, by recording speech every year,” Herff said. He noted that this can only be a first indication, not a full diagnosis. The accuracy still needs to be validated in studies that follows individuals over a period of time, he said.
Toby Walsh, a professor of artificial intelligence at the University of New South Wales, also thinks Canary’s tool has potential but highlights that Canary could diagnose some people who don’t really have the disease. “This is an interesting and promising application of AI,” he said, “but these tools need to be used carefully. Imagine the anxiety of being misdiagnosed with Alzheimer’s.”
As with many other AI tools, privacy and bias are additional issues to monitor closely, Walsh said.
Other languages
A related issue is that not everyone is fluent in English. Mahnaz Arvaneh, a senior lecturer in automatic control and systems engineering at the University of Sheffield, said this could be a blind spot.
“The system may not be very accurate for those who have English as their second language as their speaking patterns would be different, and any issue might be because of language deficiency rather than cognitive issues,” Arvaneh said.
The team is expanding to multiple languages starting with Japanese and Spanish. The elements of the model that make up the algorithm are very similar, but they need to be validated and retrained in a different language, which will require access to more data.
Recently, Canary analyzed the phone calls of 233 Japanese patients who had mild cognitive impairment and 704 healthy people. Using an English model they were able to identify the Japanese patients who had mild cognitive impairment with 78 percent accuracy. They also developed a model in Japanese that was 45 percent accurate, and they’re continuing to train it with more data.
The future
Canary is using their model to look at other diseases like Huntington’s and Parkinson’s. They’re also collaborating with pharmaceuticals to validate potential therapies for Alzheimer’s. By looking at speech patterns over time, Canary can get an indication of how well these drugs are working.
Dave Arnold and his wife dance at his nephew’s wedding in Rochester, New York, ten years ago, before his Alzheimer's diagnosis.
Dave Arnold
Ultimately, they want to integrate their tool into everyday life. “We want it to be used in a smartphone, or a teleconference call so that individuals could be examined in their home,” O’Connell said. “We could follow them over time and work with clinical teams and hospitals to improve the evaluation of patients and contribute towards an accurate diagnosis.”
Arnold, the patient with early stage Alzheimer’s, sees great promise. “The process of getting a diagnosis is already filled with so much anxiety,” he said. “Anything that can be done to make it easier and less stressful would be a good thing, as long as it’s proven accurate.”
Peanut allergies affect about a million children in the U.S., and most never outgrow them. Luckily, some promising remedies are in the works.
Typically, people with peanut allergies try to completely avoid them and carry an adrenaline autoinjector like an EpiPen in case of emergencies. This constant vigilance is very stressful, particularly for parents with young children.
“The search for a peanut allergy ‘cure’ has been a vigorous one,” says Claudia Gray, a pediatrician and allergist at Vincent Pallotti Hospital in Cape Town, South Africa. The closest thing to a solution so far, she says, is the process of desensitization, which exposes the patient to gradually increasing doses of peanut allergen to build up a tolerance. The most common type of desensitization is oral immunotherapy, where patients ingest small quantities of peanut powder. It has been effective but there is a risk of anaphylaxis since it involves swallowing the allergen.
"By the end of the trial, my son tolerated approximately 1.5 peanuts," Sharon Wong says.
DBV Technologies, a company based in Montrouge, France has created a skin patch to address this problem. The Viaskin Patch contains a much lower amount of peanut allergen than oral immunotherapy and delivers it through the skin to slowly increase tolerance. This decreases the risk of anaphylaxis.
Wong heard about the peanut patch and wanted her son to take part in an early phase 2 trial for 4-to-11-year-olds.
“We felt that participating in DBV’s peanut patch trial would give him the best chance at desensitization or at least increase his tolerance from a speck of peanut to a peanut,” Wong says. “The daily routine was quite simple, remove the old patch and then apply a new one. By the end of the trial, he tolerated approximately 1.5 peanuts.”
How it works
For DBV Technologies, it all began when pediatric gastroenterologist Pierre-Henri Benhamou teamed up with fellow professor of gastroenterology Christopher Dupont and his brother, engineer Bertrand Dupont. Together they created a more effective skin patch to detect when babies have allergies to cow's milk. Then they realized that the patch could actually be used to treat allergies by promoting tolerance. They decided to focus on peanut allergies first as the more dangerous.
The Viaskin patch utilizes the fact that the skin can promote tolerance to external stimuli. The skin is the body’s first defense. Controlling the extent of the immune response is crucial for the skin. So it has defense mechanisms against external stimuli and can promote tolerance.
The patch consists of an adhesive foam ring with a plastic film on top. A small amount of peanut protein is placed in the center. The adhesive ring is attached to the back of the patient's body. The peanut protein sits above the skin but does not directly touch it. As the patient sweats, water droplets on the inside of the film dissolve the peanut protein, which is then absorbed into the skin.
The peanut protein is then captured by skin cells called Langerhans cells. They play an important role in getting the immune system to tolerate certain external stimuli. Langerhans cells take the peanut protein to lymph nodes which activate T regulatory cells. T regulatory cells suppress the allergic response.
A different patch is applied to the skin every day to increase tolerance. It’s both easy to use and convenient.
“The DBV approach uses much smaller amounts than oral immunotherapy and works through the skin significantly reducing the risk of allergic reactions,” says Edwin H. Kim, the division chief of Pediatric Allergy and Immunology at the University of North Carolina, U.S., and one of the principal investigators of Viaskin’s clinical trials. “By not going through the mouth, the patch also avoids the taste and texture issues. Finally, the ability to apply a patch and immediately go about your day may be very attractive to very busy patients and families.”
Brandon Wong displaying origami figures he folded at an Origami Convention in 2022
Sharon Wong
Clinical trials
Results from DBV's phase 3 trial in children ages 1 to 3 show its potential. For a positive result, patients who could not tolerate 10 milligrams or less of peanut protein had to be able to manage 300 mg or more after 12 months. Toddlers who could already tolerate more than 10 mg needed to be able to manage 1000 mg or more. In the end, 67 percent of subjects using the Viaskin patch met the target as compared to 33 percent of patients taking the placebo dose.
“The Viaskin peanut patch has been studied in several clinical trials to date with promising results,” says Suzanne M. Barshow, assistant professor of medicine in allergy and asthma research at Stanford University School of Medicine in the U.S. “The data shows that it is safe and well-tolerated. Compared to oral immunotherapy, treatment with the patch results in fewer side effects but appears to be less effective in achieving desensitization.”
The primary reason the patch is less potent is that oral immunotherapy uses a larger amount of the allergen. Additionally, absorption of the peanut protein into the skin could be erratic.
Gray also highlights that there is some tradeoff between risk and efficacy.
“The peanut patch is an exciting advance but not as effective as the oral route,” Gray says. “For those patients who are very sensitive to orally ingested peanut in oral immunotherapy or have an aversion to oral peanut, it has a use. So, essentially, the form of immunotherapy will have to be tailored to each patient.” Having different forms such as the Viaskin patch which is applied to the skin or pills that patients can swallow or dissolve under the tongue is helpful.
The hope is that the patch’s efficacy will increase over time. The team is currently running a follow-up trial, where the same patients continue using the patch.
“It is a very important study to show whether the benefit achieved after 12 months on the patch stays stable or hopefully continues to grow with longer duration,” says Kim, who is an investigator in this follow-up trial.
"My son now attends university in Massachusetts, lives on-campus, and eats dorm food. He has so much more freedom," Wong says.
The team is further ahead in the phase 3 follow-up trial for 4-to-11-year-olds. The initial phase 3 trial was not as successful as the trial for kids between one and three. The patch enabled patients to tolerate more peanuts but there was not a significant enough difference compared to the placebo group to be definitive. The follow-up trial showed greater potency. It suggests that the longer patients are on the patch, the stronger its effects.
They’re also testing if making the patch bigger, changing the shape and extending the minimum time it’s worn can improve its benefits in a trial for a new group of 4-to-11 year-olds.
The future
DBV Technologies is using the skin patch to treat cow’s milk allergies in children ages 1 to 17. They’re currently in phase 2 trials.
As for the peanut allergy trials in toddlers, the hope is to see more efficacy soon.
For Wong’s son who took part in the earlier phase 2 trial for 4-to-11-year-olds, the patch has transformed his life.
“My son continues to maintain his peanut tolerance and is not affected by peanut dust in the air or cross-contact,” Wong says. ”He attends university in Massachusetts, lives on-campus, and eats dorm food. He still carries an EpiPen but has so much more freedom than before his clinical trial. We will always be grateful.”
In Ethiopia, Samuna’s three donkeys help her transport produce to market and to collect the water essential to her family, neighbours and livestock. Donkeys are more endangered than people realize, experts say.
“That's the reason why some breeds begin to disappear because humans were not really interested in having that specific breed anymore,” Gambini says. Nonetheless, in Africa, India and Latin America millions of rural families still rely on these hardy creatures for agriculture and transportation. And the only two wild donkey species—Equus africanus in Africa and Equus hemionus in Asia—are also dwindling, due to losing their habitats to human activities, diseases and slow reproduction rates. Gambini’s team wanted to create a way to preserve the animals for the future. “Donkeys are more endangered than people realize,” he says.
There’s much more to donkeys' trouble though. For the past 20 or so years, they have been facing a huge existential threat due to their hide gelatin, a compound derived from their skins by soaking and stewing. In Chinese traditional medicine, the compound, called ejiao, is believed to have a medicinal value, so it’s used in skin creams, added to food and taken in capsules. Centuries ago, ejiao was a very expensive luxury product available only for the emperor and his household. That changed in the 1990s when the Chinese economy boomed, and many people were suddenly able to afford it. “It went from a very elite product to a very popular product,” says Janneke Merkx, a campaign manager at The Donkey Sanctuary, a United Kingdom-based nonprofit organization that keeps tabs on the animals’ welfare worldwide. “It is a status symbol for gift giving.”
Having evolved in the harsh and arid mountainous terrains where food and water were scarce, donkeys are extremely adaptable and hardy. But the Donkey Sanctuary documented cases in which an entire village had their animals disappear overnight, finding them killed and skinned outside their settlement.
The Chinese donkey population was quickly decimated. Unlike many other farm animals, donkeys are finicky breeders. When stressed and unhappy, they don’t procreate, so growing them in large industrial settings isn’t possible. “Donkeys are notoriously slow breeders and really very difficult to farm,” says Merkx. “They are not the same as other livestock like sheep and pigs and cattle.” Within years the, the donkey numbers in China dropped precipitously. “China used to have the largest donkey population in the world in the 1990s. They had 11 million donkeys, and it's now down to less than 3 million, and they just can't keep up with the demand.”
To keep the ejiao conveyor going, some producers turned to the illegal wildlife trade. Poachers began to steal and slaughter donkeys from rural villages in Africa. The Donkey Sanctuary documented cases in which an entire village had their animals disappear overnight, finding them killed and skinned outside their settlement. Exactly how many creatures were lost to the skin trade to-date isn’t possible to calculate, says Faith Burden, the Donkey Sanctuary’s director of equine operations. Traditionally a poor people’s beast of burden, donkey counts are hard to keep track of. “When an animal doesn't produce meat, milk or eggs or whatever edible product, they're often less likely to be acknowledged in a government population census,” Burden says. “So reliable statistics are hard to come by.” The nonprofit estimates that about 4.8 million are slaughtered annually.
During their six to seven thousand years of domestication, donkeys rarely got the full appreciation for their services. They are often compared to horses, which doesn’t do them justice. They’re entirely different animals, Burden says. Built for speed, horses respond to predators and other dangers by running as fast as they can. Donkeys, which originate from the rocky, mountainous regions of Africa where running is dangerous, react to threats by freezing and assessing the situation for the best response. “Those so-called stubborn donkeys that won’t move as you want, they are actually thinking ‘what’s the best approach,’” Burden says. They may even choose to fight the predators rather than flee, she adds. “In some parts of the world, people use them as guard animals against things like coyotes and wolves.”
Scientists believe that domestic donkeys take their origin from Equus africanus or African wild ass, originally roaming where Kenya, Ethiopia and Eritrea are today. Having evolved in the harsh and arid mountainous terrains where food and water were scarce, they are extremely adaptable and hardy. Research finds that they can go without water for 72 hours and then drink their fill without any negative consequences. Their big jaws let them chew tough desert shrubs, which horses can’t exist on. Their large ears help dissipate heat. Their little upright hooves are a perfect fit for the uneven rocky or other dangerous grounds. Accustomed to the mountain desert climate with hot days and cold nights, they don’t mind temperature flux.
“The donkey is the most supremely adapted animal to deal with hostile conditions,” Burden says. “They can survive on much lower nutritional quality food than a cow, sheep or horse. That’s why communities living in some of the most inhospitable places will often have donkeys with them.” And that’s why losing a donkey to an illegal skin trade can devastate a family in places like Eritrea. Suddenly everything from water to firewood to produce must be carried by family members—and often women.
Workers unloading donkeys at the Shinyanga slaughterhouse in Tanzania. Fearing a future in which donkeys go extinct, scientists have found ways to cryopreserve a donkey embryo in liquid nitrogen.
TAHUCHA
One can imagine a time when worldwide donkey populations may dwindle to the point that they would need to be restored. That includes their genetic variability too. That’s where the frozen embryos may come in handy. We may be able to use them to increase the genetic variability of donkeys, which will be especially important if they get closer to extinction, Gambini says. His team had already created frozen embryos for horses and zebras, an idea similar to a seed bank. “We call this concept the Frozen Zoo.”
Creating donkey embryos proved much harder than those of zebras and horses. To improve chances of fertilization, Gambini used the intracytoplasmic sperm injection or ICSI, in which he employed a tiny needle called a micropipette to inject a donkey sperm into an egg. That was a step above the traditional IVF method, in which the egg and a sperm are left floating in a test tube together. The injection took, but during the incubating week, one after the other, the embryos stopped dividing. Finally, on day seven, Gambini finally spotted the exact sight he was hoping to see. One of the embryos developed into a burgeoning ball of cells.
“That stage is called a blastocyst,” Gambini says. The clump of cells had a lot of fluids mixed within them, which indicated that they were finally developing into a viable embryo. “When we see a blastocyst, we know we can transfer that into a female.” He was so excited he immediately called all his collaborators to tell them the good news, which they later published in the journal of Theriogenology.
The one and only embryo to reach that stage, the blastocyst was cryopreserved in liquid nitrogen. The team is waiting for the next breeding season to see if a female donkey may carry it to term and give birth to a healthy foal. Gambini’s team is hoping to polish the process and create more embryos. “It’s our weapon in the conservation ass-enal,” he says.