Scientists Want to Make Robots with Genomes that Help Grow their Minds
Lina Zeldovich has written about science, medicine and technology for Popular Science, Smithsonian, National Geographic, Scientific American, Reader’s Digest, the New York Times and other major national and international publications. A Columbia J-School alumna, she has won several awards for her stories, including the ASJA Crisis Coverage Award for Covid reporting, and has been a contributing editor at Nautilus Magazine. In 2021, Zeldovich released her first book, The Other Dark Matter, published by the University of Chicago Press, about the science and business of turning waste into wealth and health. You can find her on http://linazeldovich.com/ and @linazeldovich.
One day in recent past, scientists at Columbia University’s Creative Machines Lab set up a robotic arm inside a circle of five streaming video cameras and let the robot watch itself move, turn and twist. For about three hours the robot did exactly that—it looked at itself this way and that, like toddlers exploring themselves in a room full of mirrors. By the time the robot stopped, its internal neural network finished learning the relationship between the robot’s motor actions and the volume it occupied in its environment. In other words, the robot built a spatial self-awareness, just like humans do. “We trained its deep neural network to understand how it moved in space,” says Boyuan Chen, one of the scientists who worked on it.
For decades robots have been doing helpful tasks that are too hard, too dangerous, or physically impossible for humans to carry out themselves. Robots are ultimately superior to humans in complex calculations, following rules to a tee and repeating the same steps perfectly. But even the biggest successes for human-robot collaborations—those in manufacturing and automotive industries—still require separating the two for safety reasons. Hardwired for a limited set of tasks, industrial robots don't have the intelligence to know where their robo-parts are in space, how fast they’re moving and when they can endanger a human.
Over the past decade or so, humans have begun to expect more from robots. Engineers have been building smarter versions that can avoid obstacles, follow voice commands, respond to human speech and make simple decisions. Some of them proved invaluable in many natural and man-made disasters like earthquakes, forest fires, nuclear accidents and chemical spills. These disaster recovery robots helped clean up dangerous chemicals, looked for survivors in crumbled buildings, and ventured into radioactive areas to assess damage.
Now roboticists are going a step further, training their creations to do even better: understand their own image in space and interact with humans like humans do. Today, there are already robot-teachers like KeeKo, robot-pets like Moffin, robot-babysitters like iPal, and robotic companions for the elderly like Pepper.
But even these reasonably intelligent creations still have huge limitations, some scientists think. “There are niche applications for the current generations of robots,” says professor Anthony Zador at Cold Spring Harbor Laboratory—but they are not “generalists” who can do varied tasks all on their own, as they mostly lack the abilities to improvise, make decisions based on a multitude of facts or emotions, and adjust to rapidly changing circumstances. “We don’t have general purpose robots that can interact with the world. We’re ages away from that.”
Robotic spatial self-awareness – the achievement by the team at Columbia – is an important step toward creating more intelligent machines. Hod Lipson, professor of mechanical engineering who runs the Columbia lab, says that future robots will need this ability to assist humans better. Knowing how you look and where in space your parts are, decreases the need for human oversight. It also helps the robot to detect and compensate for damage and keep up with its own wear-and-tear. And it allows robots to realize when something is wrong with them or their parts. “We want our robots to learn and continue to grow their minds and bodies on their own,” Chen says. That’s what Zador wants too—and on a much grander level. “I want a robot who can drive my car, take my dog for a walk and have a conversation with me.”
Columbia scientists have trained a robot to become aware of its own "body," so it can map the right path to touch a ball without running into an obstacle, in this case a square.
Jane Nisselson and Yinuo Qin/ Columbia Engineering
Today’s technological advances are making some of these leaps of progress possible. One of them is the so-called Deep Learning—a method that trains artificial intelligence systems to learn and use information similar to how humans do it. Described as a machine learning method based on neural network architectures with multiple layers of processing units, Deep Learning has been used to successfully teach machines to recognize images, understand speech and even write text.
Trained by Google, one of these language machine learning geniuses, BERT, can finish sentences. Another one called GPT3, designed by San Francisco-based company OpenAI, can write little stories. Yet, both of them still make funny mistakes in their linguistic exercises that even a child wouldn’t. According to a paper published by Stanford’s Center for Research on Foundational Models, BERT seems to not understand the word “not.” When asked to fill in the word after “A robin is a __” it correctly answers “bird.” But try inserting the word “not” into that sentence (“A robin is not a __”) and BERT still completes it the same way. Similarly, in one of its stories, GPT3 wrote that if you mix a spoonful of grape juice into your cranberry juice and drink the concoction, you die. It seems that robots, and artificial intelligence systems in general, are still missing some rudimentary facts of life that humans and animals grasp naturally and effortlessly.
How does one give robots a genome? Zador has an idea. We can’t really equip machines with real biological nucleotide-based genes, but we can mimic the neuronal blueprint those genes create.
It's not exactly the robots’ fault. Compared to humans, and all other organisms that have been around for thousands or millions of years, robots are very new. They are missing out on eons of evolutionary data-building. Animals and humans are born with the ability to do certain things because they are pre-wired in them. Flies know how to fly, fish knows how to swim, cats know how to meow, and babies know how to cry. Yet, flies don’t really learn to fly, fish doesn’t learn to swim, cats don’t learn to meow, and babies don’t learn to cry—they are born able to execute such behaviors because they’re preprogrammed to do so. All that happens thanks to the millions of years of evolutions wired into their respective genomes, which give rise to the brain’s neural networks responsible for these behaviors. Robots are the newbies, missing out on that trove of information, Zador argues.
A neuroscience professor who studies how brain circuitry generates various behaviors, Zador has a different approach to developing the robotic mind. Until their creators figure out a way to imbue the bots with that information, robots will remain quite limited in their abilities. Each model will only be able to do certain things it was programmed to do, but it will never go above and beyond its original code. So Zador argues that we have to start giving robots a genome.
How does one do that? Zador has an idea. We can’t really equip machines with real biological nucleotide-based genes, but we can mimic the neuronal blueprint those genes create. Genomes lay out rules for brain development. Specifically, the genome encodes blueprints for wiring up our nervous system—the details of which neurons are connected, the strength of those connections and other specs that will later hold the information learned throughout life. “Our genomes serve as blueprints for building our nervous system and these blueprints give rise to a human brain, which contains about 100 billion neurons,” Zador says.
If you think what a genome is, he explains, it is essentially a very compact and compressed form of information storage. Conceptually, genomes are similar to CliffsNotes and other study guides. When students read these short summaries, they know about what happened in a book, without actually reading that book. And that’s how we should be designing the next generation of robots if we ever want them to act like humans, Zador says. “We should give them a set of behavioral CliffsNotes, which they can then unwrap into brain-like structures.” Robots that have such brain-like structures will acquire a set of basic rules to generate basic behaviors and use them to learn more complex ones.
Currently Zador is in the process of developing algorithms that function like simple rules that generate such behaviors. “My algorithms would write these CliffsNotes, outlining how to solve a particular problem,” he explains. “And then, the neural networks will use these CliffsNotes to figure out which ones are useful and use them in their behaviors.” That’s how all living beings operate. They use the pre-programmed info from their genetics to adapt to their changing environments and learn what’s necessary to survive and thrive in these settings.
For example, a robot’s neural network could draw from CliffsNotes with “genetic” instructions for how to be aware of its own body or learn to adjust its movements. And other, different sets of CliffsNotes may imbue it with the basics of physical safety or the fundamentals of speech.
At the moment, Zador is working on algorithms that are trying to mimic neuronal blueprints for very simple organisms—such as earthworms, which have only 302 neurons and about 7000 synapses compared to the millions we have. That’s how evolution worked, too—expanding the brains from simple creatures to more complex to the Homo Sapiens. But if it took millions of years to arrive at modern humans, how long would it take scientists to forge a robot with human intelligence? That’s a billion-dollar question. Yet, Zador is optimistic. “My hypotheses is that if you can build simple organisms that can interact with the world, then the higher level functions will not be nearly as challenging as they currently are.”
Lina Zeldovich has written about science, medicine and technology for Popular Science, Smithsonian, National Geographic, Scientific American, Reader’s Digest, the New York Times and other major national and international publications. A Columbia J-School alumna, she has won several awards for her stories, including the ASJA Crisis Coverage Award for Covid reporting, and has been a contributing editor at Nautilus Magazine. In 2021, Zeldovich released her first book, The Other Dark Matter, published by the University of Chicago Press, about the science and business of turning waste into wealth and health. You can find her on http://linazeldovich.com/ and @linazeldovich.
Gene Transfer Leads to Longer Life and Healthspan
The naked mole rat won’t win any beauty contests, but it could possibly win in the talent category. Its superpower: fighting the aging process to live several times longer than other animals its size, in a state of youthful vigor.
It’s believed that naked mole rats experience all the normal processes of wear and tear over their lifespan, but that they’re exceptionally good at repairing the damage from oxygen free radicals and the DNA errors that accumulate over time. Even though they possess genes that make them vulnerable to cancer, they rarely develop the disease, or any other age-related disease, for that matter. Naked mole rats are known to live for over 40 years without any signs of aging, whereas mice live on average about two years and are highly prone to cancer.
Now, these remarkable animals may be able to share their superpower with other species. In August, a study provided what may be the first proof-of-principle that genetic material transferred from one species can increase both longevity and healthspan in a recipient animal.
There are several theories to explain the naked mole rat’s longevity, but the one explored in the study, published in Nature, is based on the abundance of large-molecule high-molecular mass hyaluronic acid (HMM-HA).
A small molecule version of hyaluronic acid is commonly added to skin moisturizers and cosmetics that are marketed as ways to keep skin youthful, but this version, just applied to the skin, won’t have a dramatic anti-aging effect. The naked mole rat has an abundance of the much-larger molecule, HMM-HA, in the chemical-rich solution between cells throughout its body. But does the HMM-HA actually govern the extraordinary longevity and healthspan of the naked mole rat?
To answer this question, Dr. Vera Gorbunova, a professor of biology and oncology at the University of Rochester, and her team created a mouse model containing the naked mole rat gene hyaluronic acid synthase 2, or nmrHas2. It turned out that the mice receiving this gene during their early developmental stage also expressed HMM-HA.
The researchers found that the effects of the HMM-HA molecule in the mice were marked and diverse, exceeding the expectations of the study’s co-authors. High-molecular mass hyaluronic acid was more abundant in kidneys, muscles and other organs of the Has2 mice compared to control mice.
In addition, the altered mice had a much lower incidence of cancer. Seventy percent of the control mice eventually developed cancer, compared to only 57 percent of the altered mice, even after several techniques were used to induce the disease. The biggest difference occurred in the oldest mice, where the cancer incidence for the Has2 mice and the controls was 47 percent and 83 percent, respectively.
With regard to longevity, Has2 males increased their lifespan by more than 16 percent and the females added 9 percent. “Somehow the effect is much more pronounced in male mice, and we don’t have a perfect answer as to why,” says Dr. Gorbunova. Another improvement was in the healthspan of the altered mice: the number of years they spent in a state of relative youth. There’s a frailty index for mice, which includes body weight, mobility, grip strength, vision and hearing, in addition to overall conditions such as the health of the coat and body temperature. The Has2 mice scored lower in frailty than the controls by all measures. They also performed better in tests of locomotion and coordination, and in bone density.
Gorbunova’s results show that a gene artificially transferred from one species can have a beneficial effect on another species for longevity, something that had never been demonstrated before. This finding is “quite spectacular,” said Steven Austad, a biologist at the University of Alabama at Birmingham, who was not involved in the study.
Just as in lifespan, the effects in various organs and systems varied between the sexes, a common occurrence in longevity research, according to Austad, who authored the book Methuselah’s Zoo and specializes in the biological differences between species. “We have ten drugs that we can give to mice to make them live longer,” he says, “and all of them work better in one sex than in the other.” This suggests that more attention needs to be paid to the different effects of anti-aging strategies between the sexes, as well as gender differences in healthspan.
According to the study authors, the HMM-HA molecule delivered these benefits by reducing inflammation and senescence (cell dysfunction and death). The molecule also caused a variety of other benefits, including an upregulation of genes involved in the function of mitochondria, the powerhouses of the cells. These mechanisms are implicated in the aging process, and in human disease. In humans, virtually all noncommunicable diseases entail an acceleration of the aging process.
So, would the gene that creates HMM-HA have similar benefits for longevity in humans? “We think about these questions a lot,” Gorbunova says. “It’s been done by injections in certain patients, but it has a local effect in the treatment of organs affected by disease,” which could offer some benefits, she added.
“Mice are very short-lived and cancer-prone, and the effects are small,” says Steven Austad, a biologist at the University of Alabama at Birmingham. “But they did live longer and stay healthy longer, which is remarkable.”
As for a gene therapy to introduce the nmrHas2 gene into humans to obtain a global result, she’s skeptical because of the complexity involved. Gorbunova notes that there are potential dangers in introducing an animal gene into humans, such as immune responses or allergic reactions.
Austad is equally cautious about a gene therapy. “What this study says is that you can take something a species does well and transfer at least some of that into a new species. It opens up the way, but you may need to transfer six or eight or ten genes into a human” to get the large effect desired. Humans are much more complex and contain many more genes than mice, and all systems in a biological organism are intricately connected. One naked mole rat gene may not make a big difference when it interacts with human genes, metabolism and physiology.
Still, Austad thinks the possibilities are tantalizing. “Mice are very short-lived and cancer-prone, and the effects are small,” he says. “But they did live longer and stay healthy longer, which is remarkable.”
As for further research, says Austad, “The first place to look is the skin” to see if the nmrHas2 gene and the HMM-HA it produces can reduce the chance of cancer. Austad added that it would be straightforward to use the gene to try to prevent cancer in skin cells in a dish to see if it prevents cancer. It would not be hard to do. “We don’t know of any downsides to hyaluronic acid in skin, because it’s already used in skin products, and you could look at this fairly quickly.”
“Aging mechanisms evolved over a long time,” says Gorbunova, “so in aging there are multiple mechanisms working together that affect each other.” All of these processes could play a part and almost certainly differ from one species to the next.
“HMM-HA molecules are large, but we’re now looking for a small-molecule drug that would slow it’s breakdown,” she says. “And we’re looking for inhibitors, now being tested in mice, that would hinder the breakdown of hyaluronic acid.” Gorbunova has found a natural, plant-based product that acts as an inhibitor and could potentially be taken as a supplement. Ultimately, though, she thinks that drug development will be the safest and most effective approach to delivering HMM-HA for anti-aging.
In recent years, researchers of Alzheimer’s have made progress in figuring out the complex factors that lead to the disease. Yet, the root cause, or causes, of Alzheimer’s are still pretty much a mystery.
In fact, many people get Alzheimer’s even though they lack the gene variant we know can play a role in the disease. This is a critical knowledge gap for research to address because the vast majority of Alzheimer’s patients don’t have this variant.
A new study provides key insights into what’s causing the disease. The research, published in Nature Communications, points to a breakdown over time in the brain’s system for clearing waste, an issue that seems to happen in some people as they get older.
Michael Glickman, a biologist at Technion – Israel Institute of Technology, helped lead this research. I asked him to tell me about his approach to studying how this breakdown occurs in the brain, and how he tested a treatment that has potential to fix the problem at its earliest stages.
Dr. Michael Glickman is internationally renowned for his research on the ubiquitin-proteasome system (UPS), the brain's system for clearing the waste that is involved in diseases such as Huntington's, Alzheimer's, and Parkinson's. He is the head of the Lab for Protein Characterization in the Faculty of Biology at the Technion – Israel Institute of Technology. In the lab, Michael and his team focus on protein recycling and the ubiquitin-proteasome system, which protects against serious diseases like Alzheimer’s, Parkinson’s, cystic fibrosis, and diabetes. After earning his PhD at the University of California at Berkeley in 1994, Michael joined the Technion as a Senior Lecturer in 1998 and has served as a full professor since 2009.
Dr. Michael Glickman