Giving robots self-awareness as they move through space - and maybe even providing them with gene-like methods for storing rules of behavior - could be important steps toward creating more intelligent machines.
Now roboticists are going a step further, training their creations to do even better: understand their own image in space and interact with humans like humans do. Today, there are already robot-teachers like KeeKo, robot-pets like Moffin, robot-babysitters like iPal, and robotic companions for the elderly like Pepper.
But even these reasonably intelligent creations still have huge limitations, some scientists think. “There are niche applications for the current generations of robots,” says professor Anthony Zador at Cold Spring Harbor Laboratory—but they are not “generalists” who can do varied tasks all on their own, as they mostly lack the abilities to improvise, make decisions based on a multitude of facts or emotions, and adjust to rapidly changing circumstances. “We don’t have general purpose robots that can interact with the world. We’re ages away from that.”
Robotic spatial self-awareness – the achievement by the team at Columbia – is an important step toward creating more intelligent machines. Hod Lipson, professor of mechanical engineering who runs the Columbia lab, says that future robots will need this ability to assist humans better. Knowing how you look and where in space your parts are, decreases the need for human oversight. It also helps the robot to detect and compensate for damage and keep up with its own wear-and-tear. And it allows robots to realize when something is wrong with them or their parts. “We want our robots to learn and continue to grow their minds and bodies on their own,” Chen says. That’s what Zador wants too—and on a much grander level. “I want a robot who can drive my car, take my dog for a walk and have a conversation with me.”
Columbia scientists have trained a robot to become aware of its own "body," so it can map the right path to touch a ball without running into an obstacle, in this case a square.
Jane Nisselson and Yinuo Qin/ Columbia Engineering
Today’s technological advances are making some of these leaps of progress possible. One of them is the so-called Deep Learning—a method that trains artificial intelligence systems to learn and use information similar to how humans do it. Described as a machine learning method based on neural network architectures with multiple layers of processing units, Deep Learning has been used to successfully teach machines to recognize images, understand speech and even write text.
Trained by Google, one of these language machine learning geniuses, BERT, can finish sentences. Another one called GPT3, designed by San Francisco-based company OpenAI, can write little stories. Yet, both of them still make funny mistakes in their linguistic exercises that even a child wouldn’t. According to a paper published by Stanford’s Center for Research on Foundational Models, BERT seems to not understand the word “not.” When asked to fill in the word after “A robin is a __” it correctly answers “bird.” But try inserting the word “not” into that sentence (“A robin is not a __”) and BERT still completes it the same way. Similarly, in one of its stories, GPT3 wrote that if you mix a spoonful of grape juice into your cranberry juice and drink the concoction, you die. It seems that robots, and artificial intelligence systems in general, are still missing some rudimentary facts of life that humans and animals grasp naturally and effortlessly.
How does one give robots a genome? Zador has an idea. We can’t really equip machines with real biological nucleotide-based genes, but we can mimic the neuronal blueprint those genes create.
It's not exactly the robots’ fault. Compared to humans, and all other organisms that have been around for thousands or millions of years, robots are very new. They are missing out on eons of evolutionary data-building. Animals and humans are born with the ability to do certain things because they are pre-wired in them. Flies know how to fly, fish knows how to swim, cats know how to meow, and babies know how to cry. Yet, flies don’t really learn to fly, fish doesn’t learn to swim, cats don’t learn to meow, and babies don’t learn to cry—they are born able to execute such behaviors because they’re preprogrammed to do so. All that happens thanks to the millions of years of evolutions wired into their respective genomes, which give rise to the brain’s neural networks responsible for these behaviors. Robots are the newbies, missing out on that trove of information, Zador argues.
A neuroscience professor who studies how brain circuitry generates various behaviors, Zador has a different approach to developing the robotic mind. Until their creators figure out a way to imbue the bots with that information, robots will remain quite limited in their abilities. Each model will only be able to do certain things it was programmed to do, but it will never go above and beyond its original code. So Zador argues that we have to start giving robots a genome.
How does one do that? Zador has an idea. We can’t really equip machines with real biological nucleotide-based genes, but we can mimic the neuronal blueprint those genes create. Genomes lay out rules for brain development. Specifically, the genome encodes blueprints for wiring up our nervous system—the details of which neurons are connected, the strength of those connections and other specs that will later hold the information learned throughout life. “Our genomes serve as blueprints for building our nervous system and these blueprints give rise to a human brain, which contains about 100 billion neurons,” Zador says.
If you think what a genome is, he explains, it is essentially a very compact and compressed form of information storage. Conceptually, genomes are similar to CliffsNotes and other study guides. When students read these short summaries, they know about what happened in a book, without actually reading that book. And that’s how we should be designing the next generation of robots if we ever want them to act like humans, Zador says. “We should give them a set of behavioral CliffsNotes, which they can then unwrap into brain-like structures.” Robots that have such brain-like structures will acquire a set of basic rules to generate basic behaviors and use them to learn more complex ones.
Currently Zador is in the process of developing algorithms that function like simple rules that generate such behaviors. “My algorithms would write these CliffsNotes, outlining how to solve a particular problem,” he explains. “And then, the neural networks will use these CliffsNotes to figure out which ones are useful and use them in their behaviors.” That’s how all living beings operate. They use the pre-programmed info from their genetics to adapt to their changing environments and learn what’s necessary to survive and thrive in these settings.
For example, a robot’s neural network could draw from CliffsNotes with “genetic” instructions for how to be aware of its own body or learn to adjust its movements. And other, different sets of CliffsNotes may imbue it with the basics of physical safety or the fundamentals of speech.
At the moment, Zador is working on algorithms that are trying to mimic neuronal blueprints for very simple organisms—such as earthworms, which have only 302 neurons and about 7000 synapses compared to the millions we have. That’s how evolution worked, too—expanding the brains from simple creatures to more complex to the Homo Sapiens. But if it took millions of years to arrive at modern humans, how long would it take scientists to forge a robot with human intelligence? That’s a billion-dollar question. Yet, Zador is optimistic. “My hypotheses is that if you can build simple organisms that can interact with the world, then the higher level functions will not be nearly as challenging as they currently are.”
Sharing land and other resources among farmers isn’t new. But research shows it may be increasingly relevant in a time of climatic upheaval.
Sharing land and other resources among farmers isn’t new. But research shows it may be increasingly relevant in a time of climatic upheaval, potentially influencing “farmers to adopt environmentally friendly practices and agricultural innovation,” according to a 2021 paper in the Journal of Economic Surveys. Farmers might share knowledge about reducing pesticide use, says Heather Frambach, a supply chain consultant who works with farmers in California and elsewhere. As a group they may better qualify for grants to monitor soil and water quality.
Most research around such practices applies to cooperatives, whose owner-members equally share governance and profits. But a collective like Carman Ranch’s — spearheaded by fourth-generation rancher Cory Carman, who purchases beef from eight other ranchers to sell under one “regeneratively” certified brand — shows when producers band together, they can achieve eco-benefits that would be elusive if they worked alone.
Vitamins and minerals in soil pass into plants through their roots, then into cattle as they graze, then back around as the cows walk around pooping.
Carman knows from experience. Taking over her family's land in 2003, she started selling grass-fed beef “because I really wanted to figure out how to not participate in the feedlot world, to have a healthier product. I didn't know how we were going to survive,” she says. Part of her land sits on a degraded portion of Zumwalt Prairie replete with invasive grasses; working to restore it, she thought, “What good does it do to kill myself trying to make this ranch more functional? If you want to make a difference, change has to be more than single entrepreneurs on single pieces of land. It has to happen at a community level.” The seeds of her collective were sown.
Raising 100 percent grass-fed beef requires land that’s got something for cows to graze in every season — which most collective members can’t access individually. So, they move cattle around their various parcels. It’s practical, but it also restores nutrient flows “to the way they used to move, from lowlands and canyons during the winter to higher-up places as the weather gets hot,” Carman says. Meaning, vitamins and minerals in soil pass into plants through their roots, then into cattle as they graze, then back around as the cows walk around pooping.
Cory Carman sells grass-fed beef, which requires land that’s got something for cows to graze in every season.
Courtesy Cory Carman
Each collective member has individual ecological goals: Carman brought in pigs to root out invasive grasses and help natives flourish. Probert also heads a more conventional grain-finished beef collective with 100 members, and their combined 6.5 million ranchland acres were eligible for a grant supporting climate-friendly practices, which compels them to improve soil and water health and biodiversity and make their product “as environmentally friendly as possible,” Probert says. The Washington veg farmer reduced tilling and pesticide use thanks to the ecoservices of visiting cows. Similarly, a conventional hay farmer near Carman has reduced his reliance on fertilizer by letting cattle graze the cover crops he plants on 80 acres.
Additionally, the collective must meet the regenerative standards promised on their label — another way in which they work together to achieve ecological goals. Says David LeZaks, formerly a senior fellow at finance-focused ecology nonprofit Croatan Institute, it’s hard for individual farmers to access monetary assistance. “But it's easier to get financing flowing when you increase the scale with cooperatives or collectives,” he says. “This supports producers in ways that can lead to better outcomes on the landscape.”
New, smaller scale farmers might gain the most from collective and cooperative models.
For example, it can help them minimize waste by using more of an animal, something our frugal ancestors excelled at. Small-scale beef producers normally throw out hides; Thousand Hills’ 50 regenerative beef producers together have enough to sell to Timberland to make carbon-neutral leather. In another example, working collectively resulted in the support of more diverse farms: Meadowlark Community Mill in Wisconsin went from working with one wheat grower, to sourcing from several organic wheat growers marketing flour under one premium brand.
Another example shows how these collaborations can foster greater equity, among other benefits: The Federation of Southern Cooperatives has a mission to support Black farmers as they build community health. It owns several hundred forest acres in Alabama, where it teaches members to steward their own forest land and use it to grow food — one member coop raises goats to graze forest debris and produce milk. Adding the combined acres of member forest land to the Federation’s, the group qualified for a federal conservation grant that will keep this resource available for food production, and community environmental and mental health benefits. “That's the value-add of the collective land-owner structure,” says Dãnia Davy, director of land retention and advocacy.
New, smaller scale farmers might gain the most from collective and cooperative models, says Jordan Treakle, national program coordinator of the National Family Farm Coalition (NFFC). Many of them enter farming specifically to raise healthy food in healthy ways — with organic production, or livestock for soil fertility. With land, equipment and labor prohibitively expensive, farming collectively allows shared costs and risk that buy farmers the time necessary to “build soil fertility and become competitive” in the marketplace, Treakle says. Just keeping them in business is an eco-win; when small farms fail, they tend to get sold for development or absorbed into less-diversified operations, so the effects of their success can “reverberate through the entire local economy.”
Frambach, the supply chain consultant, has been experimenting with what she calls “collaborative crop planning,” where she helps farmers strategize what they’ll plant as a group. “A lot of them grow based on what they hear their neighbor is going to do, and that causes really poor outcomes,” she says. “Nobody replanted cauliflower after the [atmospheric rivers in California] this year and now there's a huge shortage of cauliflower.” A group plan can avoid the under-planting that causes farmers to lose out on revenue.
It helps avoid overplanted crops, too, which small farmers might have to plow under or compost. Larger farmers, conversely, can sell surplus produce into the upcycling market — to Matriark Foods, for example, which turns it into value-add products like pasta sauce for companies like Sysco that supply institutional kitchens at colleges and hospitals. Frambach and Anna Hammond, Matriark’s CEO, want to collectivize smaller farmers so that they can sell to the likes of Matriark and “not lose an incredible amount of income,” Hammond says.
Ultimately, farming is fraught with challenges and even collectivizing doesn’t guarantee that farms will stay in business. But with agriculture accounting for almost 30 percent of greenhouse gas emissions globally, there's an “urgent” need to shift farming practices to more environmentally sustainable models, as well as a “demand in the marketplace for it,” says NFFC’s Treakle. “The growth of cooperative and collective farming can be a huge, huge boon for the ecological integrity of the system.”