Giving robots self-awareness as they move through space - and maybe even providing them with gene-like methods for storing rules of behavior - could be important steps toward creating more intelligent machines.
Now roboticists are going a step further, training their creations to do even better: understand their own image in space and interact with humans like humans do. Today, there are already robot-teachers like KeeKo, robot-pets like Moffin, robot-babysitters like iPal, and robotic companions for the elderly like Pepper.
But even these reasonably intelligent creations still have huge limitations, some scientists think. “There are niche applications for the current generations of robots,” says professor Anthony Zador at Cold Spring Harbor Laboratory—but they are not “generalists” who can do varied tasks all on their own, as they mostly lack the abilities to improvise, make decisions based on a multitude of facts or emotions, and adjust to rapidly changing circumstances. “We don’t have general purpose robots that can interact with the world. We’re ages away from that.”
Robotic spatial self-awareness – the achievement by the team at Columbia – is an important step toward creating more intelligent machines. Hod Lipson, professor of mechanical engineering who runs the Columbia lab, says that future robots will need this ability to assist humans better. Knowing how you look and where in space your parts are, decreases the need for human oversight. It also helps the robot to detect and compensate for damage and keep up with its own wear-and-tear. And it allows robots to realize when something is wrong with them or their parts. “We want our robots to learn and continue to grow their minds and bodies on their own,” Chen says. That’s what Zador wants too—and on a much grander level. “I want a robot who can drive my car, take my dog for a walk and have a conversation with me.”
Columbia scientists have trained a robot to become aware of its own "body," so it can map the right path to touch a ball without running into an obstacle, in this case a square.
Jane Nisselson and Yinuo Qin/ Columbia Engineering
Today’s technological advances are making some of these leaps of progress possible. One of them is the so-called Deep Learning—a method that trains artificial intelligence systems to learn and use information similar to how humans do it. Described as a machine learning method based on neural network architectures with multiple layers of processing units, Deep Learning has been used to successfully teach machines to recognize images, understand speech and even write text.
Trained by Google, one of these language machine learning geniuses, BERT, can finish sentences. Another one called GPT3, designed by San Francisco-based company OpenAI, can write little stories. Yet, both of them still make funny mistakes in their linguistic exercises that even a child wouldn’t. According to a paper published by Stanford’s Center for Research on Foundational Models, BERT seems to not understand the word “not.” When asked to fill in the word after “A robin is a __” it correctly answers “bird.” But try inserting the word “not” into that sentence (“A robin is not a __”) and BERT still completes it the same way. Similarly, in one of its stories, GPT3 wrote that if you mix a spoonful of grape juice into your cranberry juice and drink the concoction, you die. It seems that robots, and artificial intelligence systems in general, are still missing some rudimentary facts of life that humans and animals grasp naturally and effortlessly.
How does one give robots a genome? Zador has an idea. We can’t really equip machines with real biological nucleotide-based genes, but we can mimic the neuronal blueprint those genes create.
It's not exactly the robots’ fault. Compared to humans, and all other organisms that have been around for thousands or millions of years, robots are very new. They are missing out on eons of evolutionary data-building. Animals and humans are born with the ability to do certain things because they are pre-wired in them. Flies know how to fly, fish knows how to swim, cats know how to meow, and babies know how to cry. Yet, flies don’t really learn to fly, fish doesn’t learn to swim, cats don’t learn to meow, and babies don’t learn to cry—they are born able to execute such behaviors because they’re preprogrammed to do so. All that happens thanks to the millions of years of evolutions wired into their respective genomes, which give rise to the brain’s neural networks responsible for these behaviors. Robots are the newbies, missing out on that trove of information, Zador argues.
A neuroscience professor who studies how brain circuitry generates various behaviors, Zador has a different approach to developing the robotic mind. Until their creators figure out a way to imbue the bots with that information, robots will remain quite limited in their abilities. Each model will only be able to do certain things it was programmed to do, but it will never go above and beyond its original code. So Zador argues that we have to start giving robots a genome.
How does one do that? Zador has an idea. We can’t really equip machines with real biological nucleotide-based genes, but we can mimic the neuronal blueprint those genes create. Genomes lay out rules for brain development. Specifically, the genome encodes blueprints for wiring up our nervous system—the details of which neurons are connected, the strength of those connections and other specs that will later hold the information learned throughout life. “Our genomes serve as blueprints for building our nervous system and these blueprints give rise to a human brain, which contains about 100 billion neurons,” Zador says.
If you think what a genome is, he explains, it is essentially a very compact and compressed form of information storage. Conceptually, genomes are similar to CliffsNotes and other study guides. When students read these short summaries, they know about what happened in a book, without actually reading that book. And that’s how we should be designing the next generation of robots if we ever want them to act like humans, Zador says. “We should give them a set of behavioral CliffsNotes, which they can then unwrap into brain-like structures.” Robots that have such brain-like structures will acquire a set of basic rules to generate basic behaviors and use them to learn more complex ones.
Currently Zador is in the process of developing algorithms that function like simple rules that generate such behaviors. “My algorithms would write these CliffsNotes, outlining how to solve a particular problem,” he explains. “And then, the neural networks will use these CliffsNotes to figure out which ones are useful and use them in their behaviors.” That’s how all living beings operate. They use the pre-programmed info from their genetics to adapt to their changing environments and learn what’s necessary to survive and thrive in these settings.
For example, a robot’s neural network could draw from CliffsNotes with “genetic” instructions for how to be aware of its own body or learn to adjust its movements. And other, different sets of CliffsNotes may imbue it with the basics of physical safety or the fundamentals of speech.
At the moment, Zador is working on algorithms that are trying to mimic neuronal blueprints for very simple organisms—such as earthworms, which have only 302 neurons and about 7000 synapses compared to the millions we have. That’s how evolution worked, too—expanding the brains from simple creatures to more complex to the Homo Sapiens. But if it took millions of years to arrive at modern humans, how long would it take scientists to forge a robot with human intelligence? That’s a billion-dollar question. Yet, Zador is optimistic. “My hypotheses is that if you can build simple organisms that can interact with the world, then the higher level functions will not be nearly as challenging as they currently are.”
The U.S. population is becoming more diverse, but clinical trials don't reflect that, experts say. Some are focusing on recruiting minorities to participate in research.
While racial and ethnic minority groups represent almost half of the U.S. population, the lack of diversity in clinical trials poses serious challenges. Limited awareness and access impede equitable representation, which is necessary to prove the safety and effectiveness of medical interventions across different groups.
A Yale University study on clinical trial diversity published last year in BMJ Medicine found that while 81 percent of trials testing the new cancer drugs approved by the U.S. Food and Drug Administration between 2012 and 2017 included women, only 23 percent included older adults and 5 percent fairly included racial and ethnic minorities. “It’s both a public health and social justice issue,” said Jennifer E. Miller, an associate professor of medicine at Yale School of Medicine. “We need to know how medicines and vaccines work for all clinically distinct groups, not just healthy young White males.” A recent JAMA Oncology editorial stresses out the need for legislation that would require diversity action plans for certain types of trials.
Ensuring meaningful representation of racial and ethnic minorities in clinical trials for regulated medical products is fundamental to public health.--FDA Commissioner Robert M. Califf.
But change is on the horizon. Last April, the FDA issued a new draft guidance encouraging industry to find ways to revamp recruitment into clinical trials. The announcement, which expanded on previous efforts, called for including more participants from underrepresented racial and ethnic segments of the population.
“The U.S. population has become increasingly diverse, and ensuring meaningful representation of racial and ethnic minorities in clinical trials for regulated medical products is fundamental to public health,” FDA commissioner Robert M. Califf, a physician, said in a statement. “Going forward, achieving greater diversity will be a key focus throughout the FDA to facilitate the development of better treatments and better ways to fight diseases that often disproportionately impact diverse communities. This guidance also further demonstrates how we support the Administration’s Cancer Moonshot goal of addressing inequities in cancer care, helping to ensure that every community in America has access to cutting-edge cancer diagnostics, therapeutics and clinical trials.”
Lola Fashoyin-Aje, associate director for Science and Policy to Address Disparities in the Oncology Center of Excellence at the FDA, said that the agency “has long held the view that clinical trial participants should reflect the clinical and demographic characteristics of the patients who will ultimately receive the drug once approved.” However, “numerous studies over many decades” have measured the extent of underrepresentation. One FDA analysis found that the proportion of White patients enrolled in U.S. clinical trials (88 percent) is much higher than their numbers in country's population. Meanwhile, the enrollment of African American and Native Hawaiian/American Indian and Alaskan Native patients is below their national numbers.
The FDA’s guidance is accelerating researchers’ efforts to be more inclusive of diverse groups in clinical trials, said Joyce Sackey, a clinical professor of medicine and associate dean at Stanford School of Medicine. Underrepresentation is “a huge issue,” she noted. Sackey is focusing on this in her role as the inaugural chief equity, diversity and inclusion officer at Stanford Medicine, which encompasses the medical school and two hospitals.
Until the early 1990s, Sackey pointed out, clinical trials were based on research that mainly included men, as investigators were concerned that women could become pregnant, which would affect the results. This has led to some unfortunate consequences, such as indications and dosages for drugs that cause more side effects in women due to biological differences. “We’ve made some progress in including women, but we have a long way to go in including people of different ethnic and racial groups,” she said.
A new mural outside Guadalupe Centers Middle School in Kansas City, Missouri, advocates for increasing diversity in clinical trials. Kim Jones, 51-year-old African American breast cancer survivor, is second on the left.
Artwork by Vania Soto. Photo by Megan Peters.
Among racial and ethnic minorities, distrust of clinical trials is deeply rooted in a history of medical racism. A prime example is the Tuskegee Study, a syphilis research experiment that started in 1932 and spanned 40 years, involving hundreds of Black men with low incomes without their informed consent. They were lured with inducements of free meals, health care and burial stipends to participate in the study undertaken by the U.S. Public Health Service and the Tuskegee Institute in Alabama.
By 1947, scientists had figured out that they could provide penicillin to help patients with syphilis, but leaders of the Tuskegee research failed to offer penicillin to their participants throughout the rest of the study, which lasted until 1972.
Opeyemi Olabisi, an assistant professor of medicine at Duke University Medical Center, aims to increase the participation of African Americans in clinical research. As a nephrologist and researcher, he is the principal investigator of a clinical trial focusing on the high rate of kidney disease fueled by two genetic variants of the apolipoprotein L1 (APOL1) gene in people of recent African ancestry. Individuals of this background are four times more likely to develop kidney failure than European Americans, with these two variants accounting for much of the excess risk, Olabisi noted.
The trial is part of an initiative, CARE and JUSTICE for APOL1-Mediated Kidney Disease, through which Olabisi hopes to diversify study participants. “We seek ways to engage African Americans by meeting folks in the community, providing accessible information and addressing structural hindrances that prevent them from participating in clinical trials,” Olabisi said. The researchers go to churches and community organizations to enroll people who do not visit academic medical centers, which typically lead clinical trials. Since last fall, the initiative has screened more than 250 African Americans in North Carolina for the genetic variants, he said.
Other key efforts are underway. “Breaking down barriers, including addressing access, awareness, discrimination and racism, and workforce diversity, are pivotal to increasing clinical trial participation in racial and ethnic minority groups,” said Joshua J. Joseph, assistant professor of medicine at the Ohio State University Wexner Medical Center. Along with the university’s colleges of medicine and nursing, researchers at the medical center partnered with the African American Male Wellness Agency, Genentech and Pfizer to host webinars soliciting solutions from almost 450 community members, civic representatives, health care providers, government organizations and biotechnology professionals in 25 states and five countries.
Their findings, published in February in the journal PLOS One, suggested that including incentives or compensation as part of the research budget at the institutional level may help resolve some issues that hinder racial and ethnic minorities from participating in clinical trials. Compared to other groups, more Blacks and Hispanics have jobs in service, production and transportation, the authors note. It can be difficult to get paid leave in these sectors, so employees often can’t join clinical trials during regular business hours. If more leaders of trials offer money for participating, that could make a difference.
Obstacles include geographic access, language and other communications issues, limited awareness of research options, cost and lack of trust.
Christopher Corsico, senior vice president of development at GSK, formerly GlaxoSmithKline, said the pharmaceutical company conducted a 17-year retrospective study on U.S. clinical trial diversity. “We are using epidemiology and patients most impacted by a particular disease as the foundation for all our enrollment guidance, including study diversity plans,” Corsico said. “We are also sharing our results and ideas across the pharmaceutical industry.”
Judy Sewards, vice president and head of clinical trial experience at Pfizer’s headquarters in New York, said the company has committed to achieving racially and ethnically diverse participation at or above U.S. census or disease prevalence levels (as appropriate) in all trials. “Today, barriers to clinical trial participation persist,” Sewards said. She noted that these obstacles include geographic access, language and other communications issues, limited awareness of research options, cost and lack of trust. “Addressing these challenges takes a village. All stakeholders must come together and work collaboratively to increase diversity in clinical trials.”
It takes a village indeed. Hope Krebill, executive director of the Masonic Cancer Alliance, the outreach network of the University of Kansas Cancer Center in Kansas City, which commissioned the mural, understood that well. So her team actively worked with their metaphorical “village.” “We partnered with the community to understand their concerns, knowledge and attitudes toward clinical trials and research,” said Krebill. “With that information, we created a clinical trials video and a social media campaign, and finally, the mural to encourage people to consider clinical trials as an option for care.”
Besides its encouraging imagery, the mural will also be informational. It will include a QR code that viewers can scan to find relevant clinical trials in their location, said Vania Soto, a Mexican artist who completed the rendition in late February. “I’m so honored to paint people that are survivors and are living proof that clinical trials worked for them,” she said.
Jones, the cancer survivor depicted in the mural, hopes the image will prompt people to feel more open to partaking in clinical trials. “Hopefully, it will encourage people to inquire about what they can do — how they can participate,” she said.