The U.S. population is becoming more diverse, but clinical trials don't reflect that, experts say. Some are focusing on recruiting minorities to participate in research.
Nestled in a predominately Hispanic neighborhood, a new mural outside Guadalupe Centers Middle School in Kansas City, Missouri imparts a powerful message: “Clinical Research Needs Representation.” The colorful portraits painted above those words feature four cancer survivors of different racial and ethnic backgrounds. Two individuals identify as Hispanic, one as African American and another as Native American.
One of the patients depicted in the mural is Kim Jones, a 51-year-old African American breast cancer survivor since 2012. She advocated for an African American friend who participated in several clinical trials for ovarian cancer. Her friend was diagnosed in an advanced stage at age 26 but lived nine more years, thanks to the trials testing new therapeutics. “They are definitely giving people a longer, extended life and a better quality of life,” said Jones, who owns a nail salon. And that’s the message the mural aims to send to the community: Clinical trials need diverse participants.
While racial and ethnic minority groups represent almost half of the U.S. population, the lack of diversity in clinical trials poses serious challenges. Limited awareness and access impede equitable representation, which is necessary to prove the safety and effectiveness of medical interventions across different groups.
A Yale University study on clinical trial diversity published last year in BMJ Medicine found that while 81 percent of trials testing the new cancer drugs approved by the U.S. Food and Drug Administration between 2012 and 2017 included women, only 23 percent included older adults and 5 percent fairly included racial and ethnic minorities. “It’s both a public health and social justice issue,” said Jennifer E. Miller, an associate professor of medicine at Yale School of Medicine. “We need to know how medicines and vaccines work for all clinically distinct groups, not just healthy young White males.” A recent JAMA Oncology editorial stresses out the need for legislation that would require diversity action plans for certain types of trials.
Ensuring meaningful representation of racial and ethnic minorities in clinical trials for regulated medical products is fundamental to public health.--FDA Commissioner Robert M. Califf.
But change is on the horizon. Last April, the FDA issued a new draft guidance encouraging industry to find ways to revamp recruitment into clinical trials. The announcement, which expanded on previous efforts, called for including more participants from underrepresented racial and ethnic segments of the population.
“The U.S. population has become increasingly diverse, and ensuring meaningful representation of racial and ethnic minorities in clinical trials for regulated medical products is fundamental to public health,” FDA commissioner Robert M. Califf, a physician, said in a statement. “Going forward, achieving greater diversity will be a key focus throughout the FDA to facilitate the development of better treatments and better ways to fight diseases that often disproportionately impact diverse communities. This guidance also further demonstrates how we support the Administration’s Cancer Moonshot goal of addressing inequities in cancer care, helping to ensure that every community in America has access to cutting-edge cancer diagnostics, therapeutics and clinical trials.”
Lola Fashoyin-Aje, associate director for Science and Policy to Address Disparities in the Oncology Center of Excellence at the FDA, said that the agency “has long held the view that clinical trial participants should reflect the clinical and demographic characteristics of the patients who will ultimately receive the drug once approved.” However, “numerous studies over many decades” have measured the extent of underrepresentation. One FDA analysis found that the proportion of White patients enrolled in U.S. clinical trials (88 percent) is much higher than their numbers in country's population. Meanwhile, the enrollment of African American and Native Hawaiian/American Indian and Alaskan Native patients is below their national numbers.
The FDA’s guidance is accelerating researchers’ efforts to be more inclusive of diverse groups in clinical trials, said Joyce Sackey, a clinical professor of medicine and associate dean at Stanford School of Medicine. Underrepresentation is “a huge issue,” she noted. Sackey is focusing on this in her role as the inaugural chief equity, diversity and inclusion officer at Stanford Medicine, which encompasses the medical school and two hospitals.
Until the early 1990s, Sackey pointed out, clinical trials were based on research that mainly included men, as investigators were concerned that women could become pregnant, which would affect the results. This has led to some unfortunate consequences, such as indications and dosages for drugs that cause more side effects in women due to biological differences. “We’ve made some progress in including women, but we have a long way to go in including people of different ethnic and racial groups,” she said.
A new mural outside Guadalupe Centers Middle School in Kansas City, Missouri, advocates for increasing diversity in clinical trials. Kim Jones, 51-year-old African American breast cancer survivor, is second on the left.
Artwork by Vania Soto. Photo by Megan Peters.
Among racial and ethnic minorities, distrust of clinical trials is deeply rooted in a history of medical racism. A prime example is the Tuskegee Study, a syphilis research experiment that started in 1932 and spanned 40 years, involving hundreds of Black men with low incomes without their informed consent. They were lured with inducements of free meals, health care and burial stipends to participate in the study undertaken by the U.S. Public Health Service and the Tuskegee Institute in Alabama.
By 1947, scientists had figured out that they could provide penicillin to help patients with syphilis, but leaders of the Tuskegee research failed to offer penicillin to their participants throughout the rest of the study, which lasted until 1972.
Opeyemi Olabisi, an assistant professor of medicine at Duke University Medical Center, aims to increase the participation of African Americans in clinical research. As a nephrologist and researcher, he is the principal investigator of a clinical trial focusing on the high rate of kidney disease fueled by two genetic variants of the apolipoprotein L1 (APOL1) gene in people of recent African ancestry. Individuals of this background are four times more likely to develop kidney failure than European Americans, with these two variants accounting for much of the excess risk, Olabisi noted.
The trial is part of an initiative, CARE and JUSTICE for APOL1-Mediated Kidney Disease, through which Olabisi hopes to diversify study participants. “We seek ways to engage African Americans by meeting folks in the community, providing accessible information and addressing structural hindrances that prevent them from participating in clinical trials,” Olabisi said. The researchers go to churches and community organizations to enroll people who do not visit academic medical centers, which typically lead clinical trials. Since last fall, the initiative has screened more than 250 African Americans in North Carolina for the genetic variants, he said.
Other key efforts are underway. “Breaking down barriers, including addressing access, awareness, discrimination and racism, and workforce diversity, are pivotal to increasing clinical trial participation in racial and ethnic minority groups,” said Joshua J. Joseph, assistant professor of medicine at the Ohio State University Wexner Medical Center. Along with the university’s colleges of medicine and nursing, researchers at the medical center partnered with the African American Male Wellness Agency, Genentech and Pfizer to host webinars soliciting solutions from almost 450 community members, civic representatives, health care providers, government organizations and biotechnology professionals in 25 states and five countries.
Their findings, published in February in the journal PLOS One, suggested that including incentives or compensation as part of the research budget at the institutional level may help resolve some issues that hinder racial and ethnic minorities from participating in clinical trials. Compared to other groups, more Blacks and Hispanics have jobs in service, production and transportation, the authors note. It can be difficult to get paid leave in these sectors, so employees often can’t join clinical trials during regular business hours. If more leaders of trials offer money for participating, that could make a difference.
Obstacles include geographic access, language and other communications issues, limited awareness of research options, cost and lack of trust.
Christopher Corsico, senior vice president of development at GSK, formerly GlaxoSmithKline, said the pharmaceutical company conducted a 17-year retrospective study on U.S. clinical trial diversity. “We are using epidemiology and patients most impacted by a particular disease as the foundation for all our enrollment guidance, including study diversity plans,” Corsico said. “We are also sharing our results and ideas across the pharmaceutical industry.”
Judy Sewards, vice president and head of clinical trial experience at Pfizer’s headquarters in New York, said the company has committed to achieving racially and ethnically diverse participation at or above U.S. census or disease prevalence levels (as appropriate) in all trials. “Today, barriers to clinical trial participation persist,” Sewards said. She noted that these obstacles include geographic access, language and other communications issues, limited awareness of research options, cost and lack of trust. “Addressing these challenges takes a village. All stakeholders must come together and work collaboratively to increase diversity in clinical trials.”
It takes a village indeed. Hope Krebill, executive director of the Masonic Cancer Alliance, the outreach network of the University of Kansas Cancer Center in Kansas City, which commissioned the mural, understood that well. So her team actively worked with their metaphorical “village.” “We partnered with the community to understand their concerns, knowledge and attitudes toward clinical trials and research,” said Krebill. “With that information, we created a clinical trials video and a social media campaign, and finally, the mural to encourage people to consider clinical trials as an option for care.”
Besides its encouraging imagery, the mural will also be informational. It will include a QR code that viewers can scan to find relevant clinical trials in their location, said Vania Soto, a Mexican artist who completed the rendition in late February. “I’m so honored to paint people that are survivors and are living proof that clinical trials worked for them,” she said.
Jones, the cancer survivor depicted in the mural, hopes the image will prompt people to feel more open to partaking in clinical trials. “Hopefully, it will encourage people to inquire about what they can do — how they can participate,” she said.
A chatbot from the nonprofit National Eating Disorders Association aimed to provide 24/7 guidance on eating disorders. Several drawbacks point to the importance of therapist-tech collaboration in multiple areas of health.
Then everything went off the rails. Tessa told Maxwell an unequivocal yes, and that “it’s important to approach weight loss with a balanced and realistic mindset,” and recommended eating whole foods and lean proteins to create a 500-1000 calorie per day deficit that would lead to a loss of 1-2 pounds per week. To most people, the advice sounds anodyne, but alarm bells sounded in Maxwell’s head.
“This is actively going to feed eating disorders,” Maxwell says. “Having a chatbot be the direct response to someone reaching out for support for an eating disorder instead of the helpline seems careless.”
“The scripts that are being fed into the chatbot are only going to be as good as the person who’s feeding them.” -- Alexis Conason.
According to several decades of research, deliberate weight loss in the form of dieting is a serious risk for people with eating disorders. Maxwell says that following medical advice like what Tessa prescribed was what triggered her eating disorder as a child. And Maxwell wasn’t the only one who got such advice from the bot. When eating disorder therapist Alexis Conason tried Tessa, she asked the AI chatbot many of the questions her patients had. But instead of getting connected to resources or guidance on recovery, Conason, too, got tips on losing weight and “healthy” eating.
“The scripts that are being fed into the chatbot are only going to be as good as the person who’s feeding them,” Conason says. “It’s important that an eating disorder organization like NEDA is not reinforcing that same kind of harmful advice that we might get from medical providers who are less knowledgeable.”
Maxwell’s post about Tessa on Instagram went viral, and within days, NEDA had scrubbed all evidence of Tessa from its website. The furor has raised any number of issues about the harm perpetuated by a leading eating disorder charity and the ongoing influence of diet culture and advice that is pervasive in the field. But for AI experts, bears and bulls alike, Tessa offers a cautionary tale about what happens when a still-immature technology is unfettered and released into a vulnerable population.
Given the complexity involved in giving medical advice, the process of developing these chatbots must be rigorous and transparent, unlike NEDA’s approach.
“We don’t have a full understanding of what’s going on in these models. They’re a black box,” says Stephen Schueller, a clinical psychologist at the University of California, Irvine.
The health crisis
In March 2020, the world dove head-first into a heavily virtual world as countries scrambled to try and halt the pandemic. Even with lockdowns, hospitals were overwhelmed by the virus. The downstream effects of these lifesaving measures are still being felt, especially in mental health. Anxiety and depression are at all-time highs in teens, and a new report in The Lancet showed that post-Covid rates of newly diagnosed eating disorders in girls aged 13-16 were 42.4 percent higher than previous years.
And the crisis isn’t just in mental health.
“People are so desperate for health care advice that they'll actually go online and post pictures of [their intimate areas] and ask what kind of STD they have on public social media,” says John Ayers, an epidemiologist at the University of California, San Diego.
For many people, the choice isn’t chatbot vs. well-trained physician, but chatbot vs. nothing at all.
I know a bit about that desperation. Like Maxwell, I have struggled with a multi-decade eating disorder. I spent my 20s and 30s bouncing from crisis to crisis. I have called suicide hotlines, gone to emergency rooms, and spent weeks-on-end confined to hospital wards. Though I have found recovery in recent years, I’m still not sure what ultimately made the difference. A relapse isn't improbably, given my history. Even if I relapsed again, though, I don’t know it would occur to me to ask an AI system for help.
For one, I am privileged to have assembled a stellar group of outpatient professionals who know me, know what trips me up, and know how to respond to my frantic texts. Ditto for my close friends. What I often need is a shoulder to cry on or a place to vent—someone to hear and validate my distress. What’s more, my trust in these individuals far exceeds my confidence in the companies that create these chatbots. The Internet is full of health advice, much of it bad. Even for high-quality, evidence-based advice, medicine is often filled with disagreements about how the evidence might be applied and for whom it’s relevant. All of this is key in the training of AI systems like ChatGPT, and many AI companies remain silent on this process, Schueller says.
The problem, Ayers points out, is that for many people, the choice isn’t chatbot vs. well-trained physician, but chatbot vs. nothing at all. Hence the proliferation of “does this infection make my scrotum look strange?” questions. Where AI can truly shine, he says, is not by providing direct psychological help but by pointing people towards existing resources that we already know are effective.
“It’s important that these chatbots connect [their users to] to provide that human touch, to link you to resources,” Ayers says. “That’s where AI can actually save a life.”
Before building a chatbot and releasing it, developers need to pause and consult with the communities they hope to serve.
Unfortunately, many systems don’t do this. In a study published last month in the Journal of the American Medical Association, Ayers and colleagues found that although the chatbots did well at providing evidence-based answers, they often didn’t provide referrals to existing resources. Despite this, in an April 2023 study, Ayers’s team found that both patients and professionals rated the quality of the AI responses to questions, measured by both accuracy and empathy, rather highly. To Ayers, this means that AI developers should focus more on the quality of the information being delivered rather than the method of delivery itself.
Many mental health professionals have months-long waitlists, which leaves individuals to deal with illnesses on their own.
Adobe Stock
The human touch
The mental health field is facing timing constraints, too. Even before the pandemic, the U.S. suffered from a shortage of mental health providers. Since then, the rates of anxiety, depression, and eating disorders have spiked even higher, and many mental health professionals report waiting lists that are months long. Without support, individuals are left to try and cope on their own, which often means their condition deteriorates even further.
Nor do mental health crises happen during office hours. I struggled the most late at night, long after everyone else had gone to bed. I needed support during those times when I was most liable to hurt myself, not in the mornings and afternoons when I was at work.
In this sense, a 24/7 chatbot makes lots of sense. “I don't think we should stifle innovation in this space,” Schueller says. “Because if there was any system that needs to be innovated, it's mental health services, because they are sadly insufficient. They’re terrible.”
But before building a chatbot and releasing it, Tina Hernandez-Boussard, a data scientist at Stanford Medicine, says that developers need to pause and consult with the communities they hope to serve. It requires a deep understanding of what their needs are, the language they use to describe their concerns, existing resources, and what kinds of topics and suggestions aren’t helpful. Even asking a simple question at the beginning of a conversation such as “Do you want to talk to an AI or a human?” could allow those individuals to pick the type of interaction that suits their needs, Hernandez-Boussard says.
NEDA did none of these things before deploying Tessa. The researchers who developed the online body positivity self-help program upon which Tessa was initially based created a set of online question-and-answer exercises to improve body image. It didn’t involve generative AI that could write its own answers. The bot deployed by NEDA did use generative AI, something that no one in the eating disorder community was aware of before Tessa was brought online. Consulting those with lived experience would have flagged Tessa’s weight loss and “healthy eating” recommendations, Conason says.
The question for healthcare isn’t whether to use AI, but how.
NEDA did not comment on initial Tessa’s development and deployment, but a spokesperson told Leaps.org that “Tessa will be back online once we are confident that the program will be run with the rule-based approach as it was designed.”
The tech and therapist collaboration
The question for healthcare isn’t whether to use AI, but how. Already, AI can spot anomalies on medical images with greater precision than human eyes and can flag specific areas of an image for a radiologist to review in greater detail. Similarly, in mental health, AI should be an add-on for therapy, not a counselor-in-a-box, says Aniket Bera, an expert on AI and mental health at Purdue University.
“If [AIs] are going to be good helpers, then we need to understand humans better,” Bera says. That means understanding what patients and therapists alike need help with and respond to.
One of the biggest challenges of struggling with chronic illness is the dehumanization that happens. You become a patient number, a set of laboratory values and test scores. Treatment is often dictated by invisible algorithms and rules that you have no control over or access to. It’s frightening and maddening. But this doesn’t mean chatbots don’t have any place in medicine and mental health. An AI system could help provide appointment reminders and answer procedural questions about parking and whether someone should fast before a test or a procedure. They can help manage billing and even provide support between outpatient sessions by offering suggestions for what coping skills to use, the best ways to manage anxiety, and point to local resources. As the bots get better, they may eventually shoulder more and more of the burden of providing mental health care. But as Maxwell learned with Tessa, it’s still no replacement for human interaction.
“I'm not suggesting we should go in and start replacing therapists with technologies,” Schueller says. Instead, he advocates for a therapist-tech collaboration. “The technology side and the human component—these things need to come together.”
