Can Radical Transparency Overcome Resistance to COVID-19 Vaccines?
Secretive panels of independent experts called Data Safety and Monitoring Boards examine clinical trials' data for safety and efficacy.
When historians look back on the COVID-19 pandemic, they may mark November 9, 2020 as the day the tide began to turn. That's when the New York-based pharmaceutical giant Pfizer announced that clinical trials showed its experimental vaccine, developed with the German firm BioNTech, to be 90 percent effective in preventing the disease.
A week later, Massachusetts biotech startup Moderna declared its vaccine to be 95 percent effective. By early December, Great Britain had begun mass inoculations, followed—once the Food and Drug Administration gave the thumbs-up—by the United States. In this scenario, the worst global health crisis in a century was on the cusp of resolution.
Yet future chroniclers may instead peg November 9 as the day false hope dawned. That could happen if serious safety issues, undetected so far, arise after millions of doses are administered. Experts consider it unlikely, however, that such problems alone (as opposed to the panic they might spark) would affect enough people to thwart a victory over the coronavirus. A more immediate obstacle is vaccine hesitancy—the prospect that much of the populace will refuse to roll up their sleeves.
To achieve "herd immunity" for COVID-19 (the point at which a vaccine reduces transmission rates enough to protect those who can't or won't take it, or for whom it doesn't work), epidemiologists estimate that up to 85 percent of the population will have to be vaccinated. Alarmingly, polls suggest that 40 to 50 percent of Americans intend to decline, judging the risks to be more worrisome than those posed by the coronavirus itself.
COVID vaccine skeptics occupy various positions on a spectrum of doubt. Some are committed anti-vaxxers, or devotees of conspiracy theories that view the pandemic as a hoax. Others belong to minority groups that have historically been used as guinea pigs in unethical medical research (for horrific examples, Google "Tuskegee syphilis experiment" or "Henrietta Lacks"). Still others simply mistrust Big Pharma and/or Big Government. A common fear is that the scramble to find a vaccine—intensified by partisan and profit motives—has led to corner-cutting in the testing and approval process. "They really rushed," an Iowa trucker told The Washington Post. "I'll probably wait a couple of months after they start to see how everyone else is handling it."
The COVID crisis has spurred calls for secretive Data Safety and Monitoring Boards to come out of the shadows.
The consensus among scientists, by contrast, is that the process has been rigorous enough, given the exigency of the situation, that the public can feel reasonably confident in any vaccine that has earned the imprimatur of the FDA. For those of us who share that assessment, finding ways to reassure the hesitant-but-persuadable is an urgent matter.
Vax-positive public health messaging is one obvious tactic, but a growing number of experts say it's not enough. They prescribe a regimen of radical transparency throughout the system that regulates research—in particular, regarding the secretive panels that oversee vaccine trials.
The Crucial Role of the Little-Known Panels
Like other large clinical trials involving potentially high-demand or controversial products, studies of COVID-19 vaccines in most countries are supervised by groups of independent observers. Known in the United States as data safety and monitoring boards (DSMBs), and elsewhere as data monitoring committees, these panels consist of scientists, clinicians, statisticians, and other authorities with no ties to the sponsor of the study.
The six trials funded by the federal program known as Operation Warp Speed (including those of newly approved Moderna and frontrunner AstraZeneca) share a DSMB, whose members are selected by the National Institutes of Health; other companies (including Pfizer) appoint their own. The panel's job is to monitor the safety and efficacy of a treatment while the trial is ongoing, and to ensure that data is being collected and analyzed correctly.
Vaccine studies are "double-blinded," which means neither the participants nor the doctors running the trial know who's getting the real thing and who's getting a placebo. But the DSMB can access that information if a study volunteer has what might be a serious side effect—and if the participant was in the vaccine group, the board can ask that the trial be paused for further investigation.
The DSMB also checks for efficacy at pre-determined intervals. If it finds that the vaccine group and the placebo group are getting sick at similar rates, the panel can recommend stopping the trial due to "futility." And if the results look overwhelmingly positive, the DSMB can recommend that the study sponsor apply for FDA approval before the scheduled end of the trial, in order to hurry the product to market.
With this kind of inside dope and high-level influence, DSMBs could easily become targets for outside pressure. That's why, since the 1980s, their membership has typically been kept secret.
During the early days of the AIDS crisis, researchers working on HIV drugs feared for the safety of the experts on their boards. "They didn't want them to be besieged and harassed by members of the community," explains Susan Ellenberg, a professor of biostatistics, medical ethics and health policy at the University of Pennsylvania, and co-author of Data Monitoring Committees in Clinical Trials, the DSMB bible. "You can understand why people would very much want to know how things were looking in a given trial. They wanted to save their own lives; they wanted to save their friends' lives." Ellenberg, who was founding director of the biostatistics branch of the AIDS division at the National Institute of Allergy and Infectious Diseases (NIAID), helped shape a range of policies designed to ensure that DSMBs made decisions based on data and nothing else.
Confidentiality also shields DSMB members from badgering by patient advocacy groups, who might urge that a drug be presented for approval before trial results are conclusive, or by profit-hungry investors. "It prevents people from trying to pry out information to get an edge in the stock market," says Art Caplan, a bioethicist at New York University.
Yet the COVID crisis has spurred calls for DSMBs to come out of the shadows. One triggering event came in March 2020, when the FDA approved hydroxychloroquine for COVID-19—a therapy that President Donald J. Trump touted, despite scant evidence for its efficacy. (Approval was rescinded in June.) If the agency could bow to political pressure on these medications, critics warned, it might do so with vaccines as well. In the end, that didn't happen; the Pfizer approval was issued well after Election Day, despite Trump's goading, and most experts agree that it was based on solid science. Still, public suspicion lingers.
Another shock came in September, after British-based AstraZeneca announced it was pausing its vaccine trial globally due to a "suspected adverse rection" in a volunteer. The company shared no details with the press. Instead, AstraZeneca's CEO divulged them in a private call with J.P. Morgan investors the next day, confirming that the volunteer was suffering from transverse myelitis, a rare and serious spinal inflammation—and that the study had also been halted in July, when another volunteer displayed neurological symptoms. STAT News broke the story after talking to tipsters.
Although both illnesses were found to be unrelated to the vaccine, and the trial was restarted, the incident had a paradoxical effect: while it confirmed for experts that the oversight system was working, AstraZeneca's initial lack of candor added to many laypeople's sense that it wasn't. "If you were seeking to undermine trust, that's kind of how you would go about doing it," says Charles Weijer, a bioethicist at Western University in Ontario, who has helped develop clinical trial guidelines for the World Health Organization.
Both Caplan and Weijer have served on many DSMBs; they believe the boards are generally trustworthy, and that those overseeing COVID vaccine trials are performing their jobs well. But the secrecy surrounding these groups, they and others argue, has become counterproductive. Shining a light on the statistical sausage-makers would help dispel doubts about the finished product.
"I'm not suggesting that any of these companies are doing things unethically," Weijer explains. "But the circumstances of a global pandemic are sufficiently challenging that perhaps they ought to be doing some things differently. I believe it would be trust-producing for data monitoring committees to be more forthcoming than usual."
Building Trust: More Transparency
Just how forthcoming is a matter of debate. Caplan suggests that each COVID vaccine DSMB reveal the name of its chair; that would enable the scientific community, as well as the media and the general public, to get a sense of the integrity and qualifications of the board as a whole while preserving the anonymity of the other members.
Indeed, when Operation Warp Speed's DSMB chair, Richard Whitley, was outed through a website slip-up, many observers applauded his selection for the role; a professor of pediatrics, microbiology, medicine and neurosurgery at the University of Alabama at Birmingham, he is "an exceptionally experienced and qualified individual," Weijer says. (Reporters with ProPublica later identified two other members: Susan Ellenberg and immunologist William Makgoba, known for his work on the South African AIDS Vaccine Initiative.)
Caplan would also like to see more details of the protocols DSMBs are using to make decisions, such as the statistical threshold for efficacy that would lead them to seek approval from the FDA. And he wishes the NIH would spell out specific responsibilities for these monitoring boards. "They don't really have clear, government-mandated charters," he notes. For example, there's no requirement that DSMBs include an ethicist or patient advocate—both of which Caplan considers essential for vaccine trials. "Rough guidelines," he says, "would be useful."
Weijer, for his part, thinks DSMBs should disclose all their members. "When you only disclose the chair, you leave questions unanswered," he says. "What expertise do [the others] bring to the table? Are they similarly free of relevant conflicts of interest? And it doesn't answer the question that will be foremost on many people's minds: are these people in the pocket of pharma?"
Weijer and Caplan both want to see greater transparency around the trial results themselves. Because the FDA approved the Pfizer and Moderna vaccines with emergency use authorizations rather than full licensure, which requires more extensive safety testing, these products reached the market without the usual paper trail of peer-reviewed publications. The same will likely be true of any future COVID vaccines that the agency greenlights. To add another level of scrutiny, both ethicists suggest, each company should publicly release its data at the end of a trial. "That offers the potential for academic groups to go in and do an analysis," Weijer explains, "to verify the claims about the safety and efficacy of the vaccine." The point, he says, is not only to ensure that the approval was justified, but to provide evidence to counter skeptics' qualms.
Caplan may differ on some of the details, but he endorses the premise. "It's all a matter of trust," he says. "You're always watching that, because a vaccine is only as good as the number of people who take it."
Questions remain about new drug for hot flashes
In May, a new drug, Fezolinetant, was approved by the FDA to treat hot flashes associated with menopause.
Vascomotor symptoms (VMS) is the medical term for hot flashes associated with menopause. You are going to hear a lot more about it because a company has a new drug to sell. Here is what you need to know.
Menopause marks the end of a woman’s reproductive capacity. Normal hormonal production associated with that monthly cycle becomes erratic and finally ceases. For some women the transition can be relatively brief with only modest symptoms, while for others the body's “thermostat” in the brain is disrupted and they experience hot flashes and other symptoms that can disrupt daily activity. Lifestyle modification and drugs such as hormone therapy can provide some relief, but women at risk for cancer are advised not to use them and other women choose not to do so.
Fezolinetant, sold by Astellas Pharma Inc. under the product name Veozah™, was approved by the Food and Drug Administration (FDA) on May 12 to treat hot flashes associated with menopause. It is the first in a new class of drugs called neurokinin 3 receptor antagonists, which block specific neurons in the brain “thermostat” that trigger VMS. It does not appear to affect other symptoms of menopause. As with many drugs targeting a brain cell receptor, it must be taken continuously for a few days to build up a good therapeutic response, rather than working as a rescue product such as an asthma inhaler to immediately treat that condition.
Hot flashes vary greatly and naturally get better or resolve completely with time. That contributes to a placebo effect and makes it more difficult to judge the outcome of any intervention. Early this year, a meta analysis of 17 studies of drug trials for hot flashes found an unusually large placebo response in those types of studies; the placebo groups had an average of 5.44 fewer hot flashes and a 36 percent reduction in their severity.
In studies of fezolinetant, the drug recently approved by the FDA, the placebo benefit was strong and persistent. The drug group bested the placebo response to a statistically significant degree but, “If people have gone from 11 hot flashes a day to eight or seven in the placebo group and down to a couple fewer ones in the drug groups, how meaningful is that? Having six hot flashes a day is still pretty unpleasant,” says Diana Zuckerman, president of the National Center for Health Research (NCHR), a health oriented think tank.
“Is a reduction compared to placebo of 2-3 hot flashes per day, in a population of women experiencing 10-11 moderate to severe hot flashes daily, enough relief to be clinically meaningful?” Andrea LaCroix asked a commentary published in Nature Medicine. She is an epidemiologist at the University of California San Diego and a leader of the MsFlash network that has conducted a handful of NIH-funded studies on menopause.
Questions Remain
LaCroix and others have raised questions about how Astellas, the company that makes the new drug, handled missing data from patients who dropped out of the clinical trials. “The lack of detailed information about important parameters such as adherence and missing data raises concerns that the reported benefits of fezolinetant very likely overestimate those that will be observed in clinical practice," LaCroix wrote.
In response to this concern, Anna Criddle, director of global portfolio communications at Astellas, wrote in an email to Leaps.org: “…a full analysis of data, including adherence data and any impact of missing data, was submitted for assessment by [the FDA].”
The company ran the studies at more than 300 sites around the world. Curiously, none appear to have been at academic medical centers, which are known for higher quality research. Zuckerman says, "When somebody is paid to do a study, if they want to get paid to do another study by the same company, they will try to make sure that the results are the results that the company wants.”
Criddle said that Astellas picked the sites “that would allow us to reach a diverse population of women, including race and ethnicity.”
A trial of a lower dose of the drug was conducted in Asia. In March 2022, Astellas issued a press release saying it had failed to prove effectiveness. No further data has been released. Astellas still plans to submit the data, according to Criddle. Results from clinical trials funded by the U.S. goverment must be reported on clinicaltrials.gov within one year of the study's completion - a deadline that, in this case, has expired.
The measurement scale for hot flashes used in the studies, mild-moderate-severe, also came in for criticism. “It is really not good scale, there probably isn’t a broad enough range of things going on or descriptors,” says David Rind. He is chief medical officer of the Institute for Clinical and Economic Review (ICER), a nonprofit authority on new drugs. It conducted a thorough review and analysis of fezolinestant using then existing data gathered from conference abstracts, posters and presentations and included a public stakeholder meeting in December. A 252-page report was published in January, finding “considerable uncertainty about the comparative net health benefits of fezolinetant” versus hormone therapy.
Questions surrounding some of these issues might have been answered if the FDA had chosen to hold a public advisory committee meeting on fezolinetant, which it regularly does for first in class medicines. But the agency decided such a meeting was unnecessary.
Cost
There was little surprise when Astellas announced a list price for fezolinetant of $550 a month ($6000 annually) and a program of patient assistance to ease out of pocket expenses. The company had already incurred large expenses.
In 2017 Astellas purchased the company that originally developed fezolinetant for $534 million plus several hundred million in potential royalties. The drug company ran a "disease awareness” ad, Heat on the Street, hat aired during the Super Bowl in February, where 30 second ads cost about $7 million. Industry analysts have projected sales to be $1.9 billion by 2028.
ICER’s pre-approval evaluation said fezolinetant might "be considered cost-effective if priced around $2,000 annually. ... [It]will depend upon its price and whether it is considered an alternative to MHT [menopause hormone treatment] for all women or whether it will primarily be used by women who cannot or will not take MHT."
Criddle wrote that Astellas set the price based on the novelty of the science, the quality of evidence for the drug and its uniqueness compared to the rest of the market. She noted that an individual’s payment will depend on how much their insurance company decides to cover. “[W]e expect insurance coverage to increase over the course of the year and to achieve widespread coverage in the U.S. over time.”
Leaps.org wrote to and followed up with nine of the largest health insurers/providers asking basic questions about their coverage of fezolinetant. Only two responded. Jennifer Martin, the deputy chief consultant for pharmacy benefits management at the Department of Veterans Affairs, said the agency “covers all drugs from the date that they are launched.” Decisions on whether it will be included in the drug formulary and what if any copays might be required are under review.
“[Fezolinetant] will go through our standard P&T Committee [patient and treatment] review process in the next few months, including a review of available efficacy data, safety data, clinical practice guidelines, and comparison with other agents used for vasomotor symptoms of menopause," said Phil Blando, executive director of corporate communications for CVS Health.
Other insurers likely are going through a similar process to decide issues such as limiting coverage to women who are advised not to use hormones, how much copay will be required, and whether women will be required to first try other options or obtain approvals before getting a prescription.
Rind wants to see a few years of use before he prescribes fezolinetant broadly, and believes most doctors share his view. Nor will they be eager to fill out the additional paperwork required for women to participate in the Astellas patient assistance program, he added.
Safety
Astellas is marketing its drug by pointing out risks of hormone therapy, such as a recent paper in The BMJ, which noted that women who took hormones for even a short period of time had a 24 percent increased risk of dementia. While the percentage was scary, the combined number of women both on and off hormones who developed dementia was small. And it is unclear whether hormones are causing dementia or if more severe hot flashes are a marker for higher risk of developing dementia. This information is emerging only after 80 years of hundreds of millions of women using hormones.
In contrast, the label for fezolinetant prohibits “concomitant use with CYP1A2 inhibitors” and requires testing for liver and kidney function prior to initiating the drug and every three months thereafter. There is no human or animal data on use in a geriatric population, defined as 65 or older, a group that is likely to use the drug. Only a few thousand women have ever taken fezolinetant and most have used it for just a few months.
Options
A woman seeking relief from symptoms of menopause would like to see how fezolintant compares with other available treatment options. But Astellas did not conduct such a study and Andrea LaCroix says it is unlikely that anyone ever will.
ICER has come the closest, with a side-by-side analysis of evidence-based treatments and found that fezolinetant performed quite similarly and modestly as the others in providing relief from hot flashes. Some treatments also help with other symptoms of menopause, which fezolinetant does not.
There are many coping strategies that women can adopt to deal with hot flashes; one of the most common is dressing in layers (such as a sleeveless blouse with a sweater) that can be added or subtracted as conditions require. Avoiding caffeine, hot liquids, and spicy foods is another common strategy. “I stopped drinking hot caffeinated drinks…for several years, and you get out of the habit of drinking them,” says Zuckerman.
LaCroix curates those options at My Meno Plan, which includes a search function where you can enter your symptoms and identify which treatments might work best for you. It also links to published research papers. She says the goal is to empower women with information to make informed decisions about menopause.
A company in England has made a test that picks out the compounds from breath that reveal if people have liver disease.
Every year, around two million people worldwide die of liver disease. While some people inherit the disease, it’s most commonly caused by hepatitis, obesity and alcoholism. These underlying conditions kill liver cells, causing scar tissue to form until eventually the liver cannot function properly. Since 1979, deaths due to liver disease have increased by 400 percent.
The sooner the disease is detected, the more effective treatment can be. But once symptoms appear, the liver is already damaged. Around 50 percent of cases are diagnosed only after the disease has reached the final stages, when treatment is largely ineffective.
To address this problem, Owlstone Medical, a biotech company in England, has developed a breath test that can detect liver disease earlier than conventional approaches. Human breath contains volatile organic compounds (VOCs) that change in the first stages of liver disease. Owlstone’s breath test can reliably collect, store and detect VOCs, while picking out the specific compounds that reveal liver disease.
“There’s a need to screen more broadly for people with early-stage liver disease,” says Owlstone’s CEO Billy Boyle. “Equally important is having a test that's non-invasive, cost effective and can be deployed in a primary care setting.”
The standard tool for detection is a biopsy. It is invasive and expensive, making it impractical to use for people who aren't yet symptomatic. Meanwhile, blood tests are less invasive, but they can be inaccurate and can’t discriminate between different stages of the disease.
In the past, breath tests have not been widely used because of the difficulties of reliably collecting and storing breath. But Owlstone’s technology could help change that.
The team is testing patients in the early stages of advanced liver disease, or cirrhosis, to identify and detect these biomarkers. In an initial study, Owlstone’s breathalyzer was able to pick out patients who had early cirrhosis with 83 percent sensitivity.
Boyle’s work is personally motivated. His wife died of colorectal cancer after she was diagnosed with a progressed form of the disease. “That was a big impetus for me to see if this technology could work in early detection,” he says. “As a company, Owlstone is interested in early detection across a range of diseases because we think that's a way to save lives and a way to save costs.”
How it works
In the past, breath tests have not been widely used because of the difficulties of reliably collecting and storing breath. But Owlstone’s technology could help change that.
Study participants breathe into a mouthpiece attached to a breath sampler developed by Owlstone. It has cartridges are designed and optimized to collect gases. The sampler specifically targets VOCs, extracting them from atmospheric gases in breath, to ensure that even low levels of these compounds are captured.
The sampler can store compounds stably before they are assessed through a method called mass spectrometry, in which compounds are converted into charged atoms, before electromagnetic fields filter and identify even the tiniest amounts of charged atoms according to their weight and charge.
The top four compounds in our breath
In an initial study, Owlstone captured VOCs in breath to see which ones could help them tell the difference between people with and without liver disease. They tested the breath of 46 patients with liver disease - most of them in the earlier stages of cirrhosis - and 42 healthy people. Using this data, they were able to create a diagnostic model. Individually, compounds like 2-Pentanone and limonene performed well as markers for liver disease. Owlstone achieved even better performance by examining the levels of the top four compounds together, distinguishing between liver disease cases and controls with 95 percent accuracy.
“It was a good proof of principle since it looks like there are breath biomarkers that can discriminate between diseases,” Boyle says. “That was a bit of a stepping stone for us to say, taking those identified, let’s try and dose with specific concentrations of probes. It's part of building the evidence and steering the clinical trials to get to liver disease sensitivity.”
Sabine Szunerits, a professor of chemistry in Institute of Electronics at the University of Lille, sees the potential of Owlstone’s technology.
“Breath analysis is showing real promise as a clinical diagnostic tool,” says Szunerits, who has no ties with the company. “Owlstone Medical’s technology is extremely effective in collecting small volatile organic biomarkers in the breath. In combination with pattern recognition it can give an answer on liver disease severity. I see it as a very promising way to give patients novel chances to be cured.”
Improving the breath sampling process
Challenges remain. With more than one thousand VOCs found in the breath, it can be difficult to identify markers for liver disease that are consistent across many patients.
Julian Gardner is a professor of electrical engineering at Warwick University who researches electronic sensing devices. “Everyone’s breath has different levels of VOCs and different ones according to gender, diet, age etc,” Gardner says. “It is indeed very challenging to selectively detect the biomarkers in the breath for liver disease.”
So Owlstone is putting chemicals in the body that they know interact differently with patients with liver disease, and then using the breath sampler to measure these specific VOCs. The chemicals they administer are called Exogenous Volatile Organic Compound) probes, or EVOCs.
Most recently, they used limonene as an EVOC probe, testing 29 patients with early cirrhosis and 29 controls. They gave the limonene to subjects at specific doses to measure how its concentrations change in breath. The aim was to try and see what was happening in their livers.
“They are proposing to use drugs to enhance the signal as they are concerned about the sensitivity and selectivity of their method,” Gardner says. “The approach of EVOC probes is probably necessary as you can then eliminate the person-to-person variation that will be considerable in the soup of VOCs in our breath.”
Through these probes, Owlstone could identify patients with liver disease with 83 percent sensitivity. By targeting what they knew was a disease mechanism, they were able to amplify the signal. The company is starting a larger clinical trial, and the plan is to eventually use a panel of EVOC probes to make sure they can see diverging VOCs more clearly.
“I think the approach of using probes to amplify the VOC signal will ultimately increase the specificity of any VOC breath tests, and improve their practical usability,” says Roger Yazbek, who leads the South Australian Breath Analysis Research (SABAR) laboratory in Flinders University. “Whilst the findings are interesting, it still is only a small cohort of patients in one location.”
The future of breath diagnosis
Owlstone wants to partner with pharmaceutical companies looking to learn if their drugs have an effect on liver disease. They’ve also developed a microchip, a miniaturized version of mass spectrometry instruments, that can be used with the breathalyzer. It is less sensitive but will enable faster detection.
Boyle says the company's mission is for their tests to save 100,000 lives. "There are lots of risks and lots of challenges. I think there's an opportunity to really establish breath as a new diagnostic class.”