Who Qualifies as an “Expert” And How Can We Decide Who Is Trustworthy?
Discerning a real expert from a charlatan is crucial during the COVID-19 pandemic and beyond.
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Expertise is a slippery concept. Who has it, who claims it, and who attributes or yields it to whom is a culturally specific, sociological process. During the COVID-19 pandemic, we have witnessed a remarkable emergence of legitimate and not-so-legitimate scientists publicly claiming or being attributed to have academic expertise in precisely my field: infectious disease epidemiology. From any vantage point, it is clear that charlatans abound out there, garnering TV coverage and hundreds of thousands of Twitter followers based on loud opinions despite flimsy credentials. What is more interesting as an insider is the gradient of expertise beyond these obvious fakers.
A person's expertise is not a fixed attribute; it is a hierarchical trait defined relative to others. Despite my protestations, I am the go-to expert on every aspect of the pandemic to my family. To a reporter, I might do my best to answer a question about the immune response to SARS-CoV-2, noting that I'm not an immunologist. Among other academic scientists, my expertise is more well-defined as a subfield of epidemiology, and within that as a particular area within infectious disease epidemiology. There's a fractal quality to it; as you zoom in on a particular subject, a differentiation of expertise emerges among scientists who, from farther out, appear to be interchangeable.
We all have our scientific domain and are less knowledgeable outside it, of course, and we are often asked to comment on a broad range of topics. But many scientists without a track record in the field have become favorites among university administrators, senior faculty in unrelated fields, policymakers, and science journalists, using institutional prestige or social connections to promote themselves. This phenomenon leads to a distorted representation of science—and of academic scientists—in the public realm.
Trustworthy experts will direct you to others in their field who know more about particular topics, and will tend to be honest about what is and what isn't "in their lane."
Predictably, white male voices have been disproportionately amplified, and men are certainly over-represented in the category of those who use their connections to inappropriately claim expertise. Generally speaking, we are missing women, racial minorities, and global perspectives. This is not only important because it misrepresents who scientists are and reinforces outdated stereotypes that place white men in the Global North at the top of a credibility hierarchy. It also matters because it can promote bad science, and it passes over scientists who can lend nuance to the scientific discourse and give global perspectives on this quintessentially global crisis.
Also at work, in my opinion, are two biases within academia: the conflation of institutional prestige with individual expertise, and the bizarre hierarchy among scientists that attributes greater credibility to those in quantitative fields like physics. Regardless of mathematical expertise or institutional affiliation, lack of experience working with epidemiological data can lead to over-confidence in the deceptively simple mathematical models that we use to understand epidemics, as well as the inappropriate use of uncertain data to inform them. Prominent and vocal scientists from different quantitative fields have misapplied the methods of infectious disease epidemiology during the COVID-19 pandemic so far, creating enormous confusion among policymakers and the public. Early forecasts that predicted the epidemic would be over by now, for example, led to a sense that epidemiological models were all unreliable.
Meanwhile, legitimate scientific uncertainties and differences of opinion, as well as fundamentally different epidemic dynamics arising in diverse global contexts and in different demographic groups, appear in the press as an indistinguishable part of this general chaos. This leads many people to question whether the field has anything worthwhile to contribute, and muddies the facts about COVID-19 policies for reducing transmission that most experts agree on, like wearing masks and avoiding large indoor gatherings.
So how do we distinguish an expert from a charlatan? I believe a willingness to say "I don't know" and to openly describe uncertainties, nuances, and limitations of science are all good signs. Thoughtful engagement with questions and new ideas is also an indication of expertise, as opposed to arrogant bluster or a bullish insistence on a particular policy strategy regardless of context (which is almost always an attempt to hide a lack of depth of understanding). Trustworthy experts will direct you to others in their field who know more about particular topics, and will tend to be honest about what is and what isn't "in their lane." For example, some expertise is quite specific to a given subfield: epidemiologists who study non-infectious conditions or nutrition, for example, use different methods from those of infectious disease experts, because they generally don't need to account for the exponential growth that is inherent to a contagion process.
Academic scientists have a specific, technical contribution to make in containing the COVID-19 pandemic and in communicating research findings as they emerge. But the liminal space between scientists and the public is subject to the same undercurrents of sexism, racism, and opportunism that society and the academy have always suffered from. Although none of the proxies for expertise described above are fool-proof, they are at least indicative of integrity and humility—two traits the world is in dire need of at this moment in history.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
Dr. Emily Oster on Decision-Making and the Kids' Covid Vaccine
Dr. Emily Oster, Brown economist and bestselling author, stops by the podcast for a robust discussion on the kids' Covid vaccine as well as her expectations for school vaccine and mask policies in 2022.
The "Making Sense of Science" podcast features interviews with leading medical and scientific experts about the latest developments and the big ethical and societal questions they raise. This monthly podcast is hosted by journalist Kira Peikoff, founding editor of the award-winning science outlet Leaps.org.
This month, Brown economist and bestselling author Dr. Emily Oster breaks down her decision-making process about why she vaccinated her kids against Covid, and the helpful frameworks other parents can use to think through the decision for their own kids. She also discusses her expectations for school policies regarding vaccines and masks in 2022.
Watch the trailer:
Listen to the Episode:
<div id="buzzsprout-player-9526587"></div><script src="https://www.buzzsprout.com/1714953/9526587-kids-covid-vaccine-and-decision-making-with-emily-oster.js?container_id=buzzsprout-player-9526587&player=small" type="text/javascript" charset="utf-8"></script>
Kira Peikoff was the editor-in-chief of Leaps.org from 2017 to 2021. As a journalist, her work has appeared in The New York Times, Newsweek, Nautilus, Popular Mechanics, The New York Academy of Sciences, and other outlets. She is also the author of four suspense novels that explore controversial issues arising from scientific innovation: Living Proof, No Time to Die, Die Again Tomorrow, and Mother Knows Best. Peikoff holds a B.A. in Journalism from New York University and an M.S. in Bioethics from Columbia University. She lives in New Jersey with her husband and two young sons. Follow her on Twitter @KiraPeikoff.
Six Questions about the Kids' COVID Vaccine, Answered by an Infectious Disease Doctor
The author, an infectious disease physician, pictured with his two daughters who are getting vaccinated against COVID-19.
I enthusiastically support the vaccination against COVID for children aged 5-11 years old. As an infectious disease doctor who took care of hundreds of COVID-19 patients over the past 20 months, I have seen the immediate and long-term consequences of COVID-19 on patients – and on their families. As a father of two daughters, I have lived through the fear and anxiety of protecting my kids at all cost from the scourges of the pandemic and worried constantly about bringing the virus home from work.
It is imperative that we vaccinate as many children in the community as possible. There are several reasons why. First children do get sick from COVID-19. Over the course of the pandemic in the U.S, more than 2 million children aged 5-11 have become infected, more than 8000 have been hospitalized, and more than 100 have died, making COVID one of the top 10 causes of pediatric deaths in this age group over the past year. Children are also susceptible to chronic consequences of COVID such as long COVID and multisystem inflammatory syndrome in children (MIS-C). Most studies demonstrate that 10-30% of children will develop chronic symptoms following COVID-19. These include complaints of brain fog, fatigue, trouble breathing, fever, headache, muscle and joint pains, abdominal pain, mood swings and even psychiatric disorders. Symptoms typically last from 4-8 weeks in children, with some reporting symptoms that persist for many months.
Second, children are increasingly recognized as vectors who can bring infection into the house, potentially transmitting infection to vulnerable household members. Finally, we have all seen the mayhem that results when one child in the classroom becomes infected with COVID and the other students get sent home to quarantine – across the U.S., more than 2000 schools have been affected this way.
We now have an extraordinarily effective vaccine with more than 90 percent efficacy at preventing symptomatic infection. Vaccinating children will boost our countrywide vaccination rate which is trailing many countries after an early start. Nevertheless, there are still many questions and concerns that parents have as the vaccine gets rolled out. I will address six of them here.
"Novel Vaccine Technology"
Even though this is a relatively new vaccine, the technology is not new. Scientists had worked on mRNA vaccines for decades prior to the COVID mRNA vaccine breakthrough. Furthermore, experience with the Pfizer COVID vaccine is rapidly growing. By now it has been more than a year and a half since the Pfizer trials began in March 2020, and more than 7 billion doses have already been administered globally, including in 13.7 million adolescents in the U.S. alone.
"Will This Vaccine Alter My Child's DNA?"
No. This is not how mRNA works. DNA is present in the cell's nucleus. The mRNA only stays in the outside cytoplasm, gets destroyed and never enters the inner sanctum of the nucleus. Furthermore, for the mRNA to be ever integrated into DNA, it requires a special enzyme called reverse transcriptase which humans don't have. Proteins (that look like the spike proteins on SARS-CoV-2) are made directly from this mRNA message without involvement of our DNA at any time. Pieces of spike proteins get displayed on the outside of our cells and our body makes protective antibodies that then protects us handily against the future real virus if it were ever to enter our (or our children's) bodies. Our children's DNA or genes can never be affected by an mRNA vaccine.
"Lack of Info on Long-Term Side Effects"
Unlike medications that are taken daily or periodically and can build up over time, the mRNA in the Pfizer vaccine is evanescent. It literally is just the messenger (that is what the "m" in mRNA stands for) and the messenger quickly disappears. mRNA is extremely fragile and easily inactivated – that's why we need to encase it in a special fatty bubble and store the vaccines at extremely cold temperatures. Our cells break down and destroy the mRNA within a few days after receiving the instructions to make the virus spike proteins. The presence of these fragments of the virus (note this is not "live" virus) prompts our immune system to generate protective antibodies to the real thing. Our bodies break down mRNA all the time in normal cellular processes – this is nothing new.
What the transience of the delivery system means is that most of the effects of the mRNA vaccines are expected to be more immediate (sore arm, redness at the site, fever, chills etc.), with no long-term side effects anticipated. A severe allergic response has been reported to occur in some generally within the first 15 minutes, is very rare, and everyone gets observed for that as part of standard vaccine administration. Even with the very uncommon complication of myocarditis (inflammation of the heart muscle) and pericarditis (inflammation of the lining of the heart) seen primarily in young men under the age of 30 following mRNA vaccines, these typically happen within days to 2 weeks and many return to work or school in days. In the 70-year history of pediatric (and adult vaccines), dangerous complications happen in the first two months. There have been millions of adolescents as young as 12 years and thousands in the initial trial of children aged 5-11 who have already received the vaccine and are well beyond the two-month period of observation. There is no biological reason to believe that younger children will have a different long-term side effect profile compared to adolescents or adults.
"Small Sample Size in Kids and the Trial Design"
Although the Pfizer trial in children aged 5-11 was relatively small, it was big enough to give us statistical confidence in assessing safety and efficacy outcomes. Scientists spend a lot of time determining the right sample size of a study during the design phase. On one hand, you want to conduct the study efficiently so that resources are used in a cost-effective way and that you get a timely answer, especially in a fast-moving pandemic. On the other hand, you want to make sure you have enough sample size so that you can answer the question confidently as to whether the intervention works and whether there are adverse effects. The more profound the effect size of the intervention (in this case the vaccine), the fewer the numbers of children needed in the trials.
Statistics help investigators determine whether the results seen would have appeared by chance or not. In this case, the effect was real and impressive. Over 3,000 children around the world have received the vaccines through the trials alone with no serious side effects detected. The first press release reported that the immune response in children aged 5-11 was similar (at one-third the vaccine dose) to the response in the comparator group aged 16-25 years old. Extrapolating clinical efficacy results from immune response measurements ("immunobridging" study) would already have been acceptable if this was the only data. This is a standard trial design for many pediatric vaccines. Vaccines are first tested in the lab, followed by animals then adults. Only when deemed safe in adults and various regulatory bodies have signed off, do the pediatric vaccine trials commence.
Because children's immune systems and bodies are in a constant state of development, the vaccines must be right-sized. Investigators typically conduct "age de-escalation" studies in various age groups. The lowest dose is first tried so see if that is effective, then the dose is increased gradually as needed. Immune response is the easiest, safest and most efficient way to test the efficacy of pediatric vaccines. This is a typical size and design of a childhood vaccine seeking regulatory approval. There is no reason to think that the clinical efficacy would be any different in children vs. adults for a given antibody response, given the experience already in the remainder of the population, including older children and adolescents. Although this was primarily designed as an "immunobridging" study, the initial immunologic response data was followed by real clinical outcomes in this population. Reporting on the outcomes of 2,268 children in the randomized controlled trial, the vaccine was 90.7% effective at preventing symptomatic infection.
"Fear of Myocarditis"
Myocarditis (inflammation of the heart muscle) and pericarditis (inflammation of the lining of the heart) have been associated with receipt of the mRNA vaccines, particularly among male adolescents and young adults, typically within a few days after receiving the second dose. But this is very rare. For every million vaccine recipients, you would expect 41 cases in males, and 4 cases in females aged 12-29 years-old. The risk in older age groups is substantially lower. It is important to recognize that the risk of myocarditis associated with COVID is substantially higher. Patients present with new chest pain, shortness of breath, or palpitations after receiving an mRNA vaccine (more common after the second dose). But outcomes are good if associated with the vaccine. Most respond well to treatment and resolve symptoms within a week. There have been no deaths associated with vaccine-associated myocarditis.
In contrast, COVID-associated myocarditis has been associated with more severe cases as well as other complications including chronic symptoms of long COVID. The risk of myocarditis is likely related to vaccine dose, so the fact that one-third the dose of the vaccine will be used in the 5-11 year-olds is expected to correspond to a lower risk of myocarditis. At the lower dose given to younger kids, there has been a lower incidence of adverse effects reported compared to older children and adults who received the full dose. In addition, baseline rates of myocarditis not associated with vaccination are much lower in children ages 5-11 years than in older children, so the same may hold true for vaccine-associated myocarditis cases. This is because myocarditis is associated with sex hormones (particularly testosterone) that surge during puberty. In support of this, the incidence of vaccine-associated myocarditis is lower in 12–15-year-old boys, compared to those who were older than 16 years old. There were no cases of myocarditis reported in the experience to date of 5–11-year-old children in the trials, although the trial was too small to pick up on such a rare effect.
"Optimal Dose Spacing Interval: Longer Than 3 Weeks?"
There is a biologic basis for increasing the interval between vaccine doses in general. Priming the immune system with the first shot and then waiting gives the second shot a better chance of prompting a secondary immune reaction that results in a more durable response (with more T cell driven immune memory). One study from the U.K. showed that the antibody response in people over 80 was more than 3 times higher if they delayed the second dose to after 12 weeks for the Pfizer vaccine instead of the 3 weeks studied in trials. In a study of 503 British health care workers, there were twice as many neutralizing antibodies produced in a longer interval group (6-14 weeks) versus a shorter interval group (3-4 weeks) between doses. However, the safety and efficacy with longer intervals has not been evaluated in the pediatric or other COVID vaccine trials.
In the U.S., the C.D.C. reported that 88 percent of counties are at a "high" or "substantial" level of community transmission. Also, Europe is already experiencing a winter surge of infections that may predict more U.S. winter cases as international travel reopens. During a time of high community virus burden with a highly transmissible Delta variant, relying on one dose of vaccine for several more weeks until the second may leave many more susceptible to infection while waiting. One study from England showed that one dose of the Pfizer vaccine was only 33% protective against symptomatic Delta infection in contrast to 50% for the Alpha variant in adults. There has been no corollary information in children but we would expect less protection in general from one vaccine dose vs. two. This is a particularly important issue with the upcoming holiday season when an increased number of families will travel. Some countries such as the U.K. and Norway have proceeded with only offering older than 12 year-olds one dose of vaccine rather than two, but this was before the current European surge which may change the risk-benefit calculus. There are no plans to only offer one vaccine dose in the U.S. at this time. However a lower dose of the vaccine will likely be studied in the future for adolescents aged 12-15.
For parents worried about the potential risk of adverse effects of two doses of vaccines in their children, it is reasonable to wait 6-12 weeks for the second shot but it all depends on your risk-benefit calculus. There is biological plausibility to pursue this strategy. Although there is no pediatric-specific data to draw from, a longer interval may lengthen immune memory and potentially decrease the risk of myocarditis, particularly in boys. There may only be partial benefit in eliciting protective antibodies after one vaccine dose but only 2-4% of children are hospitalized with COVID once infected, with risk of severe illness increasing if they have comorbidities.
There are also some data indicating that 40% of children have already been exposed to infection naturally and may not need further protection after one shot. However, this percentage is likely a large overestimation given the way the data was collected. Using antibody tests to ascertain previous infection in children may be problematic for several reasons: uncertainty regarding duration of protection, variability in symptoms in children with most having very mild symptoms, and the lack of standardization of antibody tests in general. Overall, if the child has medical comorbidities such as diabetes, parents are planning to travel with their children, if local epidemiology shows increasing cases, and if there are elderly or immunocompromised individuals in the household, I would vaccinate children with two doses as per the original recommended schedule.
Bottom line: Given the time of the year and circulating Delta, I would probably stick with the recommended 3-week interval between doses for now for most children. But if parents choose a longer interval between the first and second dose for their children, I wouldn't worry too much about it. Better to be vaccinated - even if slowly, over time -- than not at all.