Who Qualifies as an “Expert” And How Can We Decide Who Is Trustworthy?
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Expertise is a slippery concept. Who has it, who claims it, and who attributes or yields it to whom is a culturally specific, sociological process. During the COVID-19 pandemic, we have witnessed a remarkable emergence of legitimate and not-so-legitimate scientists publicly claiming or being attributed to have academic expertise in precisely my field: infectious disease epidemiology. From any vantage point, it is clear that charlatans abound out there, garnering TV coverage and hundreds of thousands of Twitter followers based on loud opinions despite flimsy credentials. What is more interesting as an insider is the gradient of expertise beyond these obvious fakers.
A person's expertise is not a fixed attribute; it is a hierarchical trait defined relative to others. Despite my protestations, I am the go-to expert on every aspect of the pandemic to my family. To a reporter, I might do my best to answer a question about the immune response to SARS-CoV-2, noting that I'm not an immunologist. Among other academic scientists, my expertise is more well-defined as a subfield of epidemiology, and within that as a particular area within infectious disease epidemiology. There's a fractal quality to it; as you zoom in on a particular subject, a differentiation of expertise emerges among scientists who, from farther out, appear to be interchangeable.
We all have our scientific domain and are less knowledgeable outside it, of course, and we are often asked to comment on a broad range of topics. But many scientists without a track record in the field have become favorites among university administrators, senior faculty in unrelated fields, policymakers, and science journalists, using institutional prestige or social connections to promote themselves. This phenomenon leads to a distorted representation of science—and of academic scientists—in the public realm.
Trustworthy experts will direct you to others in their field who know more about particular topics, and will tend to be honest about what is and what isn't "in their lane."
Predictably, white male voices have been disproportionately amplified, and men are certainly over-represented in the category of those who use their connections to inappropriately claim expertise. Generally speaking, we are missing women, racial minorities, and global perspectives. This is not only important because it misrepresents who scientists are and reinforces outdated stereotypes that place white men in the Global North at the top of a credibility hierarchy. It also matters because it can promote bad science, and it passes over scientists who can lend nuance to the scientific discourse and give global perspectives on this quintessentially global crisis.
Also at work, in my opinion, are two biases within academia: the conflation of institutional prestige with individual expertise, and the bizarre hierarchy among scientists that attributes greater credibility to those in quantitative fields like physics. Regardless of mathematical expertise or institutional affiliation, lack of experience working with epidemiological data can lead to over-confidence in the deceptively simple mathematical models that we use to understand epidemics, as well as the inappropriate use of uncertain data to inform them. Prominent and vocal scientists from different quantitative fields have misapplied the methods of infectious disease epidemiology during the COVID-19 pandemic so far, creating enormous confusion among policymakers and the public. Early forecasts that predicted the epidemic would be over by now, for example, led to a sense that epidemiological models were all unreliable.
Meanwhile, legitimate scientific uncertainties and differences of opinion, as well as fundamentally different epidemic dynamics arising in diverse global contexts and in different demographic groups, appear in the press as an indistinguishable part of this general chaos. This leads many people to question whether the field has anything worthwhile to contribute, and muddies the facts about COVID-19 policies for reducing transmission that most experts agree on, like wearing masks and avoiding large indoor gatherings.
So how do we distinguish an expert from a charlatan? I believe a willingness to say "I don't know" and to openly describe uncertainties, nuances, and limitations of science are all good signs. Thoughtful engagement with questions and new ideas is also an indication of expertise, as opposed to arrogant bluster or a bullish insistence on a particular policy strategy regardless of context (which is almost always an attempt to hide a lack of depth of understanding). Trustworthy experts will direct you to others in their field who know more about particular topics, and will tend to be honest about what is and what isn't "in their lane." For example, some expertise is quite specific to a given subfield: epidemiologists who study non-infectious conditions or nutrition, for example, use different methods from those of infectious disease experts, because they generally don't need to account for the exponential growth that is inherent to a contagion process.
Academic scientists have a specific, technical contribution to make in containing the COVID-19 pandemic and in communicating research findings as they emerge. But the liminal space between scientists and the public is subject to the same undercurrents of sexism, racism, and opportunism that society and the academy have always suffered from. Although none of the proxies for expertise described above are fool-proof, they are at least indicative of integrity and humility—two traits the world is in dire need of at this moment in history.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
The Friday Five: Scientists treated this girl's disease before she was born
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Here are the promising studies covered in this week's Friday Five:
- Kids treated for diseases before they're born
- How to lift weights in half the time
- Electric shocks help people regain the ability to walk
- Meditation just as good as medication?
- These foods could pump up your motivation
Tapping into the Power of the Placebo Effect
When Wayne Jonas was in medical school 40 years ago, doctors would write out a prescription for placebos, spelling it out backwards in capital letters, O-B-E-C-A-L-P. The pharmacist would fill the prescription with a sugar pill, recalls Jonas, now director of integrative health programs at the Samueli Foundation. It fulfilled the patient's desire for the doctor to do something when perhaps no drug could help, and the sugar pills did no harm.
Today, that deception is seen as unethical. But time and time again, studies have shown that placebos can have real benefits. Now, researchers are trying to untangle the mysteries of placebo effect in an effort to better treat patients.
The use of placebos took off in the post-WWII period, when randomized controlled clinical trials became the gold standard for medical research. One group in a study would be treated with a placebo, a supposedly inert pill or procedure that would not affect normal healing and recovery, while another group in the study would receive an "active" component, most commonly a pill under investigation. Presumably, the group receiving the active treatment would have a better response and the difference from the placebo group would represent the efficacy of the drug being tested. That was the basis for drug approval by the U.S. Food and Drug Administration.
"Placebo responses were marginalized," says Ted Kaptchuk, director of the Program in Placebo Studies & Therapeutic Encounters at Harvard Medical School. "Doctors were taught they have to overcome it when they were thinking about using an effective drug."
But that began to change around the turn of the 21st century. The National Institutes of Health held a series of meetings to set a research agenda and fund studies to answer some basic questions, led by Jonas who was in charge of the office of alternative medicine at the time. "People spontaneously get better all the time," says Kaptchuk. The crucial question was, is the placebo effect real? Is it more than just spontaneous healing?
Brain mechanisms
A turning point came in 2001 in a paper in Science that showed physical evidence of the placebo effect. It used positron emission tomography (PET) scans to measure release patterns of dopamine — a chemical messenger involved in how we feel pleasure — in the brains of patients with Parkinson's disease. Surprisingly, the placebo activated the same patterns that were activated by Parkinson's drugs, such as levodopa. It proved the placebo effect was real; now the search was on to better understand and control it.
A key part of the effect can be the beliefs, expectations, context, and "rituals" of the encounter between doctor and patient. Belief by the doctor and patient that the treatment would work, and the formalized practices of administering the treatment can all contribute to a positive outcome.
Conditioning can be another important component in generating a response, as Pavlov demonstrated more than a century ago in his experiments with dogs. They were trained with a bell prior to feeding such that they would begin to salivate in anticipation at the sound of a bell even with no food present.
Translating that to humans, studies with pain medications and sleeping aids showed that patients who had a positive response with a certain dose of those medications could have the same response if the doses was reduced and a dummy pill substituted, even to the point where there was no longer any active ingredient.
Researchers think placebo treatments can work particularly well in helping people deal with pain and psychological disorders.
Those types of studies troubled Kaptchuk because they often relied on deception; patients weren't told they were receiving a placebo, or at best there was a possibility that they might be randomized to receive a placebo. He believed the placebo effect could work even if patients were told upfront that they were going to receive a placebo. More than a dozen so call "open-label placebo" studies across numerous medical conditions, by Kaptchuk and others, have shown that you don't have to lie to patients for a placebo to work.
Jonas likes to tell the story of a patient who used methotrexate, a potent immunosuppressant, to control her rheumatoid arthritis. She was planning a long trip and didn't want to be bothered with the injections and monitoring required in using the drug, So she began to drink a powerful herbal extract of anise, a licorice flavor that she hated, prior to each injection. She reduced the amount of methotrexate over a period of months and finally stopped, but continued to drink the anise. That process had conditioned her body "to alter her immune function and her autoimmunity" as if she were taking the drug, much like Pavlov's dogs had been trained. She has not taken methotrexate for more than a year.
An intriguing paper published in May 2021 found that mild, non-invasive electric stimulation to the brain could not only boost the placebo effect on pain but also reduce the "nocebo" effect — when patients report a negative effect to a sham treatment. While the work is very preliminary, it may open the door to directly manipulating these responses.
Researchers think placebo treatments can work particularly well in helping people deal with pain and psychological disorders, areas where drugs often are of little help. Still, placebos aren't a cure and only a portion of patients experience a placebo effect.
Nocebo
If medicine were a soap opera, the nocebo would be the evil twin of the placebo. It's what happens when patients have adverse side effects because of the expectation that they will. It's commonly seem when patients claims to experience pain or gastric distress that can occur with a drug even when they've received a placebo. The side effects were either imagined or caused by something else.
"Up to 97% of reported pharmaceutical side effects are not caused by the drug itself but rather by nocebo effects and symptom misattribution," according to one 2019 paper.
One way to reduce a nocebo response is to simply not tell patients that specific side effects might occur. An example is a liver biopsy, in which a large-gauge needle is used to extract a tissue sample for examination. Those told ahead of time that they might experience some pain were more likely to report pain and greater pain than those who weren't offered this information.
Interestingly, a nocebo response plays out in the hippocampus, a part of the brain that is never activated in a placebo response. "I think what we are dealing with with nocebo is anxiety," says Kaptchuk, but he acknowledges that others disagree.
Distraction may be another way to minimize the nocebo effect. Pediatricians are using virtual reality (VR) to engage children and distract them during routine procedures such as blood draws and changing wound dressings, and burn patients of all ages have found relief with specially created VRs.
Treatment response
Jonas argues that what we commonly call the placebo effect is misnamed and leading us astray. "The fact is people heal and that inherent healing capacity is both powerful and influenced by mental, social, and contextual factors that are embedded in every medical encounter since the idea of treatment began," he wrote in a 2019 article in the journal Frontiers in Psychiatry. "Our understanding of healing and ability to enhance it will be accelerated if we stop using the term 'placebo response' and call it what it is—the meaning response, and its special application in medicine called the healing response."
He cites evidence that "only 15% to 20% of the healing of an individual or a population comes from health care. The rest—nearly 80%—comes from other factors rarely addressed in the health care system: behavioral and lifestyle choices that people make in their daily life."
To better align treatments and maximize their effectiveness, Jonas has created HOPE (Healing Oriented Practices & Environments) Note, "a patient-guided process designed to identify the patient's values and goals in their life and for healing." Essentially, it seeks to make clear to both doctor and patient what the patient's goals are in seeking treatment. In an extreme example of terminal cancer, some patients may choose to extend life despite the often brutal treatments, while others might prefer to optimize quality of life in the remaining time that they have. It builds on practices already taught in medical schools. Jonas believes doctors and patients can use tools like these to maximize the treatment response and achieve better outcomes.
Much of the medical profession has been resistant to these approaches. Part of that is simply tradition and limited data on their effectiveness, but another very real factor is the billing process for how they are reimbursed. Jonas says a new medical billing code added this year gives doctors another way to be compensated for the extra time and effort that a more holistic approach to medicine may initially require. Other moves away from fee-for-service payments to bundling and payment for outcomes, and the integrated care provided by the Veterans Affairs, Kaiser Permanente and other groups offer longer term hope for the future of approaches that might enhance the healing response.
This article was first published by Leaps.org on July 7, 2021.