Who Qualifies as an “Expert” And How Can We Decide Who Is Trustworthy?
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Expertise is a slippery concept. Who has it, who claims it, and who attributes or yields it to whom is a culturally specific, sociological process. During the COVID-19 pandemic, we have witnessed a remarkable emergence of legitimate and not-so-legitimate scientists publicly claiming or being attributed to have academic expertise in precisely my field: infectious disease epidemiology. From any vantage point, it is clear that charlatans abound out there, garnering TV coverage and hundreds of thousands of Twitter followers based on loud opinions despite flimsy credentials. What is more interesting as an insider is the gradient of expertise beyond these obvious fakers.
A person's expertise is not a fixed attribute; it is a hierarchical trait defined relative to others. Despite my protestations, I am the go-to expert on every aspect of the pandemic to my family. To a reporter, I might do my best to answer a question about the immune response to SARS-CoV-2, noting that I'm not an immunologist. Among other academic scientists, my expertise is more well-defined as a subfield of epidemiology, and within that as a particular area within infectious disease epidemiology. There's a fractal quality to it; as you zoom in on a particular subject, a differentiation of expertise emerges among scientists who, from farther out, appear to be interchangeable.
We all have our scientific domain and are less knowledgeable outside it, of course, and we are often asked to comment on a broad range of topics. But many scientists without a track record in the field have become favorites among university administrators, senior faculty in unrelated fields, policymakers, and science journalists, using institutional prestige or social connections to promote themselves. This phenomenon leads to a distorted representation of science—and of academic scientists—in the public realm.
Trustworthy experts will direct you to others in their field who know more about particular topics, and will tend to be honest about what is and what isn't "in their lane."
Predictably, white male voices have been disproportionately amplified, and men are certainly over-represented in the category of those who use their connections to inappropriately claim expertise. Generally speaking, we are missing women, racial minorities, and global perspectives. This is not only important because it misrepresents who scientists are and reinforces outdated stereotypes that place white men in the Global North at the top of a credibility hierarchy. It also matters because it can promote bad science, and it passes over scientists who can lend nuance to the scientific discourse and give global perspectives on this quintessentially global crisis.
Also at work, in my opinion, are two biases within academia: the conflation of institutional prestige with individual expertise, and the bizarre hierarchy among scientists that attributes greater credibility to those in quantitative fields like physics. Regardless of mathematical expertise or institutional affiliation, lack of experience working with epidemiological data can lead to over-confidence in the deceptively simple mathematical models that we use to understand epidemics, as well as the inappropriate use of uncertain data to inform them. Prominent and vocal scientists from different quantitative fields have misapplied the methods of infectious disease epidemiology during the COVID-19 pandemic so far, creating enormous confusion among policymakers and the public. Early forecasts that predicted the epidemic would be over by now, for example, led to a sense that epidemiological models were all unreliable.
Meanwhile, legitimate scientific uncertainties and differences of opinion, as well as fundamentally different epidemic dynamics arising in diverse global contexts and in different demographic groups, appear in the press as an indistinguishable part of this general chaos. This leads many people to question whether the field has anything worthwhile to contribute, and muddies the facts about COVID-19 policies for reducing transmission that most experts agree on, like wearing masks and avoiding large indoor gatherings.
So how do we distinguish an expert from a charlatan? I believe a willingness to say "I don't know" and to openly describe uncertainties, nuances, and limitations of science are all good signs. Thoughtful engagement with questions and new ideas is also an indication of expertise, as opposed to arrogant bluster or a bullish insistence on a particular policy strategy regardless of context (which is almost always an attempt to hide a lack of depth of understanding). Trustworthy experts will direct you to others in their field who know more about particular topics, and will tend to be honest about what is and what isn't "in their lane." For example, some expertise is quite specific to a given subfield: epidemiologists who study non-infectious conditions or nutrition, for example, use different methods from those of infectious disease experts, because they generally don't need to account for the exponential growth that is inherent to a contagion process.
Academic scientists have a specific, technical contribution to make in containing the COVID-19 pandemic and in communicating research findings as they emerge. But the liminal space between scientists and the public is subject to the same undercurrents of sexism, racism, and opportunism that society and the academy have always suffered from. Although none of the proxies for expertise described above are fool-proof, they are at least indicative of integrity and humility—two traits the world is in dire need of at this moment in history.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
My Wife's Fight Against Cancer Inspired 38,000 People to Raise Millions for Research
It was 15 years ago this month, but I'll never forget those words. When my wife Jen and I asked her oncologist about our plans to start a family, he calmly replied, "Well, I wouldn't do so unless Dave is prepared to be a single father."
About 50 percent of all people with cancer have a rare type, like the one Jen was fighting.
Time stood still. The danger crystalized — we were in a battle for my beautiful bride's life, and the odds were not in our favor.
We felt every emotion expected. Anger, sadness, confusion, frustration, and especially fear. But we made a very intentional choice to take that fear, put it to the side, and do everything we could to live our lives together to the fullest.
We focused first on Jen's health and learned everything we could about MFH Sarcoma. I was with her every step of the way — for hundreds of medical appointments, six intense surgeries, and twenty different types of chemotherapy. During such a challenging time, our choice to reject fear allowed us to live our best lives. Our careers blossomed, we enjoyed several international vacations, and Jen inspired thousands of fellow patients through her blog and speeches.
When we researched treatment options we learned that Jen was not alone. About 50 percent of all people with cancer have a rare type, like the one Jen was fighting. However, rare cancers don't get the funding they desperately need so effective treatment options are hard to find. The lack of funding felt unfair — and urgent. We didn't worry about everything that can go wrong when starting a new venture. Instead, we jumped in head first and convinced a small group of friends and family to ride stationary bikes with us to raise money for rare cancer research.
Jen Goodman Linn, riding a stationary bike for Cycle for Survival.
(Courtesy David Linn)
From those humble beginnings, Cycle for Survival grew steadily. After starting from scratch, Jen and I ran Cycle for Survival on our own for two years. We quickly realized that if we wanted to help as many people as possible, we needed the best partners. In 2009, we agreed that Memorial Sloan Kettering Cancer Center would take over the ownership of Cycle for Survival and Equinox officially became the Founding Partner. Flash forward to today, and Cycle for Survival has raised more than $220 million! I'm proud that 100% of every donation, yes every penny, goes directly into life-saving rare cancer research within six months of the annual indoor cycling events, which now take place in 17 cities nationwide.
While Cycle for Survival's trajectory was heading straight up, Jen's health struggle was devastatingly swinging up and down. With her incredible spirit and tenacity, Jen would beat the cancer through chemo and surgery, but then it would frustratingly come back again and again. After going into remission six times, it returned with such a vengeance in 2011 that even the world's leading doctors were forced to say, "I'm sorry, there's nothing more we can do."
Those were the most difficult words I've ever heard, by far. I hope no other family has to hear these crushing words.
When Jen died soon after, I didn't know what would happen to me, to my life, and to Cycle for Survival. I do remember making two very important choices at the time. First, I chose to get out of bed and put one foot in front of the other. It wasn't easy. Tears, pain, and grief would hit at any hour of the day or night. I did have a great support network of family and friends who kept me moving forward. One friend in particular changed the route of her morning runs so that I would join her and start getting back to exercising.
My second key choice was to stay involved with Cycle for Survival. At times, it was an excruciatingly difficult decision because I felt the depth of my loss each and every time I stepped into one of the events. However, it was also rewarding and energizing because I could see firsthand how many people it was helping, even though it was too late for Jen.
I began to travel across the country with the Cycle for Survival staff. My hope was to spread the word about rare cancers; along the way I met a lot of wonderful people who shared their stories with me. What I soon realized is that each of us faces obstacles in our lives. For me, it was losing the person who I wanted to spend my life with. For others, it might be challenges with their kids or in their professional lives. The common theme is that we don't have control over the fact that we have to face these challenges. But the biggest lesson I've learned is that we very much do have a choice in how we react.
I made the choice to do everything I can to help rare cancer patients and their families and it has been transformative and healing for me. The small group who rode in the first Cycle for Survival event has grown into a powerful movement of nearly 40,000 riders making a real difference. If Jen were diagnosed today, there are new treatments available– including genomic sequencing, targeted therapies, and immunotherapies – that could help her. Those weren't even options a short time ago. That's the result of funding research.
A recent Cycle for Survival event shows the passion and power of the community.
(Courtesy David Linn)
I also want to share one more choice I made. Remember that friend who changed the route of her morning runs so I could start exercising after Jen died? Well, over the years friendship grew into love, and we're now building a home together and can't wait to see what the future holds for us.
So with all that in mind I ask – when you face those inevitable challenges in your life, how will you choose to react? Remember that even in the midst of hopelessness, you can find choices. Those will be the decisions that define and guide you.
Her Incredible Sense of Smell Led Scientists to Develop the First Parkinson's Test
Thirty-seven years ago, Joy Milne, a nurse from Perth, Scotland, noticed a musky odor coming from her husband, Les.
To her surprise, at a local support group meeting, she caught the familiar scent once again, hanging over the group like a cloud.
At first, Milne thought the smell was a result of bad hygiene and badgered her husband to take longer showers. But when the smell persisted, Milne learned to live with it, not wanting to hurt her husband's feelings.
Twelve years after she first noticed the "woodsy" smell, Les was diagnosed at the age of 44 with Parkinson's Disease, a neurodegenerative condition characterized by lack of dopamine production and loss of movement. Parkinson's Disease currently affects more than 10 million people worldwide.
Milne spent the next several years believing the strange smell was exclusive to her husband. But to her surprise, at a local support group meeting in 2012, she caught the familiar scent once again, hanging over the group like a cloud. Stunned, Milne started to wonder if the smell was the result of Parkinson's Disease itself.
Milne's discovery led her to Dr. Tilo Kunath, a neurobiologist at the Centre for Regenerative Medicine at the University of Edinburgh. Together, Milne, Kunath, and a host of other scientists would use Milne's unusual sense of smell to develop a new diagnostic test, now in development and poised to revolutionize the treatment of Parkinson's Disease.
"Joy was in the audience during a talk I was giving on my work, which has to do with Parkinson's and stem cell biology," Kunath says. "During the patient engagement portion of the talk, she asked me if Parkinson's had a smell to it." Confused, Kunath said he had never heard of this – but for months after his talk he continued to turn the question over in his mind.
Kunath knew from his research that the skin's microbiome changes during different disease processes, releasing metabolites that can give off odors. In the medical literature, diseases like melanoma and Type 2 diabetes have been known to carry a specific scent – but no such connection had been made with Parkinson's. If people could smell Parkinson's, he thought, then it stood to reason that those metabolites could be isolated, identified, and used to potentially diagnose Parkinson's by their presence alone.
First, Kunath and his colleagues decided to test Milne's sense of smell. "I got in touch with Joy again and we designed a protocol to test her sense of smell without her having to be around patients," says Kunath, which could have affected the validity of the test. In his spare time, Kunath collected t-shirt samples from people diagnosed with Parkinson's and from others without the diagnosis and gave them to Milne to smell. In 100 percent of the samples, Milne was able to detect whether a person had Parkinson's based on smell alone. Amazingly, Milne was even able to detect the "Parkinson's scent" in a shirt from the control group – someone who did not have a Parkinson's diagnosis, but would go on to be diagnosed nine months later.
From the initial study, the team discovered that Parkinson's did have a smell, that Milne – inexplicably – could detect it, and that she could detect it long before diagnosis like she had with her husband, Les. But the experiments revealed other things that the team hadn't been expecting.
"One surprising thing we learned from that experiment was that the odor was always located in the back of the shirt – never in the armpit, where we expected the smell to be," Kunath says. "I had a chance meeting with a dermatologist and he said the smell was due to the patient's sebum, which are greasy secretions that are really dense on your upper back. We have sweat glands, instead of sebum, in our armpits." Patients with Parkinson's are also known to have increased sebum production.
With the knowledge that a patient's sebum was the source of the unusual smell, researchers could go on to investigate exactly what metabolites were in the sebum and in what amounts. Kunath, along with his associate, Dr. Perdita Barran, collected and analyzed sebum samples from 64 participants across the United Kingdom. Once the samples were collected, Barran and others analyzed it using a method called gas chromatography mass spectrometry, or GS-MC, which separated, weighed and helped identify the individual compounds present in each sebum sample.
Barran's team can now correctly identify Parkinson's in nine out of 10 patients – a much quicker and more accurate way to diagnose than what clinicians do now.
"The compounds we've identified in the sebum are not unique to people with Parkinson's, but they are differently expressed," says Barran, a professor of mass spectrometry at the University of Manchester. "So this test we're developing now is not a black-and-white, do-you-have-something kind of test, but rather how much of these compounds do you have compared to other people and other compounds." The team identified over a dozen compounds that were present in the sebum of Parkinson's patients in much larger amounts than the control group.
Using only the GC-MS and a sebum swab test, Barran's team can now correctly identify Parkinson's in nine out of 10 patients – a much quicker and more accurate way to diagnose than what clinicians do now.
"At the moment, a clinical diagnosis is based on the patient's physical symptoms," Barran says, and determining whether a patient has Parkinson's is often a long and drawn-out process of elimination. "Doctors might say that a group of symptoms looks like Parkinson's, but there are other reasons people might have those symptoms, and it might take another year before they're certain," Barran says. "Some of those symptoms are just signs of aging, and other symptoms like tremor are present in recovering alcoholics or people with other kinds of dementia." People under the age of 40 with Parkinson's symptoms, who present with stiff arms, are often misdiagnosed with carpal tunnel syndrome, she adds.
Additionally, by the time physical symptoms are present, Parkinson's patients have already lost a substantial amount of dopamine receptors – about sixty percent -- in the brain's basal ganglia. Getting a diagnosis before physical symptoms appear would mean earlier interventions that could prevent dopamine loss and preserve regular movement, Barran says.
"Early diagnosis is good if it means there's a chance of early intervention," says Barran. "It stops the process of dopamine loss, which means that motor symptoms potentially will not happen, or the onset of symptoms will be substantially delayed." Barran's team is in the processing of streamlining the sebum test so that definitive results will be ready in just two minutes.
"What we're doing right now will be a very inexpensive test, a rapid-screen test, and that will encourage people to self-sample and test at home," says Barran. In addition to diagnosing Parkinson's, she says, this test could also be potentially useful to determine if medications were at a therapeutic dose in people who have the disease, since the odor is strongest in people whose symptoms are least controlled by medication.
"When symptoms are under control, the odor is lower," Barran says. "Potentially this would allow patients and clinicians to see whether their symptoms are being managed properly with medication, or perhaps if they're being overmedicated." Hypothetically, patients could also use the test to determine if interventions like diet and exercise are effective at keeping Parkinson's controlled.
"We hope within the next two to five years we will have a test available."
Barran is now running another clinical trial – one that determines whether they can diagnose at an earlier stage and whether they can identify a difference in sebum samples between different forms of Parkinson's or diseases that have Parkinson's-like symptoms, such as Lewy Body Dementia.
"Within the next one to two years, we hope to be running a trial in the Manchester area for those people who do not have motor symptoms but are at risk for developing dementia due to symptoms like loss of smell and sleep difficulty," Barran says. "If we can establish that, we can roll out a test that determines if you have Parkinson's or not with those first pre-motor symptoms, and then at what stage. We hope within the next two to five years we will have a test available."
But a definitive Parkinson's test, however revolutionary, would likely not be made available to the general population – at least, not for a while.
"We would likely first give this test to people who are at risk due to a genetic predisposition, or who are at risk based on prodomal symptoms, like people who suffer from a REM sleep disorder who have a 50 to 70 percent chance of developing Parkinson's within a ten year period," Barran says. "Those would be people who would benefit from early therapeutic intervention. For the normal population, it isn't beneficial at the moment to know until we have therapeutic interventions that can be useful."
Milne's husband, Les, passed away from complications of Parkinson's Disease in 2015. But thanks to him and the dedication of his wife, Joy, science may have found a way to someday prolong the lives of others with this devastating disease.
[Ed. Note: This hit article from our archives originally ran on September 3, 2019.]