In The Fake News Era, Are We Too Gullible? No, Says Cognitive Scientist
One of the oddest political hoaxes of recent times was Pizzagate, in which conspiracy theorists claimed that Hillary Clinton and her 2016 campaign chief ran a child sex ring from the basement of a Washington, DC, pizzeria.
To fight disinformation more effectively, he suggests, humans need to stop believing in one thing above all: our own gullibility.
Millions of believers spread the rumor on social media, abetted by Russian bots; one outraged netizen stormed the restaurant with an assault rifle and shot open what he took to be the dungeon door. (It actually led to a computer closet.) Pundits cited the imbroglio as evidence that Americans had lost the ability to tell fake news from the real thing, putting our democracy in peril.
Such fears, however, are nothing new. "For most of history, the concept of widespread credulity has been fundamental to our understanding of society," observes Hugo Mercier in Not Born Yesterday: The Science of Who We Trust and What We Believe (Princeton University Press, 2020). In the fourth century BCE, he points out, the historian Thucydides blamed Athens' defeat by Sparta on a demagogue who hoodwinked the public into supporting idiotic military strategies; Plato extended that argument to condemn democracy itself. Today, atheists and fundamentalists decry one another's gullibility, as do climate-change accepters and deniers. Leftists bemoan the masses' blind acceptance of the "dominant ideology," while conservatives accuse those who do revolt of being duped by cunning agitators.
What's changed, all sides agree, is the speed at which bamboozlement can propagate. In the digital age, it seems, a sucker is born every nanosecond.
The Case Against Credulity
Yet Mercier, a cognitive scientist at the Jean Nicod Institute in Paris, thinks we've got the problem backward. To fight disinformation more effectively, he suggests, humans need to stop believing in one thing above all: our own gullibility. "We don't credulously accept whatever we're told—even when those views are supported by the majority of the population, or by prestigious, charismatic individuals," he writes. "On the contrary, we are skilled at figuring out who to trust and what to believe, and, if anything, we're too hard rather than too easy to influence."
He bases those contentions on a growing body of research in neuropsychiatry, evolutionary psychology, and other fields. Humans, Mercier argues, are hardwired to balance openness with vigilance when assessing communicated information. To gauge a statement's accuracy, we instinctively test it from many angles, including: Does it jibe with what I already believe? Does the speaker share my interests? Has she demonstrated competence in this area? What's her reputation for trustworthiness? And, with more complex assertions: Does the argument make sense?
This process, Mercier says, enables us to learn much more from one another than do other animals, and to communicate in a far more complex way—key to our unparalleled adaptability. But it doesn't always save us from trusting liars or embracing demonstrably false beliefs. To better understand why, leapsmag spoke with the author.
How did you come to write Not Born Yesterday?
In 2010, I collaborated with the cognitive scientist Dan Sperber and some other colleagues on a paper called "Epistemic Vigilance," which laid out the argument that evolutionarily, it would make no sense for humans to be gullible. If you can be easily manipulated and influenced, you're going to be in major trouble. But as I talked to people, I kept encountering resistance. They'd tell me, "No, no, people are influenced by advertising, by political campaigns, by religious leaders." I started doing more research to see if I was wrong, and eventually I had enough to write a book.
With all the talk about "fake news" these days, the topic has gotten a lot more timely.
Yes. But on the whole, I'm skeptical that fake news matters very much. And all the energy we spend fighting it is energy not spent on other pursuits that may be better ways of improving our informational environment. The real challenge, I think, is not how to shut up people who say stupid things on the internet, but how to make it easier for people who say correct things to convince people.
"History shows that the audience's state of mind and material conditions matter more than the leader's powers of persuasion."
You start the book with an anecdote about your encounter with a con artist several years ago, who scammed you out of 20 euros. Why did you choose that anecdote?
Although I'm arguing that people aren't generally gullible, I'm not saying we're completely impervious to attempts at tricking us. It's just that we're much better than we think at resisting manipulation. And while there's a risk of trusting someone who doesn't deserve to be trusted, there's also a risk of not trusting someone who could have been trusted. You miss out on someone who could help you, or from whom you might have learned something—including figuring out who to trust.
You argue that in humans, vigilance and open-mindedness evolved hand-in-hand, leading to a set of cognitive mechanisms you call "open vigilance."
There's a common view that people start from a state of being gullible and easy to influence, and get better at rejecting information as they become smarter and more sophisticated. But that's not what really happens. It's much harder to get apes than humans to do anything they don't want to do, for example. And research suggests that over evolutionary time, the better our species became at telling what we should and shouldn't listen to, the more open to influence we became. Even small children have ways to evaluate what people tell them.
The most basic is what I call "plausibility checking": if you tell them you're 200 years old, they're going to find that highly suspicious. Kids pay attention to competence; if someone is an expert in the relevant field, they'll trust her more. They're likelier to trust someone who's nice to them. My colleagues and I have found that by age 2 ½, children can distinguish between very strong and very weak arguments. Obviously, these skills keep developing throughout your life.
But you've found that even the most forceful leaders—and their propaganda machines—have a hard time changing people's minds.
Throughout history, there's been this fear of demagogues leading whole countries into terrible decisions. In reality, these leaders are mostly good at feeling the crowd and figuring out what people want to hear. They're not really influencing [the masses]; they're surfing on pre-existing public opinion. We know from a recent study, for instance, that if you match cities in which Hitler gave campaign speeches in the late '20s through early '30s with similar cities in which he didn't give campaign speeches, there was no difference in vote share for the Nazis. Nazi propaganda managed to make Germans who were already anti-Semitic more likely to express their anti-Semitism or act on it. But Germans who were not already anti-Semitic were completely inured to the propaganda.
So why, in totalitarian regimes, do people seem so devoted to the ruler?
It's not a very complex psychology. In these regimes, the slightest show of discontent can be punished by death, or by you and your whole family being sent to a labor camp. That doesn't mean propaganda has no effect, but you can explain people's obedience without it.
What about cult leaders and religious extremists? Their followers seem willing to believe anything.
Prophets and preachers can inspire the kind of fervor that leads people to suicidal acts or doomed crusades. But history shows that the audience's state of mind and material conditions matter more than the leader's powers of persuasion. Only when people are ready for extreme actions can a charismatic figure provide the spark that lights the fire.
Once a religion becomes ubiquitous, the limits of its persuasive powers become clear. Every anthropologist knows that in societies that are nominally dominated by orthodox belief systems—whether Christian or Muslim or anything else—most people share a view of God, or the spirit, that's closer to what you find in societies that lack such religions. In the Middle Ages, for instance, you have records of priests complaining of how unruly the people are—how they spend the whole Mass chatting or gossiping, or go on pilgrimages mostly because of all the prostitutes and wine-drinking. They continue pagan practices. They resist attempts to make them pay tithes. It's very far from our image of how much people really bought the dominant religion.
"The mainstream media is extremely reliable. The scientific consensus is extremely reliable."
And what about all those wild rumors and conspiracy theories on social media? Don't those demonstrate widespread gullibility?
I think not, for two reasons. One is that most of these false beliefs tend to be held in a way that's not very deep. People may say Pizzagate is true, yet that belief doesn't really interact with the rest of their cognition or their behavior. If you really believe that children are being abused, then trying to free them is the moral and rational thing to do. But the only person who did that was the guy who took his assault weapon to the pizzeria. Most people just left one-star reviews of the restaurant.
The other reason is that most of these beliefs actually play some useful role for people. Before any ethnic massacre, for example, rumors circulate about atrocities having been committed by the targeted minority. But those beliefs aren't what's really driving the phenomenon. In the horrendous pogrom of Kishinev, Moldova, 100 years ago, you had these stories of blood libel—a child disappeared, typical stuff. And then what did the Christian inhabitants do? They raped the [Jewish] women, they pillaged the wine stores, they stole everything they could. They clearly wanted to get that stuff, and they made up something to justify it.
Where do skeptics like climate-change deniers and anti-vaxxers fit into the picture?
Most people in most countries accept that vaccination is good and that climate change is real and man-made. These ideas are deeply counter-intuitive, so the fact that scientists were able to get them across is quite fascinating. But the environment in which we live is vastly different from the one in which we evolved. There's a lot more information, which makes it harder to figure out who we can trust. The main effect is that we don't trust enough; we don't accept enough information. We also rely on shortcuts and heuristics—coarse cues of trustworthiness. There are people who abuse these cues. They may have a PhD or an MD, and they use those credentials to help them spread messages that are not true and not good. Mostly, they're affirming what people want to believe, but they may also be changing minds at the margins.
How can we improve people's ability to resist that kind of exploitation?
I wish I could tell you! That's literally my next project. Generally speaking, though, my advice is very vanilla. The mainstream media is extremely reliable. The scientific consensus is extremely reliable. If you trust those sources, you'll go wrong in a very few cases, but on the whole, they'll probably give you good results. Yet a lot of the problems that we attribute to people being stupid and irrational are not entirely their fault. If governments were less corrupt, if the pharmaceutical companies were irreproachable, these problems might not go away—but they would certainly be minimized.
If you look back on the last century of scientific achievements, you might notice that most of the scientists we celebrate are overwhelmingly white, while scientists of color take a backseat. Since the Nobel Prize was introduced in 1901, for example, no black scientists have landed this prestigious award.
The work of black women scientists has gone unrecognized in particular. Their work uncredited and often stolen, black women have nevertheless contributed to some of the most important advancements of the last 100 years, from the polio vaccine to GPS.
Here are five black women who have changed science forever.
Dr. May Edward Chinn
Dr. May Edward Chinn practicing medicine in Harlem
George B. Davis, PhD.
Chinn was born to poor parents in New York City just before the start of the 20th century. Although she showed great promise as a pianist, playing with the legendary musician Paul Robeson throughout the 1920s, she decided to study medicine instead. Chinn, like other black doctors of the time, were barred from studying or practicing in New York hospitals. So Chinn formed a private practice and made house calls, sometimes operating in patients’ living rooms, using an ironing board as a makeshift operating table.
Chinn worked among the city’s poor, and in doing this, started to notice her patients had late-stage cancers that often had gone undetected or untreated for years. To learn more about cancer and its prevention, Chinn begged information off white doctors who were willing to share with her, and even accompanied her patients to other clinic appointments in the city, claiming to be the family physician. Chinn took this information and integrated it into her own practice, creating guidelines for early cancer detection that were revolutionary at the time—for instance, checking patient health histories, checking family histories, performing routine pap smears, and screening patients for cancer even before they showed symptoms. For years, Chinn was the only black female doctor working in Harlem, and she continued to work closely with the poor and advocate for early cancer screenings until she retired at age 81.
Alice Ball
Pictorial Press Ltd/Alamy
Alice Ball was a chemist best known for her groundbreaking work on the development of the “Ball Method,” the first successful treatment for those suffering from leprosy during the early 20th century.
In 1916, while she was an undergraduate student at the University of Hawaii, Ball studied the effects of Chaulmoogra oil in treating leprosy. This oil was a well-established therapy in Asian countries, but it had such a foul taste and led to such unpleasant side effects that many patients refused to take it.
So Ball developed a method to isolate and extract the active compounds from Chaulmoogra oil to create an injectable medicine. This marked a significant breakthrough in leprosy treatment and became the standard of care for several decades afterward.
Unfortunately, Ball died before she could publish her results, and credit for this discovery was given to another scientist. One of her colleagues, however, was able to properly credit her in a publication in 1922.
Henrietta Lacks
onathan Newton/The Washington Post/Getty
The person who arguably contributed the most to scientific research in the last century, surprisingly, wasn’t even a scientist. Henrietta Lacks was a tobacco farmer and mother of five children who lived in Maryland during the 1940s. In 1951, Lacks visited Johns Hopkins Hospital where doctors found a cancerous tumor on her cervix. Before treating the tumor, the doctor who examined Lacks clipped two small samples of tissue from Lacks’ cervix without her knowledge or consent—something unthinkable today thanks to informed consent practices, but commonplace back then.
As Lacks underwent treatment for her cancer, her tissue samples made their way to the desk of George Otto Gey, a cancer researcher at Johns Hopkins. He noticed that unlike the other cell cultures that came into his lab, Lacks’ cells grew and multiplied instead of dying out. Lacks’ cells were “immortal,” meaning that because of a genetic defect, they were able to reproduce indefinitely as long as certain conditions were kept stable inside the lab.
Gey started shipping Lacks’ cells to other researchers across the globe, and scientists were thrilled to have an unlimited amount of sturdy human cells with which to experiment. Long after Lacks died of cervical cancer in 1951, her cells continued to multiply and scientists continued to use them to develop cancer treatments, to learn more about HIV/AIDS, to pioneer fertility treatments like in vitro fertilization, and to develop the polio vaccine. To this day, Lacks’ cells have saved an estimated 10 million lives, and her family is beginning to get the compensation and recognition that Henrietta deserved.
Dr. Gladys West
Andre West
Gladys West was a mathematician who helped invent something nearly everyone uses today. West started her career in the 1950s at the Naval Surface Warfare Center Dahlgren Division in Virginia, and took data from satellites to create a mathematical model of the Earth’s shape and gravitational field. This important work would lay the groundwork for the technology that would later become the Global Positioning System, or GPS. West’s work was not widely recognized until she was honored by the US Air Force in 2018.
Dr. Kizzmekia "Kizzy" Corbett
TIME Magazine
At just 35 years old, immunologist Kizzmekia “Kizzy” Corbett has already made history. A viral immunologist by training, Corbett studied coronaviruses at the National Institutes of Health (NIH) and researched possible vaccines for coronaviruses such as SARS (Severe Acute Respiratory Syndrome) and MERS (Middle East Respiratory Syndrome).
At the start of the COVID pandemic, Corbett and her team at the NIH partnered with pharmaceutical giant Moderna to develop an mRNA-based vaccine against the virus. Corbett’s previous work with mRNA and coronaviruses was vital in developing the vaccine, which became one of the first to be authorized for emergency use in the United States. The vaccine, along with others, is responsible for saving an estimated 14 million lives.On today’s episode of Making Sense of Science, I’m honored to be joined by Dr. Paul Song, a physician, oncologist, progressive activist and biotech chief medical officer. Through his company, NKGen Biotech, Dr. Song is leveraging the power of patients’ own immune systems by supercharging the body’s natural killer cells to make new treatments for Alzheimer’s and cancer.
Whereas other treatments for Alzheimer’s focus directly on reducing the build-up of proteins in the brain such as amyloid and tau in patients will mild cognitive impairment, NKGen is seeking to help patients that much of the rest of the medical community has written off as hopeless cases, those with late stage Alzheimer’s. And in small studies, NKGen has shown remarkable results, even improvement in the symptoms of people with these very progressed forms of Alzheimer’s, above and beyond slowing down the disease.
In the realm of cancer, Dr. Song is similarly setting his sights on another group of patients for whom treatment options are few and far between: people with solid tumors. Whereas some gradual progress has been made in treating blood cancers such as certain leukemias in past few decades, solid tumors have been even more of a challenge. But Dr. Song’s approach of using natural killer cells to treat solid tumors is promising. You may have heard of CAR-T, which uses genetic engineering to introduce cells into the body that have a particular function to help treat a disease. NKGen focuses on other means to enhance the 40 plus receptors of natural killer cells, making them more receptive and sensitive to picking out cancer cells.
Paul Y. Song, MD is currently CEO and Vice Chairman of NKGen Biotech. Dr. Song’s last clinical role was Asst. Professor at the Samuel Oschin Cancer Center at Cedars Sinai Medical Center.
Dr. Song served as the very first visiting fellow on healthcare policy in the California Department of Insurance in 2013. He is currently on the advisory board of the Pritzker School of Molecular Engineering at the University of Chicago and a board member of Mercy Corps, The Center for Health and Democracy, and Gideon’s Promise.
Dr. Song graduated with honors from the University of Chicago and received his MD from George Washington University. He completed his residency in radiation oncology at the University of Chicago where he served as Chief Resident and did a brachytherapy fellowship at the Institute Gustave Roussy in Villejuif, France. He was also awarded an ASTRO research fellowship in 1995 for his research in radiation inducible gene therapy.
With Dr. Song’s leadership, NKGen Biotech’s work on natural killer cells represents cutting-edge science leading to key findings and important pieces of the puzzle for treating two of humanity’s most intractable diseases.
Show links
- Paul Song LinkedIn
- NKGen Biotech on Twitter - @NKGenBiotech
- NKGen Website: https://nkgenbiotech.com/
- NKGen appoints Paul Song
- Patient Story: https://pix11.com/news/local-news/long-island/promising-new-treatment-for-advanced-alzheimers-patients/
- FDA Clearance: https://nkgenbiotech.com/nkgen-biotech-receives-ind-clearance-from-fda-for-snk02-allogeneic-natural-killer-cell-therapy-for-solid-tumors/Q3 earnings data: https://www.nasdaq.com/press-release/nkgen-biotech-inc.-reports-third-quarter-2023-financial-results-and-business