Why Your Brain Falls for Misinformation – And How to Avoid It
Understanding the vulnerabilities of our own brains can help us guard against fake news.
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Whenever you hear something repeated, it feels more true. In other words, repetition makes any statement seem more accurate. So anything you hear again will resonate more each time it's said.
Do you see what I did there? Each of the three sentences above conveyed the same message. Yet each time you read the next sentence, it felt more and more true. Cognitive neuroscientists and behavioral economists like myself call this the "illusory truth effect."
Go back and recall your experience reading the first sentence. It probably felt strange and disconcerting, perhaps with a note of resistance, as in "I don't believe things more if they're repeated!"
Reading the second sentence did not inspire such a strong reaction. Your reaction to the third sentence was tame by comparison.
Why? Because of a phenomenon called "cognitive fluency," meaning how easily we process information. Much of our vulnerability to deception in all areas of life—including to fake news and misinformation—revolves around cognitive fluency in one way or another. And unfortunately, such misinformation can swing major elections.
The Lazy Brain
Our brains are lazy. The more effort it takes to process information, the more uncomfortable we feel about it and the more we dislike and distrust it.
By contrast, the more we like certain data and are comfortable with it, the more we feel that it's accurate. This intuitive feeling in our gut is what we use to judge what's true and false.
Yet no matter how often you heard that you should trust your gut and follow your intuition, that advice is wrong. You should not trust your gut when evaluating information where you don't have expert-level knowledge, at least when you don't want to screw up. Structured information gathering and decision-making processes help us avoid the numerous errors we make when we follow our intuition. And even experts can make serious errors when they don't rely on such decision aids.
These mistakes happen due to mental errors that scholars call "cognitive biases." The illusory truth effect is one of these mental blindspots; there are over 100 altogether. These mental blindspots impact all areas of our life, from health and politics to relationships and even shopping.
We pay the most attention to whatever we find most emotionally salient in our environment, as that's the information easiest for us to process.
The Maladapted Brain
Why do we have so many cognitive biases? It turns out that our intuitive judgments—our gut reactions, our instincts, whatever you call them—aren't adapted for the modern environment. They evolved from the ancestral savanna environment, when we lived in small tribes of 15–150 people and spent our time hunting and foraging.
It's not a surprise, when you think about it. Evolution works on time scales of many thousands of years; our modern informational environment has been around for only a couple of decades, with the rise of the internet and social media.
Unfortunately, that means we're using brains adapted for the primitive conditions of hunting and foraging to judge information and make decisions in a very different world. In the ancestral environment, we had to make quick snap judgments in order to survive, thrive, and reproduce; we're the descendants of those who did so most effectively.
In the modern environment, we can take our time to make much better judgments by using structured evaluation processes to protect yourself from cognitive biases. We have to train our minds to go against our intuitions if we want to figure out the truth and avoid falling for misinformation.
Yet it feels very counterintuitive to do so. Again, not a surprise: by definition, you have to go against your intuitions. It's not easy, but it's truly the only path if you don't want to be vulnerable to fake news.
The Danger of Cognitive Fluency and Illusory Truth
We already make plenty of mistakes by ourselves, without outside intervention. It's especially difficult to protect ourselves against those who know how to manipulate us. Unfortunately, the purveyors of misinformation excel at exploiting our cognitive biases to get us to buy into fake news.
Consider the illusory truth effect. Our vulnerability to it stems from how our brain processes novel stimuli. The first time we hear something new to us, it's difficult to process mentally. It has to integrate with our existing knowledge framework, and we have to build new neural pathways to make that happen. Doing so feels uncomfortable for our lazy brain, so the statement that we heard seems difficult to swallow to us.
The next time we hear that same thing, our mind doesn't have to build new pathways. It just has to go down the same ones it built earlier. Granted, those pathways are little more than trails, newly laid down and barely used. It's hard to travel down that newly established neural path, but much easier than when your brain had to lay down that trail. As a result, the statement is somewhat easier to swallow.
Each repetition widens and deepens the trail. Each time you hear the same thing, it feels more true, comfortable, and intuitive.
Does it work for information that seems very unlikely? Science says yes! Researchers found that the illusory truth effect applies strongly to implausible as well as plausible statements.
What about if you know better? Surely prior knowledge prevents this illusory truth! Unfortunately not: even if you know better, research shows you're still vulnerable to this cognitive bias, though less than those who don't have prior knowledge.
Sadly, people who are predisposed to more elaborate and sophisticated thinking—likely you, if you're reading the article—are more likely to fall for the illusory truth effect. And guess what: more sophisticated thinkers are also likelier than less sophisticated ones to fall for the cognitive bias known as the bias blind spot, where you ignore your own cognitive biases. So if you think that cognitive biases such as the illusory truth effect don't apply to you, you're likely deluding yourself.
That's why the purveyors of misinformation rely on repeating the same thing over and over and over and over again. They know that despite fact-checking, their repetition will sway people, even some of those who think they're invulnerable. In fact, believing that you're invulnerable will make you more likely to fall for this and other cognitive biases, since you won't be taking the steps necessary to address them.
Other Important Cognitive Biases
What are some other cognitive biases you need to beware? If you've heard of any cognitive biases, you've likely heard of the "confirmation bias." That refers to our tendency to look for and interpret information in ways that conform to our prior beliefs, intuitions, feelings, desires, and preferences, as opposed to the facts.
Again, cognitive fluency deserves blame. It's much easier to build neural pathways to information that we already possess, especially that around which we have strong emotions; it's much more difficult to break well-established neural pathways if we need to change our mind based on new information. Consequently, we instead look for information that's easy to accept, that which fits our prior beliefs. In turn, we ignore and even actively reject information that doesn't fit our beliefs.
Moreover, the more educated we are, the more likely we are to engage in such active rejection. After all, our smarts give us more ways of arguing against new information that counters our beliefs. That's why research demonstrates that the more educated you are, the more polarized your beliefs will be around scientific issues that have religious or political value overtones, such as stem cell research, human evolution, and climate change. Where might you be letting your smarts get in the way of the facts?
Our minds like to interpret the world through stories, meaning explanatory narratives that link cause and effect in a clear and simple manner. Such stories are a balm to our cognitive fluency, as our mind constantly looks for patterns that explain the world around us in an easy-to-process manner. That leads to the "narrative fallacy," where we fall for convincing-sounding narratives regardless of the facts, especially if the story fits our predispositions and our emotions.
You ever wonder why politicians tell so many stories? What about the advertisements you see on TV or video advertisements on websites, which tell very quick visual stories? How about salespeople or fundraisers? Sure, sometimes they cite statistics and scientific reports, but they spend much, much more time telling stories: simple, clear, compelling narratives that seem to make sense and tug at our heartstrings.
Now, here's something that's actually true: the world doesn't make sense. The world is not simple, clear, and compelling. The world is complex, confusing, and contradictory. Beware of simple stories! Look for complex, confusing, and contradictory scientific reports and high-quality statistics: they're much more likely to contain the truth than the easy-to-process stories.
Another big problem that comes from cognitive fluency: the "attentional bias." We pay the most attention to whatever we find most emotionally salient in our environment, as that's the information easiest for us to process. Most often, such stimuli are negative; we feel a lesser but real attentional bias to positive information.
That's why fear, anger, and resentment represent such powerful tools of misinformers. They know that people will focus on and feel more swayed by emotionally salient negative stimuli, so be suspicious of negative, emotionally laden data.
You should be especially wary of such information in the form of stories framed to fit your preconceptions and repeated. That's because cognitive biases build on top of each other. You need to learn about the most dangerous ones for evaluating reality clearly and making wise decisions, and watch out for them when you consume news, and in other life areas where you don't want to make poor choices.
Fixing Our Brains
Unfortunately, knowledge only weakly protects us from cognitive biases; it's important, but far from sufficient, as the study I cited earlier on the illusory truth effect reveals.
What can we do?
The easiest decision aid is a personal commitment to twelve truth-oriented behaviors called the Pro-Truth Pledge, which you can make by signing the pledge at ProTruthPledge.org. All of these behaviors stem from cognitive neuroscience and behavioral economics research in the field called debiasing, which refers to counterintuitive, uncomfortable, but effective strategies to protect yourself from cognitive biases.
What are these behaviors? The first four relate to you being truthful yourself, under the category "share truth." They're the most important for avoiding falling for cognitive biases when you share information:
Share truth
- Verify: fact-check information to confirm it is true before accepting and sharing it
- Balance: share the whole truth, even if some aspects do not support my opinion
- Cite: share my sources so that others can verify my information
- Clarify: distinguish between my opinion and the facts
The second set of four are about how you can best "honor truth" to protect yourself from cognitive biases in discussions with others:
Honor truth
- Acknowledge: when others share true information, even when we disagree otherwise
- Reevaluate: if my information is challenged, retract it if I cannot verify it
- Defend: defend others when they come under attack for sharing true information, even when we disagree otherwise
- Align: align my opinions and my actions with true information
The last four, under the category "encourage truth," promote broader patterns of truth-telling in our society by providing incentives for truth-telling and disincentives for deception:
Encourage truth
- Fix: ask people to retract information that reliable sources have disproved even if they are my allies
- Educate: compassionately inform those around me to stop using unreliable sources even if these sources support my opinion
- Defer: recognize the opinions of experts as more likely to be accurate when the facts are disputed
- Celebrate: those who retract incorrect statements and update their beliefs toward the truth
Peer-reviewed research has shown that taking the Pro-Truth Pledge is effective for changing people's behavior to be more truthful, both in their own statements and in interactions with others. I hope you choose to join the many thousands of ordinary citizens—and over 1,000 politicians and officials—who committed to this decision aid, as opposed to going with their gut.
[Adapted from: Dr. Gleb Tsipursky and Tim Ward, Pro Truth: A Practical Plan for Putting Truth Back Into Politics (Changemakers Books, 2020).]
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
A company uses AI to fight muscle loss and unhealthy aging
In December 2022, a company called BioAge Labs published findings on a drug that worked to prevent muscular atrophy, or the loss of muscle strength and mass, in older people.
There’s a growing need to slow down the aging process. The world’s population is getting older and, according to one estimate, 80 million Americans will be 65 or older by 2040. As we age, the risk of many chronic diseases goes up, from cancer to heart disease to Alzheimer’s.
BioAge Labs, a company based in California, is using genetic data to help people stay healthy for longer. CEO Kristen Fortney was inspired by the genetics of people who live long lives and resist many age-related diseases. In 2015, she started BioAge to study them and develop drug therapies based on the company’s learnings.
The team works with special biobanks that have been collecting blood samples and health data from individuals for up to 45 years. Using artificial intelligence, BioAge is able to find the distinctive molecular features that distinguish those who have healthy longevity from those who don’t.
In December 2022, BioAge published findings on a drug that worked to prevent muscular atrophy, or the loss of muscle strength and mass, in older people. Much of the research on aging has been in worms and mice, but BioAge is focused on human data, Fortney says. “This boosts our chances of developing drugs that will be safe and effective in human patients.”
How it works
With assistance from AI, BioAge measures more than 100,000 molecules in each blood sample, looking at proteins, RNA and metabolites, or small molecules that are produced through chemical processes. The company uses many techniques to identify these molecules, some of which convert the molecules into charged atoms and then separating them according to their weight and charge. The resulting data is very complex, with many thousands of data points from patients being followed over the decades.
BioAge validates its targets by examining whether a pathway going awry is actually linked to the development of diseases, based on the company’s analysis of biobank health records and blood samples. The team uses AI and machine learning to identify these pathways, and the key proteins in the unhealthy pathways become their main drug targets. “The approach taken by BioAge is an excellent example of how we can harness the power of big data and advances in AI technology to identify new drugs and therapeutic targets,” says Lorna Harries, a professor of molecular genetics at the University of Exeter Medical School.
Martin Borch Jensen is the founder of Gordian Biotechnology, a company focused on using gene therapy to treat aging. He says BioAge’s use of AI allows them to speed up the process of finding promising drug candidates. However, it remains a challenge to separate pathologies from aspects of the natural aging process that aren’t necessarily bad. “Some of the changes are likely protective responses to things going wrong,” Jensen says. “Their data doesn’t…distinguish that so they’ll need to validate and be clever.”
Developing a drug for muscle loss
BioAge decided to focus on muscular atrophy because it affects many elderly people, making it difficult to perform everyday activities and increasing the risk of falls. Using the biobank samples, the team modeled different pathways that looked like they could improve muscle health. They found that people who had faster walking speeds, better grip strength and lived longer had higher levels of a protein called apelin.
Apelin is a peptide, or a small protein, that circulates in the blood. It is involved in the process by which exercise increases and preserves muscle mass. BioAge wondered if they could prevent muscular atrophy by increasing the amount of signaling in the apelin pathway. Instead of the long process of designing a drug, they decided to repurpose an existing drug made by another biotech company. This company, called Amgen, had explored the drug as a way to treat heart failure. It didn’t end up working for that purpose, but BioAge took note that the drug did seem to activate the apelin pathway.
BioAge tested its new, repurposed drug, BGE-105, and, in a phase 1 clinical trial, it protected subjects from getting muscular atrophy compared to a placebo group that didn’t receive the drug. Healthy volunteers over age 65 received infusions of the drug during 10 days spent in bed, as if they were on bed rest while recovering from an illness or injury; the elderly are especially vulnerable to muscle loss in this situation. The 11 people taking BGE-105 showed a 100 percent improvement in thigh circumference compared to 10 people taking the placebo. Ultrasound observations also revealed that the group taking the durg had enhanced muscle quality and a 73 percent increase in muscle thickness. One volunteer taking BGE-105 did have muscle loss compared to the the placebo group.
Heather Whitson, the director of the Duke University Centre for the study of aging and human development, says that, overall, the results are encouraging. “The clinical findings so far support the premise that AI can help us sort through enormous amounts of data and identify the most promising points for beneficial interventions.”
More studies are needed to find out which patients benefit the most and whether there are side effects. “I think further studies will answer more questions,” Whitson says, noting that BGE-105 was designed to enhance only one aspect of physiology associated with exercise, muscle strength. But exercise itself has many other benefits on mood, sleep, bones and glucose metabolism. “We don’t know whether BGE-105 will impact these other outcomes,” she says.
The future
BioAge is planning phase 2 trials for muscular atrophy in patients with obesity and those who have been hospitalized in an intensive care unit. Using the data from biobanks, they’ve also developed another drug, BGE-100, to treat chronic inflammation in the brain, a condition that can worsen with age and contributes to neurodegenerative diseases. The team is currently testing the drug in animals to assess its effects and find the right dose.
BioAge envisions that its drugs will have broader implications for health than treating any one specific disease. “Ultimately, we hope to pioneer a paradigm shift in healthcare, from treatment to prevention, by targeting the root causes of aging itself,” Fortney says. “We foresee a future where healthy longevity is within reach for all.”
How old fishing nets turn into chairs, car mats and Prada bags
A company called Aquafil is turning the fibers from fishing nets and old carpets into new threads for chairs, car mats, bikinis and Prada bags.
Discarded nylon fishing nets in the oceans are among the most harmful forms of plastic pollution. Every year, about 640,000 tons of fishing gear are left in our oceans and other water bodies to turn into death traps for marine life. London-based non-profit World Animal Protection estimates that entanglement in this “ghost gear” kills at least 136,000 seals, sea lions and large whales every year. Experts are challenged to estimate how many birds, turtles, fish and other species meet the same fate because the numbers are so high.
Since 2009, Giulio Bonazzi, the son of a small textile producer in northern Italy, has been working on a solution: an efficient recycling process for nylon. As CEO and chairman of a company called Aquafil, Bonazzi is turning the fibers from fishing nets – and old carpets – into new threads for car mats, Adidas bikinis, environmentally friendly carpets and Prada bags.
For Bonazzi, shifting to recycled nylon was a question of survival for the family business. His parents founded a textile company in 1959 in a garage in Verona, Italy. Fifteen years later, they started Aquafil to produce nylon for making raincoats, an enterprise that led to factories on three continents. But before the turn of the century, cheap products from Asia flooded the market and destroyed Europe’s textile production. When Bonazzi had finished his business studies and prepared to take over the family company, he wondered how he could produce nylon, which is usually produced from petrochemicals, in a way that was both successful and ecologically sustainable.
The question led him on an intellectual journey as he read influential books by activists such as world-renowned marine biologist Sylvia Earle and got to know Michael Braungart, who helped develop the Cradle-to-Cradle ethos of a circular economy. But the challenges of applying these ideologies to his family business were steep. Although fishing nets have become a mainstay of environmental fashion ads—and giants like Dupont and BASF have made breakthroughs in recycling nylon—no one had been able to scale up these efforts.
For ten years, Bonazzi tinkered with ideas for a proprietary recycling process. “It’s incredibly difficult because these products are not made to be recycled,” Bonazzi says. One complication is the variety of materials used in older carpets. “They are made to be beautiful, to last, to be useful. We vastly underestimated the difficulty when we started.”
Soon it became clear to Bonazzi that he needed to change the entire production process. He found a way to disintegrate old fibers with heat and pull new strings from the discarded fishing nets and carpets. In 2022, his company Aquafil produced more than 45,000 tons of Econyl, which is 100% recycled nylon, from discarded waste.
More than half of Aquafil’s recyclate is from used goods. According to the company, the recycling saves 90 percent of the CO2 emissions compared to the production of conventional nylon. That amounts to saving 57,100 tons of CO2 equivalents for every 10,000 tons of Econyl produced.
Bonazzi collects fishing nets from all over the world, including Norway and Chile—which have the world’s largest salmon productions—in addition to the Mediterranean, Turkey, India, Japan, Thailand, the Philippines, Pakistan, and New Zealand. He counts the government leadership of Seychelles as his most recent client; the island has prohibited ships from throwing away their fishing nets, creating the demand for a reliable recycler. With nearly 3,000 employees, Aquafil operates almost 40 collection and production sites in a dozen countries, including four collection sites for old carpets in the U.S., located in California and Arizona.
First, the dirty nets are gathered, washed and dried. Bonazzi explains that nets often have been treated with antifouling agents such as copper oxide. “We recycle the coating separately,” he says via Zoom from his home near Verona. “Copper oxide is a useful substance, why throw it away?”
Still, only a small percentage of Aquafil’s products are made from nets fished out of the ocean, so your new bikini may not have saved a strangled baby dolphin. “Generally, nylon recycling is a good idea,” says Christian Schiller, the CEO of Cirplus, the largest global marketplace for recyclates and plastic waste. “But contrary to what consumers think, people rarely go out to the ocean to collect ghost nets. Most are old, discarded nets collected on land. There’s nothing wrong with this, but I find it a tad misleading to label the final products as made from ‘ocean plastic,’ prompting consumers to think they’re helping to clean the oceans by buying these products.”
Aquafil gets most of its nets from aqua farms. Surprisingly, one of Aquafil’s biggest problems is finding enough waste. “I know, it’s hard to believe because waste is everywhere,” Bonazzi says. “But we need to find it in reliable quantity and quality.” He has invested millions in establishing reliable logistics to source the fishing nets. Then the nets get shredded into granules that can be turned into car mats for the new Hyundai Ioniq 5 or a Gucci swimsuit.
The process works similarly with carpets. In the U.S. alone, 3.5 billion pounds of carpet are discarded in landfills every year, and less than 3 percent are currently recycled. Aquafil has built a recycling plant in Phoenix to help divert 12,500 tons of carpets from the landfill every year. The carpets are shredded and deconstructed into three components: fillers such as calcium carbonate will be reused in the cement industry, synthetic fibers like polypropylene can be used for engineering plastics, and nylon. Only the pelletized nylon gets shipped back to Europe for the production of Econyl. “We ship only what’s necessary,” Bonazzi says. Nearly 50 percent of his nylon in Italy and Slovenia is produced from recyclate, and he hopes to increase the percentage to two-thirds in the next two years.
His clients include Interface, the leading world pioneer for sustainable flooring, and many other carpet producers plus more than 2500 fashion labels, including Gucci, Prada, Patagonia, Louis Vuitton, Adidas and Stella McCartney. “Stella McCartney just introduced a parka that’s made 100 percent from Econyl,” Bonazzi says. “We’re also in a lot of sportswear because Nylon is a good fabric for swimwear and for yoga clothes.” Next, he’s looking into sunglasses and chairs made with Econyl - for instance, the flexible ergonomic noho chair, designed by New Zealand company Formway.
“When I look at a landfill, I see a gold mine," Bonazzi says.
“Bonazzi decided many years ago to invest in the production of recycled nylon though industry giants halted similar plans after losing large investments,” says Anika Herrmann, vice president of the German Greentech-competitor Camm Solutions, which creates bio-based polymers from cane sugar and other ag waste. “We need role models like Bonazzi who create sustainable solutions with courage and a pioneering spirit. Like Aquafil, we count on strategic partnerships to enable fast upscaling along the entire production chain.”
Bonazzi’s recycled nylon is still five to 10 percent more expensive than conventionally produced material. However, brands are increasingly bending to the pressure of eco-conscious consumers who demand sustainable fashion. What helped Bonazzi was the recent rise of oil prices and the pressure on industries to reduce their carbon footprint. Now Bonazzi says, “When I look at a landfill, I see a gold mine.”
Ideally, the manufacturers take the products back when the client is done with it, and because the nylon can theoretically be reused nearly infinitely, the chair or bikini could be made into another chair or bikini. “But honestly,” Bonazzi half-jokes, “if someone returns a McCartney parka to me, I’ll just resell it because it’s so expensive.”
The next step: Bonazzi wants to reshape the entire nylon industry by pivoting from post-consumer nylon to plant-based nylon. In 2017, he began producing “nylon-6,” together with Genomatica in San Diego. The process uses sugar instead of petroleum. “The idea is to make the very same molecule from sugar, not from oil,” he says. The demonstration plant in Ljubljana, Slovenia, has already produced several hundred tons of nylon, and Genomatica is collaborating with Lululemon to produce plant-based yoga wear.
Bonazzi acknowledges that his company needs a few more years before the technology is ready to meet his ultimate goal, producing only recyclable products with no petrochemicals, low emissions and zero waste on an industrial scale. “Recycling is not enough,” he says. “You also need to produce the primary material in a sustainable way, with a low carbon footprint.”