Sloppy Science Happens More Than You Think
Manipulating DNA through gene editing.
The media loves to tout scientific breakthroughs, and few are as toutable – and in turn, have been as touted – as CRISPR. This method of targeted DNA excision was discovered in bacteria, which use it as an adaptive immune system to combat reinfection with a previously encountered virus.
Shouldn't the editors at a Nature journal know better than to have published an incorrect paper in the first place?
It is cool on so many levels: not only is the basic function fascinating, reminding us that we still have more to discover about even simple organisms that we thought we knew so well, but the ability it grants us to remove and replace any DNA of interest has almost limitless applications in both the lab and the clinic. As if that didn't make it sexy enough, add in a bicoastal, male-female, very public and relatively ugly patent battle, and the CRISPR story is irresistible.
And then last summer, a bombshell dropped. The prestigious journal Nature Methods published a paper in which the authors claimed that CRISPR could cause many unintended mutations, rendering it unfit for clinical use. Havoc duly ensued; stocks in CRISPR-based companies plummeted. Thankfully, the authors of the offending paper were responsible, good scientists; they reassessed, then recanted. Their attention- and headline- grabbing results were wrong, and they admitted as much, leading Nature Methods to formally retract the paper this spring.
How did this happen? Shouldn't the editors at a Nature journal know better than to have published this in the first place?
Alas, high-profile scientific journals publish misleading and downright false results fairly regularly. Some errors are unavoidable – that's how the scientific method works. Hypotheses and conclusions will invariably be overturned as new data becomes available and new technologies are developed that allow for deeper and deeper studies. That's supposed to happen. But that's not what we're talking about here. Nor are we talking about obvious offenses like outright plagiarism. We're talking about mistakes that are avoidable, and that still have serious ramifications.
The cultures of both industry and academia promote research that is poorly designed and even more poorly analyzed.
Two parties are responsible for a scientific publication, and thus two parties bear the blame when things go awry: the scientists who perform and submit the work, and the journals who publish it. Unfortunately, both are incentivized for speedy and flashy publications, and not necessarily for correct publications. It is hardly a surprise, then, that we end up with papers that are speedy and flashy – and not necessarily correct.
"Scientists don't lie and submit falsified data," said Andy Koff, a professor of Molecular Biology at Sloan Kettering Institute, the basic research arm of Memorial Sloan Kettering Cancer Center. Richard Harris, who wrote the book on scientific misconduct running the gamut from unconscious bias and ignorance to more malicious fraudulence, largely concurs (full disclosure: I reviewed the book here). "Scientists want to do good science and want to be recognized as such," he said. But even so, the cultures of both industry and academia promote research that is poorly designed and even more poorly analyzed. In Rigor Mortis: How Sloppy Science Creates Worthless Cures, Crushes Hope, and Wastes Millions, Harris describes how scientists must constantly publish in order to maintain their reputations and positions, to get grants and tenure and students. "They are disincentivized from doing that last extra experiment to prove their results," he said; it could prove too risky if it could cost them a publication.
Ivan Oransky and Adam Marcus founded Retraction Watch, a blog that tracks the retraction of scientific papers, in 2010. Oransky pointed out that blinded peer review – the pride and joy of the scientific publishing enterprise – is a large part of the problem. "Pre-publication peer review is still important, but we can't treat it like the only check on the system. Papers are being reviewed by non-experts, and reviewers are asked to review papers only tangentially related to their field. Moreover, most peer reviewers don't look at the underlying or raw data, even when it is available. How then can they tell if the analysis is flawed or the data is accurate?" he wondered.
Mistaken publications also erode the public's opinion of legitimate science, which is problematic since that opinion isn't especially high to begin with.
Koff agreed that anonymous peer review is valuable, but severely flawed. "Blinded review forces a collective view of importance," he said. "If an article disagrees with the reviewer's worldview, the article gets rejected or forced to adhere to that worldview – even if that means pushing the data someplace it shouldn't necessarily go." We have lost the scientific principle behind review, he thinks, which was to critically analyze a paper. But instead of challenging fundamental assumptions within a paper, reviewers now tend to just ask for more and more supplementary data. And don't get him started on editors. "Editors are supposed to arbitrate between reviewers and writers and they have completely abdicated this responsibility, at every journal. They do not judge, and that's a real failing."
Harris laments the wasted time, effort, and resources that result when erroneous ideas take hold in a field, not to mention lives lost when drug discovery is predicated on basic science findings that end up being wrong. "When no one takes the time, care, and money to reproduce things, science isn't stopping – but it is slowing down," he noted. Mistaken publications also erode the public's opinion of legitimate science, which is problematic since that opinion isn't especially high to begin with.
Scientists and publishers don't only cause the problem, though – they may also provide the solution. Both camps are increasingly recognizing and dealing with the crisis. The self-proclaimed "data thugs" Nick Brown and James Heathers use pretty basic arithmetic to reveal statistical errors in papers. The microbiologist Elisabeth Bik scans the scientific literature for problematic images "in her free time." The psychologist Brian Nosek founded the Center for Open Science, a non-profit organization dedicated to promoting openness, integrity, and reproducibility in scientific research. The Nature family of journals – yes, the one responsible for the latest CRISPR fiasco – has its authors complete a checklist to combat irreproducibility, à la Atul Gawande. And Nature Communications, among other journals, uses transparent peer review, in which authors can opt to have the reviews of their manuscript published anonymously alongside the completed paper. This practice "shows people how the paper evolved," said Koff "and keeps the reviewer and editor accountable. Did the reviewer identify the major problems with the paper? Because there are always major problems with a paper."
The upcoming vaccine is changing the way we look at treating one of the country’s deadliest cancers.
Last week, researchers at the University of Oxford announced that they have received funding to create a brand new way of preventing ovarian cancer: A vaccine. The vaccine, known as OvarianVax, will teach the immune system to recognize and destroy mutated cells—one of the earliest indicators of ovarian cancer.
Understanding Ovarian Cancer
Despite advancements in medical research and treatment protocols over the last few decades, ovarian cancer still poses a significant threat to women’s health. In the United States alone, more than 12,0000 women die of ovarian cancer each year, and only about half of women diagnosed with ovarian cancer survive five or more years past diagnosis. Unlike cervical cancer, there is no routine screening for ovarian cancer, so it often goes undetected until it has reached advanced stages. Additionally, the primary symptoms of ovarian cancer—frequent urination, bloating, loss of appetite, and abdominal pain—can often be mistaken for other non-cancerous conditions, delaying treatment.
An American woman has roughly a one percent chance of developing ovarian cancer throughout her lifetime. However, these odds increase significantly if she has inherited mutations in the BRCA1 or BRCA2 genes. Women who carry these mutations face a 46% lifetime risk for ovarian and breast cancers.
An Unlikely Solution
To address this escalating health concern, the organization Cancer Research UK has invested £600,000 over the next three years in research aimed at creating a vaccine, which would destroy cancerous cells before they have a chance to develop any further.
Researchers at the University of Oxford are at the forefront of this initiative. With funding from Cancer Research UK, scientists will use tissue samples from the ovaries and fallopian tubes of patients currently battling ovarian cancer. Using these samples, University of Oxford scientists will create a vaccine to recognize certain proteins on the surface of ovarian cancer cells known as tumor-associated antigens. The vaccine will then train that person’s immune system to recognize the cancer markers and destroy them.
The next step
Once developed, the vaccine will first be tested in patients with the disease, to see if their ovarian tumors will shrink or disappear. Then, the vaccine will be tested in women with the BRCA1 or BRCA2 mutations as well as women in the general population without genetic mutations, to see whether the vaccine can prevent the cancer altogether.
While the vaccine still has “a long way to go,” according to Professor Ahmed Ahmed, Director of Oxford University’s ovarian cancer cell laboratory, he is “optimistic” about the results.
“We need better strategies to prevent ovarian cancer,” said Ahmed in a press release from the University of Oxford. “Currently, women with BRCA1/2 mutations are offered surgery which prevents cancer but robs them of the chance to have children afterward.
Teaching the immune system to recognize the very early signs of cancer is a tough challenge. But we now have highly sophisticated tools which give us real insights into how the immune system recognizes ovarian cancer. OvarianVax could offer the solution.”
How sharing, hearing, and remembering positive stories can help shape our brains for the better
Across cultures and through millennia, human beings have always told stories. Whether it’s a group of boy scouts around a campfire sharing ghost stories or the paleolithic Cro-Magnons etching pictures of bison on cave walls, researchers believe that storytelling has been universal to human beings since the development of language.
But storytelling was more than just a way for our ancestors to pass the time. Researchers believe that storytelling served an important evolutionary purpose, helping humans learn empathy, share important information (such as where predators were or what berries were safe to eat), as well as strengthen social bonds. Quite literally, storytelling has made it possible for the human race to survive.
Today, neuroscientists are discovering that storytelling is just as important now as it was millions of years ago. Particularly in sharing positive stories, humans can more easily form relational bonds, develop a more flexible perspective, and actually grow new brain circuitry that helps us survive. Here’s how.
How sharing stories positively impacts the brain
When human beings share stories, it increases the levels of certain neurochemicals in the brain, neuroscientists have found. In a 2021 study published in Proceedings of the National Academy of Sciences (PNAS), Swedish researchers found that simply hearing a story could make hospitalized children feel better, compared to other hospitalized children who played a riddle game for the same amount of time. In their research, children in the intensive care unit who heard stories for just 30 minutes had higher levels of oxytocin, a hormone that promotes positive feelings and is linked to relaxation, trust, social connectedness, and overall psychological stability. Furthermore, the same children showed lower levels of cortisol, a hormone associated with stress. Afterward, the group of children who heard stories tended to describe their hospital experiences more positively, and even reported lower levels of pain.
Annie Brewster, MD, knows the positive effect of storytelling from personal experience. An assistant professor at Harvard Medical School and the author of The Healing Power of Storytelling: Using Personal Narrative to Navigate Illness, Trauma, and Loss, Brewster started sharing her personal experience with chronic illness after being diagnosed with multiple sclerosis in 2001. In doing so, Brewster says it has enabled her to accept her diagnosis and integrate it into her identity. Brewster believes so much in the power of hearing and sharing stories that in 2013 she founded Health Story Collaborative, a forum for others to share their mental and physical health challenges.“I wanted to hear stories of people who had found ways to move forward in positive ways, in spite of health challenges,” Brewster said. In doing so, Brewster believes people with chronic conditions can “move closer to self-acceptance and self-love.”
While hearing and sharing positive stories has been shown to increase oxytocin and other “feel good” chemicals, simply remembering a positive story has an effect on our brains as well. Mark Hoelterhoff, PhD, a lecturer in clinical psychology at the University of Edinburgh, recalling and “savoring” a positive story, thought, or feedback “begins to create new brain circuitry—a new neural network that’s geared toward looking for the positive,” he says. Over time, other research shows, savoring positive stories or thoughts can literally change the shape of your brain, hard-wiring someone to see things in a more positive light.How stories can change your behavior
In 2009, Paul Zak, PhD, a neuroscientist and professor at Claremont Graduate University, set out to measure how storytelling can actually change human behavior for the better. In his study, Zak wanted to measure the behavioral effects of oxytocin, and did this by showing test subjects two short video clips designed to elicit an emotional response.
In the first video they showed the study participants, a father spoke to the camera about his two-year-old son, Ben, who had been diagnosed with terminal brain cancer. The father told the audience that he struggled to connect with and enjoy Ben, as Ben had only a few months left to live. In the end, the father finds the strength to stay emotionally connected to his son until he dies.
The second video clip, however, was much less emotional. In that clip, the same father and son are shown spending the day at the zoo. Ben is only suggested to have cancer (he is bald from chemotherapy and referred to as a ‘miracle’, but the cancer isn’t mentioned directly). The second story lacked the dramatic narrative arc of the first video.
Zak’s team took blood before and after the participants watched one of the two videos and found that the first story increased the viewers’ cortisol and oxytocin, suggesting that they felt distress over the boy’s diagnosis and empathy toward the boy and his father. The second narrative, however, didn’t increase oxytocin or cortisol at all.
But Zak took the experiment a step further. After the movie clips, his team gave the study participants a chance to share money with a stranger in the lab. The participants who had an increase in cortisol and oxytocin were more likely to donate money generously. The participants who had increased cortisol and oxytocin were also more likely to donate money to a charity that works with children who are ill. Zak also found that the amount of oxytocin that was released was correlated with how much money people felt comfortable giving—in other words, the more oxytocin that was released, the more generous they felt, and the more money they donated.
How storytelling strengthens our bond with others
Sharing, hearing, and remembering stories can be a powerful tool for social change–not only in the way it changes our brain and our behavior, but also because it can positively affect our relationships with other people
Emotional stimulation from telling stories, writes Zak, is the foundation for empathy, and empathy strengthens our relationships with other people. “By knowing someone’s story—where they come from, what they do, and who you might know in common—relationships with strangers are formed.”
But why are these relationships important for humanity? Because human beings can use storytelling to build empathy and form relationships, it enables them to “engage in the kinds of large-scale cooperation that builds massive bridges and sends humans into space,” says Zak.
Storytelling, Zak found, and the oxytocin release that follows, also makes people more sensitive to social cues. This sensitivity not only motivates us to form relationships, but also to engage with other people and offer help, particularly if the other person seems to need help.
But as Zak found in his experiments, the type of storytelling matters when it comes to affecting relationships. Where Zak found that storytelling with a dramatic arc helps release oxytocin and cortisol, enabling people to feel more empathic and generous, other researchers have found that sharing happy stories allows for greater closeness between individuals and speakers. A group of Chinese researchers found that, compared to emotionally-neutral stories, happy stories were more “emotionally contagious.” Test subjects who heard happy stories had greater activation in certain areas of their brains, experienced more significant, positive changes in their mood, and felt a greater sense of closeness between themselves and the speaker.
“This finding suggests that when individuals are happy, they become less self-focused and then feel more intimate with others,” the authors of the study wrote. “Therefore, sharing happiness could strengthen interpersonal bonding.” The researchers went on to say that this could lead to developing better social networks, receiving more social support, and leading more successful social lives.
Since the start of the COVID pandemic, social isolation, loneliness, and resulting mental health issues have only gotten worse. In light of this, it’s safe to say that hearing, sharing, and remembering stories isn’t just something we can do for entertainment. Storytelling has always been central to the human experience, and now more than ever it’s become something crucial for our survival.
Want to know how you can reap the benefits of hearing happy stories? Keep an eye out for Upworthy’s first book, GOOD PEOPLE: Stories from the Best of Humanity, published by National Geographic/Disney, available on September 3, 2024. GOOD PEOPLE is a much-needed trove of life-affirming stories told straight from the heart. Handpicked from Upworthy’s community, these 101 stories speak to the breadth, depth, and beauty of the human experience, reminding us we have a lot more in common than we realize.