Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
Sarah Mancoll was 22 years old when she noticed a bald spot on the back of her head. A dermatologist confirmed that it was alopecia aerata, an autoimmune disorder that causes hair loss.
Of 213 new drugs approved from 2003 to 2012, only five percent included any data from pregnant women.
She successfully treated the condition with corticosteroid shots for nearly 10 years. Then Mancoll and her husband began thinking about starting a family. Would the shots be safe for her while pregnant? For the fetus? What about breastfeeding?
Mancoll consulted her primary care physician, her dermatologist, even a pediatrician. Without clinical data, no one could give her a definitive answer, so she stopped treatment to be "on the safe side." By the time her son was born, she'd lost at least half her hair. She returned to her Washington, D.C., public policy job two months later entirely bald—and without either eyebrows or eyelashes.
After having two more children in quick succession, Mancoll recently resumed the shots but didn't forget her experience. Today, she is an advocate for including more pregnant and lactating women in clinical studies so they can have more information about therapies than she did.
"I live a very privileged life, and I'll do just fine with or without hair, but it's not just about me," Mancoll said. "It's about a huge population of women who are being disenfranchised…They're invisible."
About 4 million women give birth each year in the United States, and many face medical conditions, from hypertension and diabetes to psychiatric disorders. A 2011 study showed that most women reported taking at least one medication while pregnant between 1976 and 2008. But for decades, pregnant and lactating women have been largely excluded from clinical drug studies that rigorously test medications for safety and effectiveness.
An estimated 98 percent of government-approved drug treatments between 2000 and 2010 had insufficient data to determine risk to the fetus, and close to 75 percent had no human pregnancy data at all. All told, of 213 new pharmaceuticals approved from 2003 to 2012, only five percent included any data from pregnant women.
But recent developments suggest that could be changing. Amid widespread concerns about increased maternal mortality rates, women's health advocates, physicians, and researchers are sensing and encouraging a cultural shift toward protecting women through responsible research instead of from research.
"The question is not whether to do research with pregnant women, but how," Anne Drapkin Lyerly, professor and associate director of the Center for Bioethics at the University of North Carolina at Chapel Hill, wrote last year in an op-ed. "These advances are essential. It is well past time—and it is morally imperative—for research to benefit pregnant women."
"In excluding pregnant women from drug trials to protect them from experimentation, we subject them to uncontrolled experimentation."
To that end, the American College of Obstetricians and Gynecologists' Committee on Ethics acknowledged that research trials need to be better designed so they don't "inappropriately constrain the reproductive choices of study participants or unnecessarily exclude pregnant women." A federal task force also called for significantly expanded research and the removal of regulatory barriers that make it difficult for pregnant and lactating women to participate in research.
Several months ago, a government change to a regulation known as the Common Rule took effect, removing pregnant women as a "vulnerable population" in need of special protections -- a designation that had made it more difficult to enroll them in clinical drug studies. And just last week, the U.S. Food and Drug Administration (FDA) issued new draft guidances for industry on when and how to include pregnant and lactating women in clinical trials.
Inclusion is better than the absence of data on their treatment, said Catherine Spong, former chair of the federal task force.
"It's a paradox," said Spong, professor of obstetrics and gynecology and chief of maternal fetal medicine at University of Texas Southwestern Medical Center. "There is a desire to protect women and fetuses from harm, which is translated to a reluctance to include them in research. By excluding them, the evidence for their care is limited."
Jacqueline Wolf, a professor of the history of medicine at Ohio University, agreed.
"In excluding pregnant women from drug trials to protect them from experimentation, we subject them to uncontrolled experimentation," she said. "We give them the medication without doing any research, and that's dangerous."
Women, of course, don't stop getting sick or having chronic medical conditions just because they are pregnant or breastfeeding, and conditions during pregnancy can affect a baby's health later in life. Evidence-based data is important for other reasons, too.
Pregnancy can dramatically change a woman's physiology, affecting how drugs act on her body and how her body acts or reacts to drugs. For instance, pregnant bodies can more quickly clear out medications such as glyburide, used during diabetes in pregnancy to stabilize high blood-sugar levels, which can be toxic to the fetus and harmful to women. That means a regular dose of the drug may not be enough to control blood sugar and prevent poor outcomes.
Pregnant patients also may be reluctant to take needed drugs for underlying conditions (and doctors may be hesitant to prescribe them), which in turn can cause more harm to the woman and fetus than had they been treated. For example, women who have severe asthma attacks while pregnant are at a higher risk of having low-birthweight babies, and pregnant women with uncontrolled diabetes in early pregnancy have more than four times the risk of birth defects.
Current clinical trials involving pregnant women are assessing treatments for obstructive sleep apnea, postpartum hemorrhage, lupus, and diabetes.
For Kate O'Brien, taking medication during her pregnancy was a matter of life and death. A freelance video producer who lives in New Jersey, O'Brien was diagnosed with tuberculosis in 2015 after she became pregnant with her second child, a boy. Even as she signed hospital consent forms, she had no idea if the treatment would harm him.
"It's a really awful experience," said O'Brien, who now is active with We are TB, an advocacy and support network. "All they had to tell me about the medication was just that women have been taking it for a really long time all over the world. That was the best they could do."
More and more doctors, researchers and women's health organizations and advocates are calling that unacceptable.
By indicating that filling current knowledge gaps is "a critical public health need," the FDA is signaling its support for advancing research with pregnant women, said Lyerly, also co-founder of the Second Wave Initiative, which promotes fair representation of the health interests of pregnant women in biomedical research and policies. "It's a very important shift."
Research with pregnant women can be done ethically, Lyerly said, whether by systematically collecting data from those already taking medications or enrolling pregnant women in studies of drugs or vaccines in development.
Current clinical trials involving pregnant women are assessing treatments for obstructive sleep apnea, postpartum hemorrhage, lupus, and diabetes. Notable trials in development target malaria and HIV prevention in pregnancy.
"It clearly is doable to do this research, and test trials are important to provide evidence for treatment," Spong said. "If we don't have that evidence, we aren't making the best educated decisions for women."
The news last November that a rogue Chinese scientist had genetically altered the embryos of a pair of Chinese twins shocked the world. But although this use of advanced technology to change the human gene pool was premature, it was a harbinger of how genetic science will alter our healthcare, the way we make babies, the nature of the babies we make, and, ultimately, our sense of who and what we are as a species.
The healthcare applications of the genetics revolution are merely stations along the way to the ultimate destination.
But while the genetics revolution has already begun, we aren't prepared to handle these Promethean technologies responsibly.
By identifying the structure of DNA in the 1950s, Watson, Crick, Wilkins, and Franklin showed that the book of life was written in the DNA double helix. When the human genome project was completed in 2003, we saw how this book of human life could be transcribed. Painstaking research paired with advanced computational algorithms then showed what increasing numbers of genes do and how the genetic book of life can be read.
Now, with the advent of precision gene editing tools like CRISPR, we are seeing that the book of life -- and all biology -- can be re-written. Biology is being recognized as another form of readable, writable, and hackable information technology with we humans as the coders.
The impact of this transformation is being first experienced in our healthcare. Gene therapies including those extracting, re-engineering, then reintroducing a person's own cells enhanced into cancer-fighting supercells are already performing miracles in clinical trials. Thousands of applications have already been submitted to regulators across the globe for trials using gene therapies to address a host of other diseases.
Recently, the first gene editing of cells inside a person's body was deployed to treat the genetically relatively simple metabolic disorder Hunter syndrome, with many more applications to come. These new approaches are only the very first steps in our shift from the current system of generalized medicine based on population averages to precision medicine based on each patient's individual biology to predictive medicine based on AI-generated estimations of a person's future health state.
Jamie Metzl's groundbreaking new book, Hacking Darwin: Genetic Engineering and the Future of Humanity, explores how the genetic revolution is transforming our healthcare, the way we make babies, and the nature of and babies we make, what this means for each of us, and what we must all do now to prepare for what's coming.
This shift in our healthcare will ensure that millions and then billions of people will have their genomes sequenced as the foundation of their treatment. Big data analytics will then be used to compare at scale people's genotypes (what their genes say) to their phenotypes (how those genes are expressed over the course of their lives).
These massive datasets of genetic and life information will then make it possible to go far beyond the simple genetic analysis of today and to understand far more complex human diseases and traits influenced by hundreds or thousands of genes. Our understanding of this complex genetic system within the vaster ecosystem of our bodies and the environment around us will transform healthcare for the better and help us cure terrible diseases that have plagued our ancestors for millennia.
But as revolutionary as this challenge will be for medicine, the healthcare applications of the genetics revolution are merely stations along the way to the ultimate destination – a deep and fundamental transformation of our evolutionary trajectory as a species.
A first inkling of where we are heading can be seen in the direct-to-consumer genetic testing industry. Many people around the world have now sent their cheek swabs to companies like 23andMe for analysis. The information that comes back can tell people a lot about relatively simple genetic traits like carrier status for single gene mutation diseases, eye color, or whether they hate the taste of cilantro, but the information about complex traits like athletic predisposition, intelligence, or personality style today being shared by some of these companies is wildly misleading.
This will not always be the case. As the genetic and health data pools grow, analysis of large numbers of sequenced genomes will make it possible to apply big data analytics to predict some very complex genetic disease risks and the genetic components of traits like height, IQ, temperament, and personality style with increasing accuracy. This process, called "polygenic scoring," is already being offered in beta stage by a few companies and will become an ever bigger part of our lives going forward.
The most profound application of all this will be in our baby-making. Before making a decision about which of the fertilized eggs to implant, women undergoing in vitro fertilization can today elect to have a small number of cells extracted from their pre-implanted embryos and sequenced. With current technology, this can be used to screen for single-gene mutation diseases and other relatively simple disorders. Polygenic scoring, however, will soon make it possible to screen these early stage pre-implanted embryos to assess their risk of complex genetic diseases and even to make predictions about the heritable parts of complex human traits. The most intimate elements of being human will start feeling like high-pressure choices needing to be made by parents.
The limit of our imagination will become the most significant barrier to our recasting biology.
Adult stem cell technologies will then likely make it possible to generate hundreds or thousands of a woman's own eggs from her blood sample or skin graft. This would blow open the doors of reproductive possibility and allow parents to choose embryos with exceptional potential capabilities from a much larger set of options.
The complexity of human biology will place some limits to the extent of possible gene edits that might be made to these embryos, but all of biology, including our own, is extremely flexible. How else could all the diversity of life have emerged from a single cell nearly four billion years ago? The limit of our imagination will become the most significant barrier to our recasting biology.
But while we humans are gaining the powers of the gods, we aren't at all ready to use them.
The same tools that will help cure our worst afflictions, save our children, help us live longer, healthier, more robust lives will also open the door to potential abuses. Prospective parents with the best of intentions or governments with lax regulatory structures or aggressive ideas of how population-wide genetic engineering might be used to enhance national competitiveness or achieve some other goal could propel us into a genetic arms race that could undermine our essential diversity, dangerously divide societies, lead to dangerous, destabilizing, and potentially even deadly conflicts between us, and threaten our very humanity.
But while the advance of genetic technologies is inevitable, how it plays out is anything but. If we don't want the genetic revolution to undermine our species or lead to grave conflicts between genetic haves and have nots or between societies opting in and those opting out, now is the time when we need to make smart decisions based on our individual and collective best values. Although the technology driving the genetic revolution is new, the value systems we will need to optimize the benefits and minimize the harms of this massive transformation are ones we have been developing for thousands of years.
And while some very smart and well-intentioned scientists have been meeting to explore what comes next, it won't be enough for a few of even our wisest prophets to make decisions about the future of our species that will impact everyone. We'll also need smart regulations on both the national and international levels.
Every country will need to have its own regulatory guidelines for human genetic engineering based on both international best practices and the country's unique traditions and values. Because we are all one species, however, we will also ultimately need to develop guidelines that can apply to all of us.
As a first step toward making this possible, we must urgently launch a global, species-wide education effort and inclusive dialogue on the future of human genetic engineering that can eventually inform global norms that will need to underpin international regulations. This process will not be easy, but the alternative of an unregulated genetic arms race would be far worse.
The overlapping genomics and AI revolutions may seem like distant science fiction but are closer than you think. Far sooner than most people recognize, the inherent benefits of these technologies and competition between us will spark rapid adoption. Before that spark ignites, we have a brief moment to come together as a species like we never have before to articulate and translate into action the future we jointly envision. The north star of our best shared values can help us navigate the almost unimaginable opportunities and very real challenges that lie ahead.