Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
Couples Facing Fertility Treatments Should Beware of This
When Jane Stein and her husband used in-vitro fertilization in 2001 to become pregnant with twins, her fertility clinic recommended using a supplemental procedure called intracytoplasmic sperm injection (ICSI), known in fertility lingo as "ix-see."
'Add-on' fertility procedures are increasingly coming under scrutiny for having a high cost and low efficacy rate.
During IVF, an egg and sperm are placed in a petri dish together with the hope that a sperm will seek out and fertilize the egg. With ICSI, doctors inject sperm directly into the egg.
Stein, whose name has been changed to protect her privacy, agreed to try it. Her twins are now 16, but while 17 years have gone by since that procedure, the efficacy of ICSI is still unclear. In other words, while Stein succeeded in having children, it may not have been because of ICSI. It may simply have been because she did IVF.
The American Society for Reproductive Medicine has concluded, "There are no data to support the routine use of ICSI for non-male factor infertility." That is, ICSI can help couples have a baby when the issue is male infertility. But when it's not, the evidence of its effectiveness is lacking. And yet the procedure is being used more and more, even when male infertility is not the issue. Some 40 percent of fertility treatments in Europe, Asia and the Middle East now use ICSI, according to a world report released in 2016 by the International Committee for Monitoring Assisted Reproductive Technologies. In the Middle East, the figure is actually 100 percent, the report said.
ICSI is just one of many supplemental procedures, or 'add-ons,' increasingly coming under scrutiny for having a high cost and low efficacy rate. They cost anywhere from a couple of hundred dollars to several thousand – ICSI costs $2,000 to $3,000 -- hiking up the price of what is already a very costly endeavor. And many don't even work. Worse, some actually cause harm.
It's no surprise couples use them. They promise to increase the chance of conceiving. For patients who desperately want a child, money is no object. The Human Fertilization and Embryology Authority (HFEA) in the U.K. found that some 74 percent of patients who received fertility treatments over the last two years were given at least one type of add-on. Now, fertility associations in the U.S. and abroad have begun issuing guidance about which add-ons are worth the extra cost and which are not.
"Many IVF add-ons have little in the way of conclusive evidence supporting their role in successful IVF treatment," said Professor Geeta Nargund, medical director of CREATE Fertility and Lead Consultant for reproductive medicine at St George's Hospital, London.
The HFEA has actually rated these add-ons, indicating which procedures are effective and safe. Some treatments were rated 'red' because they were considered to have insufficient evidence to justify their use. These include assisted hatching, which uses acid or lasers to make a hole in the surrounding layer of proteins to help the embryo hatch; intrauterine culture, where a device is inserted into the womb to collect and incubate the embryo; and reproductive immunology, which suppresses the body's natural immunity so that it accepts the embryo.
"Fertility care is a highly competitive market. In a private system, offering add-ons may discern you from your neighboring clinic."
For some treatments, the HFEA found there is evidence that they don't just fail to work, but can even be harmful. These procedures include ICSI used when male infertility is not at issue, as well as a procedure called endometrial scratching, where the uterus is scratched, not unlike what would happen with a biopsy, to stimulate the local uterine immune system.
And then for some treatments, there is conflicting evidence, warranting further research. These include artificial egg activation by calcium ionophore, elective freezing in all cycles, embryo glue, time-lapse imaging and pre-implantation genetic testing for abnormal chromosomes on day 5.
"Currently, there is very little evidence to suggest that many of the add-ons could increase success rates," Nargund said. "Indeed, the HFEA's assessment of add-on treatments concluded that none of the add-ons could be given a 'green' rating, due to a lack of conclusive supporting research."
So why do fertility clinics offer them?
"Fertility care is a highly competitive market," said Professor Hans Evers, editor-in-chief of the journal Human Reproduction. "In a private system, offering add-ons may discern you from your neighboring clinic. The more competition, the more add-ons. Hopefully the more reputable institutions will only offer add-ons (for free) in the context of a randomized clinical trial."
The only way for infertile couples to know which work and which don't is the guidance released by professional organizations like the ASRM, and through government regulation in countries that have a public health care system.
The problem is, infertile couples will sometimes do anything to achieve a pregnancy.
"They will stand on their heads if this is advocated as helpful. Someone has to protect them," Evers said.
In the Netherlands, where Evers is based, the national health care system tries to make the best use of the limited resources it has, so it makes sure the procedures it's funding actually work, Evers said.
"We have calculated that to serve a population of 17 million, we need 13 IVF clinics, and we have 13," he said. "We as professionals discuss and try to agree on the value of newly proposed add-ons, and we will implement only those that are proven effective and safe."
Likewise, in the U.K., there's been a lot of squawking about speculative add-ons because the government, or National Health Service, pays for them. In the U.S., it's private insurers or patients' own cash.
"The [U.K.] government takes a very close look at what therapies they are offering and what the evidence is around offering the therapy," said Alan Penzias, who chairs the Practice Committee of the ASRM. It wants to make sure the treatments it is funding are at least worth the money.
ICSI is a case in point. Originally intended for male infertility, it's now being applied across the board because fertility clinics didn't want couples to pay $10,000 to $15,000 and wind up with no embryos.
"It is so disastrous to have no fertilization whatsoever, clinics started to make this bargain with their patients, saying, 'Well, listen, even though it's not indicated, what we would like to do is to take half of your eggs and do the ICSI procedure, and half we'll do conventional insemination just to make sure,'" he said. "It's a disaster if you have no embryos, and now you're out 10 to 12 thousand dollars, so for a small added fee, we can do the injection just to guard against that."
In the Netherlands, the national health care system tries to make the best use of its limited resources, so it makes sure the procedures it's funding actually work.
Clinics offer it where they see lower rates of fertilization, such as with older women or in cases where induced ovulation results in just two or three eggs instead of, say, 13. Unfortunately, ICSI may result in a higher fertilization rate, but it doesn't result in a higher live birth rate, according to a study last year in Human Reproduction, so couples wind up paying for a procedure that doesn't even result in a child.
Private insurers in the U.S. are keen to it. Penzia, who is also an associate professor of obstetrics, gynecology and reproductive biology at Harvard Medical School and works as a reproductive endocrinology and infertility specialist at Boston IVF, said Massachusetts requires that insurers cover infertility treatments. But when he submits claims for ICSI, for instance, insurers now want to see two sperm counts and proof that the man has seen a urologist.
"They want to make sure we're doing it for male factor (infertility)," he said. "That's not unreasonable, because the insurance company is taking the burden of this."
How exactly does your DNA make you who you are?
It's because of epigenetics that identical twins can actually look different and develop different diseases.
Just as software developers don't write apps out of ones and zeros, the interesting parts of the human genome aren't written merely in As, Ts, Cs and Gs. Yes, these are the fundamental letters that make up our DNA and encode the proteins that make our cells function, but the story doesn't end there.
Our cells possess amazing abilities, like eating invading bacteria or patching over a wound, and these abilities require the coordinated action of hundreds, if not thousands, of proteins. Epigenetics, the study of gene expression, examines how multiple genes work at once to make these biological processes happen.
It's because of epigenetics that identical twins – who possess identical DNA -- can actually look different and develop different diseases. Their environments may influence the expression of their genes in unique ways. For example, a research study in mice found that maternal exposure to a chemical called bisphenol A (BPA) resulted in drastic differences between genetically identical offspring. BPA exposure increased the likelihood that a certain gene was turned on, which led to the birth of yellow mice who were prone to obesity. Their genetically identical siblings who were not exposed to BPA were thinner and born with brown fur.
These three mice are genetically identical. Epigenetic differences, however, result in vastly different phenotypes.
(© 1994 Nature Publishing Group, Duhl, D.)
This famous mouse experiment is just one example of how epigenetics may transform medicine in the coming years. By studying the way genes are turned on and off, and maybe even making those changes ourselves, scientists are beginning to approach diseases like cancer in a completely new way.
With few exceptions, most of the 1 trillion cells that make up your body contain the same DNA instructions as all the others. How does each cell in your body know what it is and what it has to do? One of the answers appears to lie in epigenetic regulation. Just as everyone at a company may have access to all the same files on the office Dropbox, the accountants will put different files on their desktop than the lawyers do.
Our cells prioritize DNA sequences in the same way, even storing entire chromosomes that aren't needed along the wall of the nucleus, while keeping important pieces of DNA in the center, where it is most accessible to be read and used. One of the ways our cells prioritize certain DNA sequences is through methylation, a process that inactivates large regions of genes without editing the underlying "file" itself.
As we learn more about epigenetics, we gain more opportunities to develop therapeutics for a broad range of human conditions, from cancer to metabolic disorders. Though there have not been any clinical applications of epigenetics to immune or metabolic diseases yet, cancer is one of the leading areas, with promising initial successes.
One of the challenges of cancer treatments is that different patients may respond positively or negatively to the same treatment. With knowledge of epigenetics, however, doctors could conduct diagnostic tests to identify a patient's specific epigenetic profile and determine the best treatment for him or her. Already, commercial kits are available that help doctors screen glioma patients for an epigenetic biomarker called MGMT, because patients with this biomarker have shown high rates of success with certain kinds of treatments.
Other epigenetic advances go beyond personalized screening to treatments targeting the mechanism of disease. Some epigenetic drugs turn on genes that help suppress tumors, while others turn on genes that reveal the identity of tumor cells to the immune system, allowing it to attack cancerous cells.
Direct, targeted control of your epigenome could allow doctors to reprogram cancerous or aging cells.
The study of epigenetics has also been fundamental to the field of aging research. The older you get, the more methylation marks your DNA carries, and this has led to the distinction between biological aging, or the state of your cells, and chronological aging, or how old you actually are.
Just as our DNA can get miscopied and accumulate mutations, errors in DNA methylation can lead to so-called "epimutations". One of the big hypotheses in aging research today is that the accumulation of these random epimutations over time is responsible for what we perceive as aging.
Studies thus far have been correlative - looking at several hundred sites of epigenetic modifications in a person's cell, scientists can now roughly discern the age of that person. The next set of advances in the field will come from learning what these epigenetic changes individually do by themselves, and if certain methylations are correlated with cellular aging. General diagnostic terms like "aging" could be replaced with "abnormal methylation at these specific locations," which would also open the door to new therapeutic targets.
Direct, targeted control of your epigenome could allow doctors to reprogram cancerous or aging cells. While this type of genetic surgery is not feasible just yet, current research is bringing that possibility closer. The Cas9 protein of genome-editing CRISPR/Cas9 fame has been fused with epigenome modifying enzymes to target epigenetic modifications to specific DNA sequences.
A therapeutic of this type could theoretically undo a harmful DNA methylation, but would also be competing with the cell's native machinery responsible for controlling this process. One potential approach around this problem involves making beneficial synthetic changes to the epigenome that our cells do not have the capacity to undo.
Also fueling this frontier is a new approach to understanding disease itself. Scientists and doctors are now moving beyond the "one defective gene = one disease" paradigm. Because lots of diseases are caused by multiple genes going haywire, epigenetic therapies could hold the key to new types of treatments by targeting multiple defective genes at once.
Scientists are still discovering which epigenetic modifications are responsible for particular diseases, and engineers are building new tools for epigenome editing. Given the proliferation of work in these fields within the last 10 years, we may see epigenetic therapeutics emerging within the next couple of decades.