Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
An Investigational Drug Offers Hope to Patients with a Disabling Neuromuscular Disease
Robert Thomas was a devoted runner, gym goer, and crew member on a sailing team in San Diego when, in his 40s, he noticed that his range of movement was becoming more limited.
He thought he was just getting older, but when he was hiking an uphill trail in Lake Tahoe, he kept tripping over rocks. "I'd never had this happen before," Robert says. "I knew something was wrong but didn't know what it was."
It wasn't until age 50 when he was diagnosed with Charcot-Marie-Tooth disease. The genetic disorder damages the peripheral nerves, which connect the brain and spinal cord to the rest of the body. This network of nerves is responsible for relaying information and signals about sensation, movement, and motor coordination. Over time, the disease causes debilitating muscle weakness and the loss of limb control.
Charcot-Marie-Tooth usually presents itself in childhood or in a person's teens, but in some patients, like Robert, onset can be later in life. Symptoms may include muscle cramping, tingling, or burning. Many patients also have high foot arches or hammer toes — toes that curl from the middle joint instead of pointing forward. Those affected often have difficulty walking and may lose sensation in their lower legs, feet, hands, or forearms. One of the most common rare diseases, it affects around 130,000 people in the United States and 2.8 million worldwide.
Like many people with Charcot-Marie-Tooth, or CMT, Robert wears corrective braces on his legs to help with walking. Now 61, he can't run or sail anymore because of the disease, but he still works out regularly and can hike occasionally. CMT also affects his grip, so he has to use special straps while doing some exercises.
For the past few years, Robert has been participating in a clinical trial for an investigational CMT drug. He takes the liquid formulation every morning and evening using an oral syringe. Scientists are following patients like Robert to learn if their symptoms stabilize or improve while on the drug. Dubbed PXT300, the drug was designed by French biopharmaceutical company Pharnext and is the farthest along in development for CMT. If approved, it would be the first drug for the disease.
Currently, there's no cure for CMT, only supportive treatments like pain medication. Some individuals receive physical and occupational therapy. A drug for CMT could be a game-changer for patients whose quality of life is severely affected by the disease.
Genetic Underpinnings
CMT arises from mutations in genes that are responsible for creating and maintaining the myelin sheath — the insulating layer around nerves. Pharnext's drug is meant to treat patients with CMT1A, the most common form of the disease, which represents about half of CMT cases. Around 5% of those with CMT1A become severely disabled and end up in wheelchairs. People with CMT1A have an extra copy of the gene PMP22, which makes a protein that's needed to maintain the myelin sheath around peripheral nerves.
Typically, an individual inherits one copy of PMP22 from each parent. But a person with CMT1A receives a copy of PMP22 from one parent and two copies from a parent with the disease. This extra copy of the gene results in excess protein production, which damages the cells responsible for preserving and regenerating the myelin sheath, called Schwann cells.
The myelin sheath helps ensure that a signal from the brain gets carried to nerves in the muscles so that a part of the body can carry out a particular action or movement. This sheath is like the insulation on an electrical cord and the action is like a light bulb. If the insulation is fine, the light bulb turns on. But if the insulation is frayed, the light will flicker.
"The same happens to these patients," says David Horn Solomon, CEO of Pharnext. "The signal to their muscle is weak and flickers." Over time, their muscles become weaker and thinner.
The PMP22 gene has proven difficult to target with a drug because it's located in a protected space — the Schwann cells that make up the insulation around nerves. "There's not an easy way to tamp it down," Solomon says.
Another company, Acceleron Pharma of Cambridge, Massachusetts, was developing an injectable CMT drug meant to increase the strength of leg muscles. But the company halted development last year after the experimental drug failed in a mid-stage trial. While the drug led to a statistically significant increase in muscle volume, it didn't translate to improvements in muscle function or quality of life for trial participants.
Made by Design
Pharnext's drug, PXT3003, is a combination of three existing drugs — baclofen, a muscle relaxant; naltrexone, a drug that decreases the desire for alcohol and opioids; and sorbitol, a type of sugar alcohol.
The company designed the drug using its artificial intelligence platform, which screened 20,000 existing drugs to predict combinations that could inhibit the PMP22 gene and thereby lower protein production. The AI system narrowed the search to several hundreds of combinations and Pharnext tested around 75 of them in the lab before landing on baclofen, naltrexone, and sorbitol. Individually, the drugs don't have much effect on the PMP22 gene. But combined, they work to lower how much protein the gene makes.
"How the drug inside the cell reduces expression isn't quite clear yet," says Florian Thomas, director of the Hereditary Neuropathy Center, and founding chair and professor in the department of neurology at Hackensack University Medical Center and Hackensack Meridian School of Medicine in New Jersey (no relation to Robert Thomas, the CMT patient). "By reducing the amount of protein being produced, we hopefully can stabilize the nerves."
In rodents genetically engineered to have the PMP22 gene, the drug reduced protein levels and delayed onset of muscle weakness when given to rats. In another animal study, the drug increased the size of the myelin sheath around nerves in rats.
"Like humans with CMT, one of the problems the animals have is they can't grip things, their grip strength is poor," Solomon says. But when treated with Pharnext's drug, "the grip strength of these animals improves dramatically even over 12 weeks."
Human trials look encouraging, too. But the company ran into a manufacturing issue during a late-stage trial. The drug requires refrigeration, and as a result of temperature changes, crystals formed inside vials containing the high dose of the drug. The study was a double-blind trial, meaning neither the trial participants nor investigators were supposed to know who received the high dose of the drug, who received the low dose, and who received a placebo. In these types of studies, the placebo and experimental drug should look the same so that investigators can't tell them apart. But because only the high dose contained crystals, not the low dose or placebo, regulators said the trial data could be biased.
Pharnext is now conducting a new randomized, double-blind trial to prove that its drug works. The study is recruiting individuals aged 16 through 65 years old with mild to moderate CMT. The company hopes to show that the drug can stop patients' symptoms from worsening, or in the best case scenario, possibly even improve them. The company doesn't think the drug will be able to help people with severe forms of the disease.
"In neurologic disease, you're looking for plasticity, where there's still the possibility of stabilization or reversal," Solomon says. Plasticity refers to the ability of the nervous system to change and adapt in response to stimuli.
Preventing Disability
Allison Moore, a CMT patient and founder and CEO of the Hereditary Neuropathy Foundation, has been following drug development for CMT since she founded the organization in 2001. She says many investigational drugs haven't moved forward because they've shown little success in animals. The fact that Pharnext's drug has made it to a late-stage human trial is promising, she says.
"It's really exciting," Moore says. "There's a chance that if you take the drug early before you're very severe, you'll end up not developing the disease to a level that's super disabling."
CMT has damaged Moore's peroneal nerve, a main nerve in the foot. As a result, she has foot drop, the inability to lift the front part of her foot, and needs to wear leg braces to help her walk. "The idea that you could take this early on and that it could stop progression, that's the hope that we have."
Thomas, the neurologist, says a drug doesn't have to be a cure to have a significant impact on patients. "If I have a CMT patient who's 50 years old, that patient will be more disabled by age 60," he says. "If I can treat that person with a drug, and that person is just as disabled at age 60 as they were at age 50, that's transformative in my mind."
While Robert Thomas says he hasn't noticed a dramatic improvement since he's been on the drug, he does think it's helping. Robert is now in an open-label study, which means he and his health provider are aware that he's receiving the drug.
When the COVID-19 pandemic hit, manufacturing and supply chain disruptions meant that Robert was without the trial drug for two months. When his medication ran out, his legs felt unstable again and walking was harder. "There was a clear distinction between being on and off that medication," he says.
Pharnext's current trial will take about a year and a half to complete. After that, the FDA will decide on whether to approve the drug for CMT patients.
As scientists learn more about the PMP22 gene and the more than 100 other genes that when mutated cause CMT, more precise treatments could be possible. For instance, scientists have used the gene-editing tool CRISPR to correct a CMT-causing mutation in human cells in the lab. The results were published August 16 in the journal Frontiers in Cell and Developmental Biology.
Pharnext is also interested in pursuing genetic treatments for CMT, but in the meantime, repurposed drugs may be the best shot at helping patients until more advanced treatments are available.
"Making Sense of Science" is a monthly podcast that features interviews with leading medical and scientific experts about the latest developments and the big ethical and societal questions they raise. This episode is hosted by science and biotech journalist Emily Mullin, summer editor of the award-winning science outlet Leaps.org.