Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
A new way to help kids with ADHD: Treat adult ADHD
When a child is diagnosed with attention deficit hyperactivity disorder (ADHD), it can often be a surprise to the parents that one of them has ADHD as well. They may have experienced some of the symptoms but never had the condition diagnosed.
Physicians, however, are usually less surprised because they know that ADHD is a very heritable disorder. According to a 2015 study, if a parent has ADHD, the child has up to a 57 percent chance of having it, and the child’s risk is 32 percent if their sibling has it.
“There have been 20 to 30 twin studies that show that the heritability of ADHD is about 70 percent,” meaning that both twins have it, says Stephen Faraone, distinguished professor and vice chair for research at SUNY Upstate Medical University. “It is as heritable as schizophrenia, bipolar disorder, autism or other psychiatric disorders that people tend to think are more biological than ADHD for some reason.”
More attention needed for adult ADHD
Brad McAlister, CMSE, executive director of the American Professional Society of ADHD & Related Disorders, or APSARD, explains that the consequences of untreated ADHD in adults are very well documented. The prevalence of ADHD in U.S. adults is 4.4 percent or about 11 million people.
Many adults go undiagnosed for decades or are misdiagnosed by providers. McAlister says that 75 percent are not receiving treatment. “The U.S. economic burden of adult ADHD is $105 to $194 billion annually,” he says. “The negative consequences on peoples’ lives include higher risks of dropping out of school, losing jobs, financial debt, divorce, fractured relationships, substance use disorders, and co-occurring depression/anxiety.”
One of the negative impacts of undiagnosed ADHD in adults is the effect that it can have on their children who have ADHD.
Adult ADHD is currently treated by a broad range of health care providers with different educational backgrounds and in different practice settings. In August, APSARD published the first U.S. guidelines for adult ADHD. “The creation of guidelines for ADHD in adults will allow all practitioners to benefit from the best evidence about diagnosing and treating the disorder,” McAlister says.
Faraone explains that the guidelines are intended to help practitioners understand the best practices for adults with ADHD, including screening and other ways of evaluating whether someone has it. He recently completed a study of what he calls the Metrics of Quality Care for adults with ADHD.
“We looked at a sizable group of primary care practices in the U.S., and we learned that although quality care for adults with ADHD has been gradually improving over the past decade, there are many areas where it is still far behind where it needs to be,” he says. “That’s consistent with other studies that show that in primary care for adults, ADHD is not treated nearly as well as it is treated in specialty and psychiatry care.”
How kids with ADHD are affected
One of the negative impacts of undiagnosed ADHD in adults is the effect that it can have on their children who have ADHD because their ability to care for that child’s special needs may be impaired.
“The treatments that are most effective in treating children with ADHD are medication and behavioral interventions as their reward bait, and at home, it’s the parent that administers them,” says Mark A. Stein, director of the ADHD and Related Disorders Program at Seattle Children’s Hospital. “Adults with ADHD have difficulties with time management and organization skills, so they will have a hard time making sure their child is ready for school, has breakfast, has their medications, etcetera.”
Even more challenging than getting a prescription, Stein adds, is finding a psychologist or therapist who is skilled in evaluating and working with children with ADHD and their parents. If left undiagnosed and untreated, adult ADHD may also interfere with getting a good evaluation for the child.
“If you have ADHD and your mind is wandering and you don’t have all of the forms from the school for your provider, and you’re focused on the bad day you’re having rather than giving a history of your child, all of that is going to delay getting an effective treatment for your child,” Stein says. “So that’s why it’s important to identify ADHD in parents.”
Promising research and training
After delays due to the pandemic, Stein and his colleague Andrea Chronis-Tuscano, professor and director of the Maryland ADHD Program at the University of Maryland, are now about two years into what they anticipate will be a six-year study that involves treating parents who have children with untreated ADHD symptoms. The goal is to see whether treating the parent first with medication and training, or just the training, helps the child’s symptoms due to improved parenting. They are also studying whether they can postpone the need for medication until children are older, when it’s more effective.
“Pediatricians are more aware of ADHD in parents because of our study,” Stein says. “They’re also more aware of the shortcomings in our healthcare delivery system in terms of how hard it is to find providers who are comfortable treating adult ADHD.”
“Besides depression, ADHD is the other disorder that parents have that really impacts kids significantly," Stein says. “With treatment, many people with ADHD do very well."
That said, he’s seen a significant improvement in the past decade with increased recognition of ADHD in adults. “It started with pediatricians recognizing that post-partum depression impacted the mother’s ability to care for her children and making it routine to screen for depression in parents of kids,” he says. “Besides depression, ADHD is the other disorder that parents have that really impacts kids significantly, so it’s important for them to be aware of characteristics of [ADHD in] parents and have resources they can give parents to help them.”
Stein emphasizes that even if someone displays symptoms of ADHD, that does not mean that they have it. They should seek a physician’s evaluation to confirm a diagnosis, which would enable them to get the medication and behavioral treatment they need.
The medication can take effect in parents within an hour. Meanwhile, when parents participate in the behavioral parent training courses, their kids with ADHD start showing significant improvement within about four to five weeks, according to Stein.
“With treatment, many people with ADHD do very well,” he says. “Especially if they get through formal schooling, find the right fit with their job, and if they make the right choices with their relationships, those three things can go a long way to make their ADHD fade into the background.”
Patients voice hope and relief as FDA gives third-ever drug approval for ALS
At age 52, Glen Rouse suffered from arm weakness and a lot of muscle twitches. “I first thought something was wrong when I could not throw a 50-pound bag of dog food over the tailgate of my truck—something I use to do effortlessly,” said the 54-year-old resident of Anderson, California, about three hours north of San Francisco.
In August, Rouse retired as a forester for a private timber company, a job he had held for 31 years. The impetus: amyotrophic lateral sclerosis, or ALS, a progressive neuromuscular disease that is commonly known as Lou Gehrig’s disease, named after the New York Yankees’ first baseman who succumbed to it less than a month shy of his 38th birthday in 1941. ALS eventually robs an individual of the ability to talk, walk, chew, swallow and breathe.
Rouse is now dependent on ventilation through a nasal mask and uses a powerchair to get around. “I can no longer walk or use my arms very well,” he said. “I can still move my wrists and fingers. I can also transfer from my chair to the toilet if I have two of my friends help me.”
It’s “shocking” that modern medicine has very little to offer to people with this devastating condition, Rouse said. But there is hope on the horizon. Yesterday, the U.S. Food and Drug Administration approved Relyvrio, a drug made up of two parts, sodium phenylbutyrate and taurursodiol, to treat patients with ALS.
“This approval provides another important treatment option for ALS, a life-threatening disease that currently has no cure,” said Billy Dunn, director of the Office of Neuroscience in the FDA’s Center for Drug Evaluation and Research, in a statement. “The FDA remains committed to facilitating the development of additional ALS treatments.”
Until this point, the FDA had approved only two other medications—Riluzole (rilutek) in 1995 and Radicava (edaravone) in 2017—to extend life in patients with ALS, which typically kills within two to five years after diagnosis. That’s why earlier this week, Rouse was optimistic about the FDA’s likely approval of a controversial new drug for ALS.
When Relyvrio is taken in addition to Riluzole, it appears to slow functional decline by an additional 25 percent and extend life by another 6 to 10 months, said Richard Bedlak, director of the Duke ALS Clinic. “It is not a cure, but it is definitely a step forward.”
“The whole ALS community is extremely excited about it,” he said the day before Relyvrio’s expected approval. “We are very hopeful. We’re on pins and needles.”
A study of 137 ALS patients did not result in “substantial evidence” that Relyvrio was effective, the agency’s Peripheral and Central Nervous System Drugs Advisory Committee concluded in March. However, after some persuasion from FDA officials, patients and their families, the committee met again and decided to recommend approving the drug.
In January 2019, following an ALS diagnosis at age 58 in October the previous year, Jeff Sarnacki, of Chester, Maryland, was accepted into a trial for Relyvrio. “Because of the trial, we did experience hope and a greater sense of help than had we not had that opportunity,” said Juliet Taylor, his wife and caregiver. They both believed the drug “worked for him in giving him more time.”
In June 2019, Sarnacki chose an open-label extension, offered to patients by drug researchers after a study ends, and took the active drug until he died peacefully at home under hospice care in May 2020, five days after his 60th birthday. A retired agent with the federal Bureau of Alcohol, Tobacco, Firearms and Explosives who later worked as a security consultant, Sarnacki lived about 19 months after diagnosis, which is shorter than the typical prognosis.
His symptoms began with leg cramps in fall 2017 and foot drop in early 2018. A feeding tube was placed in 2019, as it became necessary early in his illness, Taylor said. He also took Radicava and Riluzole, the two previously approved drugs, for his ALS. “We were both incredulous that, so many years after Lou Gehrig’s own diagnosis, there were so few treatments available,” she said.
The dearth of successful treatments for ALS is “certainly not for lack of trying,” said Karen Raley Steffens, a registered nurse and ALS support services coordinator at the Les Turner ALS Foundation in Skokie, Ill. “There are thousands of researchers and scientists all over the world working tirelessly to try to develop treatments for ALS.”
Unfortunately, she added, research takes time and exorbitant amounts of funding, while bureaucratic challenges persist. The rare disease also manifests and progresses in many different ways, so many treatments are needed.
As of 2017, the Centers for Disease Control and Prevention estimated that more than 31,000 people in the U.S. live with ALS, and an average of 5,000 people are newly diagnosed every year. It is slightly more common in men than women. Most people are diagnosed between the ages of 55 and 75.
Most cases of ALS are sporadic, meaning that doctors don’t know the cause. There is about a one-year interval between symptom onset and an ALS diagnosis for most patients, so many motor neurons are lost by the time individuals can enroll in a clinical trial, said Richard Bedlack, professor of neurology and director of the Duke ALS Clinic in Durham, North Carolina.
Bedlack found the new drug, Relyvrio, to be “very promising,” which is why he testified to the FDA in favor of approval. (He’s a consultant and disease state speaker for multiple companies including Amylyx, manufacturer of Relyvrio.)
The “drug has different mechanisms of action than the currently approved treatments,” Bedlack said. He added that, when Relyvrio is taken in addition to Riluzole, it appears to slow functional decline by an additional 25 percent and extend life by another 6 to 10 months. “It is not a cure, but it is definitely a step forward.”
T. Scott Diesing, a neurohospitalist and director of general neurology at the University of Nebraska Medical Center in Omaha, said he hopes the drug is “as good as people anticipated it should be, because there are not too many options for these patients.”
"FDA went out on a limb in approving Relyvrio based on limited results from a small trial while a larger study remains in progress," said Florian P. Thomas, co-director of the ALS Center at Hackensack University Medical Center and Hackensack Meridian School of Medicine in New Jersey. "While it is definitely promising, clearly, the last word on this drug has not been spoken."
So far, Rouse's voice is holding up, but he knows the day will come when ALS will steal that and much more from him.
ALS is 100 percent fatal, with some patients dying as soon as a year after diagnosis. A few have lasted as long as 15 years, but those are the exceptions, Diesing said.
“If this drug can provide even months of additional life, or would maintain quality of life, that’s a big deal,” he noted, adding that “the patients are saying, ‘I know it’s not proven conclusively, but what do we have to lose?’ So, they would like to try it while additional studies are ongoing.” The drug has already been conditionally approved in Canada.
As his disease progresses, Rouse hopes to get a speech-to-text voice-generating computer that he can control with his eyes. So far, his voice is holding up, but he knows the day will come when ALS will steal that and much more from him. He works at I AM ALS, a patient-led community, and six of his friends have already died of the disease.
“Every time I lose a friend to ALS, I grieve and am sad but I resolve myself to keep working harder for them, myself and others,” Rouse said. “People living with ALS find great purpose in life advocating and trying to make a difference.”