Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
How a Deadly Fire Gave Birth to Modern Medicine
On the evening of November 28, 1942, more than 1,000 revelers from the Boston College-Holy Cross football game jammed into the Cocoanut Grove, Boston's oldest nightclub. When a spark from faulty wiring accidently ignited an artificial palm tree, the packed nightspot, which was only designed to accommodate about 500 people, was quickly engulfed in flames. In the ensuing panic, hundreds of people were trapped inside, with most exit doors locked. Bodies piled up by the only open entrance, jamming the exits, and 490 people ultimately died in the worst fire in the country in forty years.
"People couldn't get out," says Dr. Kenneth Marshall, a retired plastic surgeon in Boston and president of the Cocoanut Grove Memorial Committee. "It was a tragedy of mammoth proportions."
Within a half an hour of the start of the blaze, the Red Cross mobilized more than five hundred volunteers in what one newspaper called a "Rehearsal for Possible Blitz." The mayor of Boston imposed martial law. More than 300 victims—many of whom subsequently died--were taken to Boston City Hospital in one hour, averaging one victim every eleven seconds, while Massachusetts General Hospital admitted 114 victims in two hours. In the hospitals, 220 victims clung precariously to life, in agonizing pain from massive burns, their bodies ravaged by infection.
The scene of the fire.
Boston Public Library
Tragic Losses Prompted Revolutionary Leaps
But there is a silver lining: this horrific disaster prompted dramatic changes in safety regulations to prevent another catastrophe of this magnitude and led to the development of medical techniques that eventually saved millions of lives. It transformed burn care treatment and the use of plasma on burn victims, but most importantly, it introduced to the public a new wonder drug that revolutionized medicine, midwifed the birth of the modern pharmaceutical industry, and nearly doubled life expectancy, from 48 years at the turn of the 20th century to 78 years in the post-World War II years.
The devastating grief of the survivors also led to the first published study of post-traumatic stress disorder by pioneering psychiatrist Alexandra Adler, daughter of famed Viennese psychoanalyst Alfred Adler, who was a student of Freud. Dr. Adler studied the anxiety and depression that followed this catastrophe, according to the New York Times, and "later applied her findings to the treatment World War II veterans."
Dr. Ken Marshall is intimately familiar with the lingering psychological trauma of enduring such a disaster. His mother, an Irish immigrant and a nurse in the surgical wards at Boston City Hospital, was on duty that cold Thanksgiving weekend night, and didn't come home for four days. "For years afterward, she'd wake up screaming in the middle of the night," recalls Dr. Marshall, who was four years old at the time. "Seeing all those bodies lined up in neat rows across the City Hospital's parking lot, still in their evening clothes. It was always on her mind and memories of the horrors plagued her for the rest of her life."
The sheer magnitude of casualties prompted overwhelmed physicians to try experimental new procedures that were later successfully used to treat thousands of battlefield casualties. Instead of cutting off blisters and using dyes and tannic acid to treat burned tissues, which can harden the skin, they applied gauze coated with petroleum jelly. Doctors also refined the formula for using plasma--the fluid portion of blood and a medical technology that was just four years old--to replenish bodily liquids that evaporated because of the loss of the protective covering of skin.
"Every war has given us a new medical advance. And penicillin was the great scientific advance of World War II."
"The initial insult with burns is a loss of fluids and patients can die of shock," says Dr. Ken Marshall. "The scientific progress that was made by the two institutions revolutionized fluid management and topical management of burn care forever."
Still, they could not halt the staph infections that kill most burn victims—which prompted the first civilian use of a miracle elixir that was being secretly developed in government-sponsored labs and that ultimately ushered in a new age in therapeutics. Military officials quickly realized this disaster could provide an excellent natural laboratory to test the effectiveness of this drug and see if it could be used to treat the acute traumas of combat in this unfortunate civilian approximation of battlefield conditions. At the time, the very existence of this wondrous medicine—penicillin—was a closely guarded military secret.
From Forgotten Lab Experiment to Wonder Drug
In 1928, Alexander Fleming discovered the curative powers of penicillin, which promised to eradicate infectious pathogens that killed millions every year. But the road to mass producing enough of the highly unstable mold was littered with seemingly unsurmountable obstacles and it remained a forgotten laboratory curiosity for over a decade. But Fleming never gave up and penicillin's eventual rescue from obscurity was a landmark in scientific history.
In 1940, a group at Oxford University, funded in part by the Rockefeller Foundation, isolated enough penicillin to test it on twenty-five mice, which had been infected with lethal doses of streptococci. Its therapeutic effects were miraculous—the untreated mice died within hours, while the treated ones played merrily in their cages, undisturbed. Subsequent tests on a handful of patients, who were brought back from the brink of death, confirmed that penicillin was indeed a wonder drug. But Britain was then being ravaged by the German Luftwaffe during the Blitz, and there were simply no resources to devote to penicillin during the Nazi onslaught.
In June of 1941, two of the Oxford researchers, Howard Florey and Ernst Chain, embarked on a clandestine mission to enlist American aid. Samples of the temperamental mold were stored in their coats. By October, the Roosevelt Administration had recruited four companies—Merck, Squibb, Pfizer and Lederle—to team up in a massive, top-secret development program. Merck, which had more experience with fermentation procedures, swiftly pulled away from the pack and every milligram they produced was zealously hoarded.
After the nightclub fire, the government ordered Merck to dispatch to Boston whatever supplies of penicillin that they could spare and to refine any crude penicillin broth brewing in Merck's fermentation vats. After working in round-the-clock relays over the course of three days, on the evening of December 1st, 1942, a refrigerated truck containing thirty-two liters of injectable penicillin left Merck's Rahway, New Jersey plant. It was accompanied by a convoy of police escorts through four states before arriving in the pre-dawn hours at Massachusetts General Hospital. Dozens of people were rescued from near-certain death in the first public demonstration of the powers of the antibiotic, and the existence of penicillin could no longer be kept secret from inquisitive reporters and an exultant public. The next day, the Boston Globe called it "priceless" and Time magazine dubbed it a "wonder drug."
Within fourteen months, penicillin production escalated exponentially, churning out enough to save the lives of thousands of soldiers, including many from the Normandy invasion. And in October 1945, just weeks after the Japanese surrender ended World War II, Alexander Fleming, Howard Florey and Ernst Chain were awarded the Nobel Prize in medicine. But penicillin didn't just save lives—it helped build some of the most innovative medical and scientific companies in history, including Merck, Pfizer, Glaxo and Sandoz.
"Every war has given us a new medical advance," concludes Marshall. "And penicillin was the great scientific advance of World War II."
This Boy Struggled to Walk Before Gene Therapy. Now, Such Treatments Are Poised to Explode.
Conner Curran was diagnosed with Duchenne's muscular dystrophy in 2015 when he was four years old. It's the most severe form of the genetic disease, with a nearly inevitable progression toward total paralysis. Many Duchenne's patients die in their teens; the average lifespan is 26.
But Conner, who is now 10, has experienced some astonishing improvements in recent years. He can now walk for more than two miles at a time – an impossible journey when he was younger.
In 2018, Conner became the very first patient to receive gene therapy specific to treating Duchenne's. In the initial clinical trial of nine children, nearly 80 percent reacted positively to the treatment). A larger-scale stage 3 clinical trial is currently underway, with initial results expected next year.
Gene therapy involves altering the genes in an individual's cells to stop or treat a disease. Such a procedure may be performed by adding new gene material to existing cells, or editing the defective genes to improve their functionality.
That the medical world is on the cusp of a successful treatment for a crippling and deadly disease is the culmination of more than 35 years of work by Dr. Jude Samulski, a professor of pharmacology at the University of North Carolina School of Medicine in Chapel Hill. More recently, he's become a leading gene therapy entrepreneur.
But Samulski likens this breakthrough to the frustrations of solving a Rubik's cube. "Just because one side is now all the color yellow does not mean that it is completely aligned," he says.
Although Conner's life and future have dramatically improved, he's not cured. The gene therapy tamed but did not extinguish his disorder: Conner is now suffering from the equivalent of Becker's muscular dystrophy, a milder form of the disease with symptoms that appear later in life and progress more slowly. Moreover, the loss of muscle cells Conner suffered prior to the treatment is permanent.
"It will take more time and more innovations," Samulski says of finding an even more effective gene therapy for muscular dystrophy.
Conner's family is still overjoyed with the results. "Jude's grit and determination gave Conner a chance at a new life, one that was not in his cards before gene therapy," says his mother Jessica Curran. She adds that "Conner is more confident than before and enjoys life, even though he has limitations, if compared to his brothers or peers."
Conner Curran holding a football post gene therapy treatment.
Courtesy of the Curran family
For now, the use of gene therapy as a treatment for diseases and disorders remains relatively isolated. On paper at least, progress appears glacially slow. In 2018, there were four FDA-approved gene therapies (excluding those reliant on bone marrow/stem cell transplants or implants). Today, there are 10. One therapy is solely for the cosmetic purpose of reducing facial lines and folds.
Nevertheless, experts in the space believe gene therapy is poised to expand dramatically.
"Certainly in the next three to five years you will see dozens of gene therapies and cell therapies be approved," says Dr. Pavan Cheruvu, who is CEO of Sio Gene Therapies in New York. The company is developing treatments for Parkinson's disease and Tay-Sachs, among other diseases.
Cheruvu's conclusion is supported by NEWDIGS, a think tank at the Massachusetts Institute of Technology that keeps tabs on gene therapy developments. NEWDIGS predicts there will be at least 60 gene therapies approved for use in the U.S. by the end of the decade. That number could be closer to 100 if Chinese researchers and biotech ventures decide the American market is a good fit for the therapies they develop.
"We are watching something of a conditional evolution, like a dot-com, or cellphones that were sizes of shoeboxes that have now matured to the size of wafers. Our space will follow along very similarly."
Dr. Carsten Brunn, a chemist by training and CEO of Selecta Biosciences outside of Boston, is developing ways to reduce the immune responses in patients who receive gene therapy. He observes that there are more than 300 therapies in development and thousands of clinical trials underway. "It's definitely an exciting time in the field," he says.
That's a far cry from the environment of little more than a decade ago. Research and investment in gene therapy had been brought low for years after the death of teenager Jesse Gelsinger in 1999 while he had been enrolled in a clinical trial to treat a liver disease. Gene therapy was a completely novel concept back then, and his death created existential questions about whether it was a proper pathway to pursue. Cheruvu, a cardiologist, calls the years after Gelsinger's death an "ice age" for gene therapy.
However, those dark years eventually yielded to a thaw. And while there have been some recent stumbles, they are considered part of the trial-and-error that has often accompanied medical research as opposed to an ominous "stop" sign.
The deaths of three patients last year receiving gene therapy for myotubular myopathy – a degenerative disease that causes severe muscle weakness – promptly ended the clinical trial in which they were enrolled. However, the incident caused few ripples beyond that. Researchers linked the deaths to dosage sizes that caused liver toxicity, as opposed to the gene therapy itself being an automatic death sentence; younger patients who received lower doses due to a less advanced disease state experienced improvements.
The gene sequencing and editing that helped create vaccines for COVID-19 in record time also bolstered the argument for more investment in research and development. Cheruvu notes that the field has usually been the domain of investors with significant expertise in the field; these days, more money is flowing in from generalists.
The Challenges Ahead
What will be the next step in gene therapy's evolution? Many of Samulski's earliest innovations came in the laboratory, for example. Then that led to him forming a company called AskBio in collaboration with the Muscular Dystrophy Association. AskBio sold its gene therapy to Pfizer five years ago to assure that enough could be manufactured for stage 3 clinical trials and eventually reach the market.
Cheruvu suggests that many future gene therapy innovations will be the result of what he calls "congruent innovation." That means publicly funded laboratories and privately funded companies might develop treatments separately or in collaboration. Or, university scientists may depend on private ventures to solve one of gene therapy's most vexing issues: producing enough finished material to test and treat on a large scale. "Manufacturing is a real bottleneck right now," Brunn says.
The alternative is referred to in the sector as the "valley of death": a lab has found a promising treatment, but is not far enough along in development to submit an investigational new drug application with the FDA. The promise withers away as a result. But the new abundance of venture capital for gene therapy has made this scenario less of an issue for private firms, some of which have received hundreds of millions of dollars in funding.
There are also numerous clinical challenges. Many gene therapies use what are known as adeno-associated virus vectors (AAVs) to deliver treatments. They are hollowed-out husks of viruses that can cause a variety of mostly mild maladies ranging from colds to pink eye. They are modified to deliver the genetic material used in the therapy. Most of these vectors trigger an antibody reaction that limits treatments to a single does or a handful of smaller ones. That can limit the potential progress for patients – an issue referred to as treatment "durability."
Although vectors from animals such as horses trigger far less of an antibody reaction in patients -- and there has been significant work done on using artificial vectors -- both are likely years away from being used on a large scale. "For the foreseeable future, AAV is the delivery system of choice," Brunn says.
Also, there will likely be demand for concurrent gene therapies that can lead to a complete cure – not only halting the progress of Duchenne's in kids like Conner Curran, but regenerating their lost muscle cells, perhaps through some form of stem cell therapy or another treatment that has yet to be devised.
Nevertheless, Samulski believes demand for imperfect treatments will be high – particularly with a disease such as muscular dystrophy, where many patients are mere months from spending the remainder of their lives in wheelchairs. But Samulski believes those therapies will also inevitably evolve into something far more effective.
"We are watching something of a conditional evolution, like a dot-com, or cellphones that were sizes of shoeboxes that have now matured to the size of wafers," he says. "Our space will follow along very similarly."
Jessica Curran will remain forever grateful for what her son has received: "Jude gave us new hope. He gave us something that is priceless – a chance to watch Conner grow up and live out his own dreams."