Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
On today’s podcast episode, I had a chance to speak with Shai Efrati, a physician and professor in the schools of medicine and neuroscience at Tel Aviv University. Efrati also directs the Sagol Center for Hyperbaric Medicine and Research, and our conversation in this episode focuses on the potential health benefits of hyperbaric oxygen therapy.
Efrati's studies point to a connection between the use of hyperbaric chambers and improvements for a range of health problems such as Long Covid, strokes and traumatic brain injuries. Plus, Efrati has an early line of research suggesting that hyperbaric oxygen therapy could help protect against cognitive decline in healthy people and perhaps even slow down the overall aging process.
We talk about what’s going in on the body during hyperbaric oxygen therapy that could possibly lead to transformative benefits for patients, some of whom had searched for treatments previously and come up empty. We also discuss exactly where Efrati is with this line of inquiry, both what his studies have shown and the great deal of additional research that’s needed before the healthcare system can and should fully embrace hyperbaric oxygen therapy.
Efrati and I talk about why you can’t just go on Amazon and buy something that says hyperbaric – the only way it can have a positive effect is if you access the real version of the chamber and use it correctly under the supervision of a knowledgeable physician.
I also ask Efrati what we know about the short- and long-term risks for those who follow the research-based protocol on a regular basis. And what about accessibility to people without a lot of extra cash to spend on their health? Efrati is already rolling out this therapy at a small number of specialized clinics in places like the Villages retirement community in Florida.
Shai Efrati
A vaccine for Lyme disease could be coming. But will patients accept it?
For more than two decades, Marci Flory, a 40-year-old emergency room nurse from Lawrence, Kan., has battled the recurring symptoms of chronic Lyme disease, an illness which she believes began after being bitten by a tick during her teenage years.
Over the years, Flory has been plagued by an array of mysterious ailments, ranging from fatigue to crippling pain in her eyes, joints and neck, and even postural tachycardia syndrome or PoTS, an abnormal increase in heart rate after sitting up or standing. Ten years ago, she began to experience the onset of neurological symptoms which ranged from brain fog to sudden headaches, and strange episodes of leg weakness which would leave her unable to walk.
“Initially doctors thought I had ALS, or less likely, multiple sclerosis,” she says. “But after repeated MRI scans for a year, they concluded I had a rare neurological condition called acute transverse myelitis.”
But Flory was not convinced. After ordering a variety of private blood tests, she discovered she was infected with a range of bacteria in the genus Borrelia that live in the guts of ticks, the infectious agents responsible for Lyme disease.
“It made sense,” she says. “Looking back, I was bitten in high school and misdiagnosed with mononucleosis. This was probably the start, and my immune system kept it under wraps for a while. The Lyme bacteria can burrow into every tissue in the body, go into cyst form and become dormant before reactivating.”
The reason why cases of Lyme disease are increasing is down to changing weather patterns, triggered by climate change, meaning that ticks are now found across a much wider geographic range than ever before.
When these species of bacteria are transmitted to humans, they can attack the nervous system, joints and even internal organs which can lead to serious health complications such as arthritis, meningitis and even heart failure. While Lyme disease can sometimes be successfully treated with antibiotics if spotted early on, not everyone responds to these drugs, and for patients who have developed chronic symptoms, there is no known cure. Flory says she knows of fellow Lyme disease patients who have spent hundreds of thousands of dollars seeking treatments.
Concerningly, statistics show that Lyme and other tick-borne diseases are on the rise. Recently released estimates based on health insurance records suggest that at least 476,000 Americans are diagnosed with Lyme disease every year, and many experts believe the true figure is far higher.
The reason why the numbers are growing is down to changing weather patterns, triggered by climate change, meaning that ticks are now found across a much wider geographic range than ever before. Health insurance data shows that cases of Lyme disease have increased fourfold in rural parts of the U.S. over the last 15 years, and 65 percent in urban regions.
As a result, many scientists who have studied Lyme disease feel that it is paramount to bring some form of protective vaccine to market which can be offered to people living in the most at-risk areas.
“Even the increased awareness for Lyme disease has not stopped the cases,” says Eva Sapi, professor of cellular and molecular biology at the University of New Haven. “Some of these patients are looking for answers for years, running from one doctor to another, so that is obviously a very big cost for our society at so many levels.”
Emerging vaccines – and backlash
But with the rising case numbers, interest has grown among the pharmaceutical industry and research communities. Vienna-based biotech Valneva have partnered with Pfizer to take their vaccine – a seasonal jab which offers protection against the six most common strains of Lyme disease in the northern hemisphere – into a Phase III clinical trial which began in August. Involving 6,000 participants in a number of U.S. states and northern Europe where Lyme disease is endemic, it could lead to a licensed vaccine by 2025, if it proves successful.
“For many years Lyme was considered a small market vaccine,” explains Monica E. Embers, assistant professor of parasitology at Tulane University in New Orleans. “Now we know that this is a much bigger problem, Pfizer has stepped up to invest in preventing this disease and other pharmaceutical companies may as well.”
Despite innovations, patient communities and their representatives remain ambivalent about the idea of a vaccine. Some of this skepticism dates back to the failed LYMErix vaccine which was developed in the late 1990s before being withdrawn from the market.
At the same time, scientists at Yale University are developing a messenger RNA vaccine which aims to train the immune system to respond to tick bites by exposing it to 19 proteins found in tick saliva. Whereas the Valneva vaccine targets the bacteria within ticks, the Yale vaccine attempts to provoke an instant and aggressive immune response at the site of the bite. This causes the tick to fall off and limits the potential for transmitting dangerous infections.
But despite these innovations, patient communities and their representatives remain ambivalent about the idea of a vaccine. Some of this skepticism dates back to the failed LYMErix vaccine which was developed in the late 1990s before being withdrawn from the market in 2002 after concerns were raised that it might induce autoimmune reactions in humans.
While this theory was ultimately disproved, the lingering stigma attached to LYMErix meant that most vaccine manufacturers chose to stay away from the disease for many years, something which Gregory Poland, head of the Mayo Clinic’s Vaccine Research Group in Minnesota, describes as a tragedy.
“Since 2002, we have not had a human Lyme vaccine in the U.S. despite the increasing number of cases,” says Poland. “Pretty much everyone in the field thinks they’re ten times higher than the official numbers, so you’re probably talking at least 400,000 each year. It’s an incredible burden but because of concerns about anti-vax protestors, until very recently, no manufacturer has wanted to touch this.”
Such was the backlash surrounding the failed LYMErix program that scientists have even explored the most creative of workarounds for protecting people in tick-populated regions, without needing to actually vaccinate them. One research program at the University of Tennessee came up with the idea of leaving food pellets containing a vaccine in woodland areas with the idea that rodents would eat the pellets, and the vaccine would then kill Borrelia bacteria within any ticks which subsequently fed on the animals.
Even the Pfizer-Valneva vaccine has been cautiously designed to try and allay any lingering concerns, two decades after LYMErix. “The concept is the same as the original LYMErix vaccine, but it has been made safer by removing regions that had the potential to induce autoimmunity,” says Embers. “There will always be individuals who oppose vaccines, Lyme or otherwise, but it will be a tremendous boost to public health to have the option.”
Vaccine alternatives
Researchers are also considering alternative immunization approaches in case sufficiently large numbers of people choose to reject any Lyme vaccine which gets approved. Researchers at UMass Chan Medical School have developed an artificially generated antibody, administered via an annual injection, which is capable of killing Borrelia bacteria in the guts of ticks before they can get into the human host.
So far animal studies have shown it to be 100 percent effective, while the scientists have completed a Phase I trial in which they tested it for safety on 48 volunteers in Nebraska. Because this approach provides the antibody directly, rather than triggering the human immune system to produce the antibody like a vaccine would, Embers predicts that it could be a viable alternative for the vaccine hesitant as well as providing an option for immunocompromised individuals who cannot produce enough of their own antibodies.
At the same time, many patient groups still raise concerns over the fact that numerous diagnostic tests for Lyme disease have been reported to have a poor accuracy. Without this, they argue that it is difficult to prove whether vaccines or any other form of immunization actually work. “If the disease is not understood enough to create a more accurate test and a universally accepted treatment protocol, particularly for those who weren’t treated promptly, how can we be sure about the efficacy of a vaccine?” says Natasha Metcalf, co-founder of the organization Lyme Disease UK.
Flory points out that there are so many different types of Borrelia bacteria which cause Lyme disease, that the immunizations being developed may only stop a proportion of cases. In addition, she says that chronic Lyme patients often report a whole myriad of co-infections which remain poorly understood and are likely to also be involved in the disease process.
Marci Flory undergoes an infusion in an attempt to treat her Lyme disease symptoms.
Marci Flory
“I would love to see an effective Lyme vaccine but I have my reservations,” she says. “I am infected with four types of Borrelia bacteria, plus many co-infections – Babesia, Bartonella, Erlichiosis, Rickettsia, and Mycoplasma – all from a single Douglas County Kansas tick bite. Lyme never travels alone and the vaccine won’t protect against all the many strains of Borrelia and co-infections.”
Valneva CEO Thomas Lingelbach admits that the Pfizer-Valneva vaccine is not perfect, but predicts that it will still have significant impact if approved.
“We expect the vaccine to have 75 percent plus efficacy,” he says. “There is this legacy around the old Lyme vaccines, but the world is very, very different today. The number of clinical manifestations known to be caused by infection with Lyme Borreliosis has significantly increased, and the understanding around severity has certainly increased.”
Embers agrees that while it will still be important for doctors to monitor for other tick-borne infections which are not necessarily covered by the vaccine, having any clinically approved jab would still represent a major step forward in the fight against the disease.
“I think that any vaccine must be properly vetted, and these companies are performing extensive clinical trials to do just that,” she says. “Lyme is the most common tick-borne disease in the U.S. so the public health impact could be significant. However, clinicians and the general public must remain aware of all of the other tick-borne diseases such as Babesia and Anaplasma, and continue to screen for those when a tick bite is suspected.”