Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
How Excessive Regulation Helped Ignite COVID-19's Rampant Spread
When historians of the future look back at the 2020 pandemic, the heroic work of Helen Y. Chu, a flu researcher at the University of Washington, will be worthy of recognition.
Chu's team bravely defied the order and conducted the testing anyway.
In late January, Chu was testing nasal swabs for the Seattle Flu Study to monitor influenza spread when she learned of the first case of COVID-19 in Washington state. She deemed it a pressing public health matter to document if and how the illness was spreading locally, so that early containment efforts could succeed. So she sought regulatory approval to adapt the Flu Study to test for the coronavirus, but the federal government denied the request because the original project was funded to study only influenza.
Aware of the urgency, Chu's team bravely defied the order and conducted the testing anyway. Soon they identified a local case in a teenager without any travel history, followed by others. Still, the government tried to shutter their efforts until the outbreak grew dangerous enough to command attention.
Needless testing delays, prompted by excessive regulatory interference, eliminated any chances of curbing the pandemic at its initial stages. Even after Chu went out on a limb to sound alarms, a heavy-handed bureaucracy crushed the nation's ability to roll out early and widespread testing across the country. The Centers for Disease Control and Prevention infamously blundered its own test, while also impeding state and private labs from coming on board, fueling a massive shortage.
The long holdup created "a backlog of testing that needed to be done," says Amesh Adalja, an infectious disease specialist who is a senior scholar at the Johns Hopkins University Center for Health Security.
In a public health crisis, "the ideal situation" would allow the government's test to be "supplanted by private laboratories" without such "a lag in that transition," Adalja says. Only after the eventual release of CDC's test could private industry "begin in earnest" to develop its own versions under the Food and Drug Administration's emergency use authorization.
In a statement, CDC acknowledged that "this process has not gone as smoothly as we would have liked, but there is currently no backlog for testing at CDC."
Now, universities and corporations are in a race against time, playing catch up as the virus continues its relentless spread, also afflicting many health care workers on the front lines.
"Home-testing accessibility is key to preventing further spread of the COVID-19 pandemic."
Hospitals are attempting to add the novel coronavirus to the testing panel of their existent diagnostic machines, which would reduce the results processing time from 48 hours to as little as four hours. Meanwhile, at least four companies announced plans to deliver at-home collection tests to help meet the demand – before a startling injunction by the FDA halted their plans.
Everlywell, an Austin, Texas-based digital health company, had been set to launch online sales of at-home collection kits directly to consumers last week. Scaling up in a matter of days to an initial supply of 30,000 tests, Everlywell collaborated with multiple laboratories where consumers could ship their nasal swab samples overnight, projecting capacity to screen a quarter-million individuals on a weekly basis, says Frank Ong, chief medical and scientific officer.
Secure digital results would have been available online within 48 hours of a sample's arrival at the lab, as well as a telehealth consultation with an independent, board-certified doctor if someone tested positive, for an inclusive $135 cost. The test has a less than 3 percent false-negative rate, Ong says, and in the event of an inadequate self-swab, the lab would not report a conclusive finding. "Home-testing accessibility," he says, "is key to preventing further spread of the COVID-19 pandemic."
But on March 20, the FDA announced restrictions on home collection tests due to concerns about accuracy. The agency did note "the public health value in expanding the availability of COVID-19 testing through safe and accurate tests that may include home collection," while adding that "we are actively working with test developers in this space."
After the restrictions were announced, Everlywell decided to allocate its initial supply of COVID-19 collection kits to hospitals, clinics, nursing homes, and other qualifying health care companies that can commit to no-cost screening of frontline workers and high-risk symptomatic patients. For now, no consumers can order a home-collection test.
"Losing two months is close to disastrous, and that's what we did."
Currently, the U.S. has ramped up to testing an estimated 100,000 people a day, according to Stat News. But 150,000 or more Americans should be tested every day, says Ashish Jha, professor and director of the Harvard Global Health Institute. Due to the dearth of tests, many sick people who suspect they are infected still cannot get confirmation unless they need to be hospitalized.
To give a concrete sense of how far behind we are in testing, consider Palm Beach County, Fla. The state's only drive-thru test center just opened there, requiring an appointment. The center aims to test 750 people per day, but more than 330,000 people have already called to try to book a slot.
"This is such a rapidly moving infection that losing a few days is bad, and losing a couple of weeks is terrible," says Jha, a practicing general internist. "Losing two months is close to disastrous, and that's what we did."
At this point, it will take a long time to fully ramp up. "We are blindfolded," he adds, "and I'd like to take the blindfolds off so we can fight this battle with our eyes wide open."
Better late than never: Yesterday, FDA Commissioner Stephen Hahn said in a statement that the agency has worked with more than 230 test developers and has approved 20 tests since January. An especially notable one was authorized last Friday – 67 days since the country's first known case in Washington state. It's a rapid point-of-care test from medical-device firm Abbott that provides positive results in five minutes and negative results in 13 minutes. Abbott will send 50,000 tests a day to urgent care settings. The first tests are expected to ship tomorrow.
Your Privacy vs. the Public's Health: High-Tech Tracking to Fight COVID-19 Evokes Orwell
The COVID-19 pandemic has placed public health and personal privacy on a collision course, as smartphone technology has completely rewritten the book on contact tracing.
It's not surprising that an autocratic regime like China would adopt such measures, but democracies such as Israel have taken a similar path.
The gold standard – patient interviews and detective work – had been in place for more than a century. It's been all but replaced by GPS data in smartphones, which allows contact tracing to occur not only virtually in real time, but with vastly more precision.
China has gone the furthest in using such tech to monitor and prevent the spread of the coronavirus. It developed an app called Health Code to determine which of its citizens are infected or at risk of becoming infected. It has assigned each individual a color code – red, yellow or green – and restricts their movement depending on their assignment. It has also leveraged its millions of public video cameras in conjunction with facial recognition tech to identify people in public who are not wearing masks.
It's not surprising that an autocratic regime like China would adopt such measures, but democracies such as Israel have taken a similar path. The national security agency Shin Bet this week began analyzing all personal cellphone data under emergency measures approved by the government. It texts individuals when it's determined they had been in contact with someone who had the coronavirus. In Spain and China, police have sent drones aloft searching for people violating stay-at-home orders. Commands to disperse can be issued through audio systems built into the aircraft. In the U.S., efforts are underway to lift federal restrictions on drones so that police can use them to prevent people from gathering.
The chief executive of a drone manufacturer in the U.S. aptly summed up the situation in an interview with the Financial Times: "It seems a little Orwellian, but this could save lives."
Epidemics and how they're surveilled often pose thorny dilemmas, according to Craig Klugman, a bioethicist and professor of health sciences at DePaul University in Chicago. "There's always a moral issue to contact tracing," he said, adding that the issue doesn't change by nation, only in the way it's resolved.
"Once certain privacy barriers have been breached, it can be difficult to roll them back again."
In China, there's little to no expectation for privacy, so their decision to take the most extreme measures makes sense to Klugman. "In China, the community comes first. In the U.S., individual rights come first," he said.
As the U.S. has scrambled to develop testing kits and manufacture ventilators to identify potential patients and treat them, individual rights have mostly not received any scrutiny. However, that could change in the coming weeks.
The American approach is also leaning toward using smartphone apps, but in a way that may preserve the privacy of users. Researchers at MIT have released a prototype known as Private Kit: Safe Paths. Patients diagnosed with the coronavirus can use the app to disclose their location trail for the prior 28 days to other users without releasing their specific identity. They also have the option of sharing the data with public health officials. But such an app would only be effective if there is a significant number of users.
Singapore is offering a similar app to its citizens known as TraceTogether, which uses both GPS and Bluetooth pings among users to trace potential encounters. It's being offered on a voluntary basis.
The Electronic Frontier Foundation, the leading nonprofit organization defending civil liberties in the digital world, said it is monitoring how these apps are developed and deployed. "Governments around the world are demanding new dragnet location surveillance powers to contain the COVID-19 outbreak," it said in a statement. "But before the public allows their governments to implement such systems, governments must explain to the public how these systems would be effective in stopping the spread of COVID-19. There's no questioning the need for far-reaching public health measures to meet this urgent challenge, but those measures must be scientifically rigorous, and based on the expertise of public health professionals."
Andrew Geronimo, director of the intellectual property venture clinic at the Case Western University School of Law, said that the U.S. government is currently in talks with Facebook, Google and other tech companies about using deidentified location data from smartphones to better monitor the progress of the outbreak. He was hesitant to endorse such a step.
"These companies may say that all of this data is anonymized," he said, "but studies have shown that it is difficult to fully anonymize data sets that contain so much information about us."
Beyond the technical issues, social attitudes may mount another challenge. Epic events such as 9/11 tend to loosen vigilance toward protecting privacy, according to Klugman and Geronimo. And as more people are sickened and hospitalized in the U.S. with COVID-19, Klugman believes more Americans will be willing to allow themselves to be tracked. "If that happens, there needs to be a time limitation," he said.
However, even if time limits are put in place, Geronimo believes it would lead to an even greater rollback of privacy during the next crisis.
"Once certain privacy barriers have been breached, it can be difficult to roll them back again," he warned. "And the prior incidents could always be used as a precedent – or as proof of concept."