Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
Every weekend since January, pediatrician Cora Collette Breuner has volunteered to give the COVID-19 vaccine to individuals from age 12 to 96 in an underserved community in Washington state.
Even though the COVID-19 vaccines have been shown to be incredibly safe and effective, there's still quite a bit of hesitancy among parents to vaccinate their teenage children, says Breuner, an adolescent medicine specialist at Seattle Children's Hospital and a past chair of the American Academy of Pediatrics' Committee on Adolescence. "They have questions and they have questions," she says.
Breuner patiently answers them all. Even then, parents—who have the final say in whether their child gets the vaccine—may be reluctant to sign off on it.
In 41 states, parents must consent for minors under age 18 to receive a COVID-19 vaccine. One state—Nebraska—requires parental consent for individuals under age 19, according to the Kaiser Family Foundation. Healthcare workers can't legally give teens COVID-19 vaccines otherwise. In a May report, the nonprofit healthcare organization highlights that from a legal perspective, "the landscape may be shifting slightly as more jurisdictions seek to encourage vaccination of young people."
Meanwhile, as the Delta variant creates a new surge in cases, some ethicists and pediatricians argue that state laws should be amended or loosened to allow minors to consent to COVID-19 vaccination on their own, without the need for parental permission.
"COVID-19 has killed millions of people around the world and disrupted the global economy," says pediatrician John Lantos. "It's a global catastrophe that requires special rules."
There are compelling arguments in favor of letting minors consent on their own, says Robyn Shapiro, a health care lawyer and a bioethicist in the Milwaukee area. "By that, I mean they're either old enough or they're evaluated in such a way that they have sufficient understanding of what they're agreeing to."
Shapiro and other ethicists argue that teens are perfectly capable of giving "informed consent"—a key principle in ethics that means fully understanding the benefits and risks of a medical intervention. To give informed consent, a person must be able to process that information in line with their own values. Only then can they make an autonomous choice and sign a consent form, Shapiro says.
Most states already have laws permitting minors to consent to testing and treatments related to sexually transmitted diseases, birth control, behavioral health, and substance abuse. It wouldn't be that much of a stretch to add COVID-19 vaccination to the list, Shapiro says. New Jersey and New York have introduced bills to let teens as young as 14 to consent to getting the COVID-19 vaccine and Minnesota has proposed a bill to allow children as young as 12 to give consent.
With any medical test or intervention, doctors often wrestle with how to best involve teens in conversations about their own health care, says John Lantos, a pediatrician and director of the Bioethics Center at Children's Mercy Kansas City.
"Most bioethicists would say that [teens] should be included to the degree that they have decision-making capacity," he says. "In most cases, that means including them in discussions with their parents in trying to achieve consensus about what the best choice may be."
COVID-19 vaccination also presents a unique circumstance, Lantos notes. It raises the question: Should teens have greater decisional authority because it's a public health emergency? In his opinion, the answer is yes. "COVID-19 has killed millions of people around the world and disrupted the global economy," says pediatrician Lantos. "It's a global catastrophe that requires special rules."
In North Carolina, state legislators are moving to do the opposite. State law currently allows those under 18 to make vaccination decisions on their own, but on Aug. 5, North Carolina's General Assembly approved a Republican-sponsored bill requiring parental consent for 12- to 17-year-olds to get a COVID-19 vaccine.
Kyle Brothers, a pediatrician in Louisville, Kentucky, says it's "ethically justifiable" for states to permit adolescents, especially those on the verge of adulthood, to consent to COVID-19 vaccination and other straightforward medical care.
In many cases, 16- and 17-year-old adolescents are capable of making well-informed decisions, says Brothers, a member of the American Academy of Pediatrics' Section on Bioethics. "The problem is, the law tends not to have that level of nuance," he adds. "We know in the real world that maturing and developing the ability to make decisions is a continuous process, but the law sets a bright line at age 18."
Lacking parental consent, some defiant teens are researching avenues to get vaccinated without their mom's or dad's knowledge. They may have turned to VaxTeen.org, a site operated by a Los Angeles teenager that provides information on consent laws by state.
If parents are wavering on the decision to give consent, Breuner recommends that they speak with a trusted healthcare provider about their specific concerns. These kinds of dialogues often can clarify lingering worries and may help drive up consent rates for teen vaccination.
Vaccine-hesitant parents should hear out their teens who wish to be vaccinated. Teenagers have their own opinions and belief systems, and parents should respect their child's choice to be vaccinated if they wish, considering the minimal risk of harm and the significant benefit to society as a whole.
George J. Annas, professor and director at the Center for Health Law, Ethics & Human Rights at Boston University, says parents have a legal obligation to provide their children with necessary medical treatment, or they could be found guilty of child neglect. The circumstances vary, but in the face of unrelenting COVID-19, he says parents have an ethical duty to consent to teens' vaccination because "the disease is rampant and children are dying."
The Nose Knows: Dogs Are Being Trained to Detect the Coronavirus
Asher is eccentric and inquisitive. He loves an audience, likes keeping busy, and howls to be let through doors. He is a six-year-old working Cocker Spaniel, who, with five other furry colleagues, has now been trained to sniff body odor samples from humans to detect COVID-19 infections.
As the Delta variant and other new versions of the SARS-CoV-2 virus emerge, public health agencies are once again recommending masking while employers contemplate mandatory vaccination. While PCR tests remain the "gold standard" of COVID-19 tests, they can take hours to flag infections. To accelerate the process, scientists are turning to a new testing tool: sniffer dogs.
At the London School of Hygiene and Tropical Medicine (LSHTM), researchers deployed Asher and five other trained dogs to test sock samples from 200 asymptomatic, infected individuals and 200 healthy individuals. In May, they published the findings of the yearlong study in a preprint, concluding that dogs could identify COVID-19 infections with a high degree of accuracy – they could correctly identify a COVID-positive sample up to 94% of the time and a negative sample up to 92% of the time. The paper has yet to be peer-reviewed.
"Dogs can screen lots of people very quickly – 300 people per dog per hour. This means they could be used in places like airports or public venues like stadiums and maybe even workplaces," says James Logan, who heads the Department of Disease Control at LSHTM, adding that canines can also detect variants of SARS-CoV-2. "We included samples from two variants and the dogs could still detect them."
Detection dogs have been one of the most reliable biosensors for identifying the odor of human disease. According to Gemma Butlin, a spokesperson of Medical Detection Dogs, the UK-based charity that trained canines for the LSHTM study, the olfactory capabilities of dogs have been deployed to detect malaria, Parkinson's disease, different types of cancers, as well as pseudomonas, a type of bacteria known to cause infections in blood, lungs, eyes, and other parts of the human body.
COVID-19 has a distinctive smell — a result of chemicals known as volatile organic compounds released by infected body cells, which give off an odor "fingerprint."
"It's estimated that the percentage of a dog's brain devoted to analyzing odors is 40 times larger than that of a human," says Butlin. "Humans have around 5 million scent receptors dedicated to smell. Dogs have 350 million and can detect odors at parts per trillion. To put this into context, a dog can detect a teaspoon of sugar in a million gallons of water: two Olympic-sized pools full."
According to LSHTM scientists, COVID-19 has a distinctive smell — a result of chemicals known as volatile organic compounds released by infected body cells, which give off an odor "fingerprint." Other studies, too, have revealed that the SARS-CoV-2 virus has a distinct olfactory signature, detectable in the urine, saliva, and sweat of infected individuals. Humans can't smell the disease in these fluids, but dogs can.
"Our research shows that the smell associated with COVID-19 is at least partly due to small and volatile chemicals that are produced by the virus growing in the body or the immune response to the virus or both," said Steve Lindsay, a public health entomologist at Durham University, whose team collaborated with LSHTM for the study. He added, "There is also a further possibility that dogs can actually smell the virus, which is incredible given how small viruses are."
In April this year, researchers from the University of Pennsylvania and collaborators published a similar study in the scientific journal PLOS One, revealing that detection dogs could successfully discriminate between urine samples of infected and uninfected individuals. The accuracy rate of canines in this study was 96%. Similarly, last December, French scientists found that dogs were 76-100% effective at identifying individuals with COVID-19 when presented with sweat samples.
Grandjean Dominique, a professor at France's National Veterinary School of Alfort, who led the French study, said that the researchers used two types of dogs — search and rescue dogs, as they can sniff sweat, and explosive detection dogs, because they're often used at airports to find bomb ingredients. Dogs may very well be as good as PCR tests, said Dominique, but the goal, he added, is not to replace these tests with canines.
In France, the government gave the green light to train hundreds of disease detection dogs and deploy them in airports. "They will act as mass pre-test, and only people who are positive will undergo a PCR test to check their level of infection and the kind of variant," says Dominique. He thinks the dogs will be able to decrease the amount of PCR testing and potentially save money.
Since the accuracy rate for bio-detection dogs is fairly high, scientists think they could prove to be a quick diagnosis and mass screening tool, especially at ports, airports, train stations, stadiums, and public gatherings. Countries like Finland, Thailand, UAE, Italy, Chile, India, Australia, Pakistan, Saudi Arabia, Switzerland, and Mexico are already training and deploying canines for COVID-19 detection. The dogs are trained to sniff the area around a person, and if they find the odor of COVID-19 they will sit or stand back from an individual as a signal that they've identified an infection.
While bio-detection dogs seem promising for cheap, large-volume screening, many of the studies that have been performed to date have been small and in controlled environments. The big question is whether this approach work on people in crowded airports, not just samples of shirts and socks in a lab.
"The next step is 'real world' testing where they [canines] are placed in airports to screen people and see how they perform," says Anna Durbin, professor of international health at the John Hopkins Bloomberg School of Public Health. "Testing in real airports with lots of passengers and competing scents will need to be done."
According to Butlin of Medical Detection Dogs, scalability could be a challenge. However, scientists don't intend to have a dog in every waiting room, detecting COVID-19 or other diseases, she said.
"Dogs are the most reliable bio sensors on the planet and they have proven time and time again that they can detect diseases as accurately, if not more so, than current technological diagnostics," said Butlin. "We are learning from them all the time and what their noses know will one day enable the creation an 'E-nose' that does the same job – imagine a day when your mobile phone can tell you that you are unwell."