Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
Steven Pinker: Data Shows That Life Today Is Better Than Ever
The government shutdown. A volatile stock market. Climate change.
It's so easy to get discouraged by the latest headlines, argues Steven Pinker, that we lose sight of the bigger picture: life today is actually improving.
"To appreciate the world, we've got to look at numbers and trends."
Pinker, a cognitive psychologist from Harvard, says in his book "Enlightenment Now" that we're living at the greatest moment of progress in history, thanks to reason, science, and humanism. But today, he says, these ideals are under-appreciated, and we ignore them at our peril.
So he set out to provide a vigorous moral defense of the values of the Enlightenment by examining the evidence for their effectiveness. Across a range of categories from happiness and health to peace and safety, Pinker examines the data and reassures readers that this is a pretty great time to be alive. As we kick off the new year, he's hopeful that our embrace of science and reason will lead to an even more prosperous future. But political and cultural hurdles must still be overcome before the heroic story of human progress can continue to unfold.
Pinker spoke with our Editor-in-Chief Kira Peikoff in advance of the book's paperback release, which hits stores next Tuesday. This interview has been edited and condensed for clarity.
One anecdote you describe in the book was particularly striking: how the public reacted when the polio vaccine was announced. People took the day off work to celebrate, they smiled at each other in the streets, they offered to throw parades. Today, it's hard to imagine such prevalent enthusiasm for a new advance. How can we bring back a culture of respect and gratitude for science?
That's such a good question. And I wish I knew the answer. My contribution is just to remind people of how much progress we've made. It's easy to ignore if your view of the world comes from headlines, but there are some built-in biases in journalism that we have to counteract. Most things that happen all of a sudden are bad things: wars break out, terrorists attack, rampage shootings occur, whereas a lot of the things that make us better off creep up by stealth. But we have to become better aware of them.
It's unlikely that we're going to have replications of the great Salk event, which happened on a particular day, but I think we have to take lessons from cognitive science, from the work of people like Daniel Kahneman and Amos Tversky, showing how misled we can be by images and narratives and that to appreciate the world, we've got to look at numbers and trends.
The cover of "Enlightenment Now," which comes out in paperback next week.
You mention that the President's Bioethics Council under Bush was appointed to deal with "the looming threat of biomedical advances." Do you think that professional bioethicists are more of a hindrance than a help when it comes to creating truly enlightened science policy?
I do. I think that there are some problems in the culture of bioethics. And of course, I would not argue against that the concept of bioethics. Obviously, we have to do biomedical research and applications conscientiously and ethically. But the field called Bioethics tends to specialize in exotic thought experiments that tend to imagine the worst possible things that can happen, and often mire research in red tape that results in a net decrease in human welfare, whereas the goal of bioethics should be to enhance human welfare.
In an op-ed that I published in the Boston Globe a few years ago, I said, deliberately provocatively, that the main moral imperative of bioethics is to get out of the way since there's so much suffering that humans endure from degenerative diseases, from cancer, from heart disease and stroke. The potential for increasing happiness and well-being from biomedical research is just stupendous. So before we start to drag out Brave New World for the umpteenth time, or compare every advance in genetics to the Nazis, we should remember the costs of people dying prematurely from postponing advances in biomedical research.
Later in the book, you mention how much more efficient the production of food has become due to high-tech agriculture. But so many people today are leery of advances in the food industry, like GMOs. And we will have to feed 10 billion people in 2050. Are you concerned about how we will meet that challenge?
Yes, I think anyone has to be, and all the more reason we should be clear about what is simultaneously best for humans and for the planet, which is to grow as much food on this planet as possible. That ideal of density -- the less farmland the better -- runs up against the ideal of the organic farming and natural farming, which use lots of land. So genetically modified organisms and precision agriculture of the kind that is sometimes associated with Israel -- putting every last drop of water to use, delivering it when it's needed, using the minimum amount of fertilizer -- all of these technologically driven developments are going to be necessary to meet that need.
"The potential for increasing happiness and well-being from biomedical research is just stupendous."
You also mention "sustainability" as this big buzz word that you say is based on a flawed assumption that we will run out of resources rather than pivot to ingenious alternatives. What's the most important thing we can do as a culture to encourage innovation?
It has to be an ideal. We have restore it as what we need to encourage, to glorify in order to meet the needs of humanity. Governments have to play a role because lots of innovation is just too risky with benefits that are too widely diffuse for private companies and individuals to pursue. International cooperation has to play a role. And also, we need to change our environmental philosophy from a reflexive rejection of technology to an acknowledgement that it will be technology that is our best hope for staving off environmental problems.
And yet innovation and technology today are so often viewed fearfully by the public -- just look at AI and gene editing. If we need science and technology to solve our biggest challenges, how do we overcome this disconnect?
Part of it is simply making the argument that is challenging the ideology and untested assumptions behind traditional Greenism. Also, on the part of the promoters of technology themselves, it's crucial to make it not just clear, but to make it a reality that technology is going to be deployed to enhance human welfare.
That of course means an acknowledgement of the possible harms and limitations of technology. The fact that the first widely used genetically modified crop was soybeans that were resistant to herbicides, to Roundup -- that was at the very least a public relations disaster for genetically modified organisms. As opposed to say, highlighting crops that require less insecticide, less chemical fertilizers, less water level. The poster children for technology should really be cases that quite obviously benefit humanity.
"One of the surprises from 'Enlightenment Now' was how much moral progress depends on economic progress."
Finally, what is one emerging innovation that you're excited about for 2019?
I would say 4th generation nuclear power. Small modular reactors. Because everything depends on energy. For poor countries to get rich, they are going to have to consume far more energy than they do now and if they do it via fossil fuels, especially coal, that could spell disaster. Zero-carbon energy will allow poor countries to get richer -- and rich countries to stay rich without catastrophic environmental damage.
One of the surprises from "Enlightenment Now" was how much moral progress depends on economic progress. Rich countries not only allow the citizens to have cool gadgets, but all kinds of good things happen when a country gets rich, like Norway, Netherlands, Switzerland. Countries that are richer on average are more democratic, are less likely that to fight wars, are more feminist, are more environmentally conscientious, are smarter -- that is, they have a greater increase in IQ. So anything that makes a country get richer, and that's going to include a bunch of energy, is going to make humanity better off.
Kira Peikoff was the editor-in-chief of Leaps.org from 2017 to 2021. As a journalist, her work has appeared in The New York Times, Newsweek, Nautilus, Popular Mechanics, The New York Academy of Sciences, and other outlets. She is also the author of four suspense novels that explore controversial issues arising from scientific innovation: Living Proof, No Time to Die, Die Again Tomorrow, and Mother Knows Best. Peikoff holds a B.A. in Journalism from New York University and an M.S. in Bioethics from Columbia University. She lives in New Jersey with her husband and two young sons. Follow her on Twitter @KiraPeikoff.
Shoot for the Moon: Its Surface Contains a Pot of Gold
Here's a riddle: What do the Moon, nuclear weapons, clean energy of the future, terrorism, and lung disease all have in common?
One goal of India's upcoming space probe is to locate deposits of helium-3 that are worth trillions of dollars.
The answer is helium-3, a gas that's extremely rare on Earth but 100 million times more abundant on the Moon. This past October, the Lockheed Martin corporation announced a concept for a lunar landing craft that may return humans to the Moon in the coming decade, and yesterday China successfully landed the Change-4 probe on the far side of the Moon. Landing inside the Moon's deepest crater, the Chinese achieved a first in space exploration history.
Meanwhile, later this month, India's Chandrayaan-2 space probe will also land on the lunar surface. One of its goals is to locate deposits of helium-3 that are worth trillions of dollars, because it could be a fuel for nuclear fusion energy to generate electricity or propel a rocket.
The standard way that nuclear engineers are trying to achieve sustainable fusion uses fuels that are more plentiful on Earth: deuterium and tritium. But MIT researchers have found that adding small amounts of helium-3 to the mix could make it much more efficient, and thus a viable energy source much sooner that once thought.
Even if fusion is proven practical tomorrow, any kind of nuclear energy involves long waits for power plant construction measured in decades. However, mining helium-3 could be useful now, because of its non-energy applications. A major one is its ability to detect neutrons coming from plutonium that could be used in terrorist attacks. Here's how it works: a small amount of helium-3 is contained within a forensic instrument. When a neutron hits an atom of helium-3, the reaction produces tritium, a proton, and an electrical charge, alerting investigators to the possibility that plutonium is nearby.
Ironically, as global concern about a potential for hidden nuclear material increased in the early 2000s, so did the supply of helium-3 on Earth. That's because helium-3 comes from the decay of tritium, used in thermonuclear warheads (H-bombs). Thousands of such weapons have been dismantled from U.S. and Russian arsenals, making helium-3 available for plutonium detection, research, and other applications--including in the world of healthcare.
Helium-3 can help doctors diagnose lung diseases, since it enables imaging of the lungs in real time.
Helium-3 dramatically improves the ability of doctors to image the lungs in a range of diseases including asthma, chronic obstructive pulmonary disease and emphysema, cystic fibrosis, and bronchopulmonary dysplasia, which happens particularly in premature infants. Specifically, helium-3 is useful in magnetic resonance imaging (MRI), a procedure that creates images from within the body for diagnostic purposes.
But while a standard MRI allows doctors to visualize parts of the body like the heart or brain, it's useless for seeing the lungs. Because lungs are filled with air, which is much less dense than water or fat, effectively no signals are produced that would enable imaging.
To compensate for this problem, a patient can inhale gas that is hyperpolarized –meaning enhanced with special procedures so that the magnetic resonance signals from the lungs are finally readable. This gas is safe to breathe when mixed with enough oxygen to support life. Helium-3 is one such gas that can be hyperpolarized; since it produces such a strong signal, the MRI can literally see the air inside the lungs and in all of the airways, revealing intricate details of the bronchopulmonary tree. And it can do this in real time
The capability to show anatomic details of the lungs and airways, and the ability to display functional imaging as a patient breathes, makes helium-3 MRI far better than the standard method of testing lung function. Called spirometry, this method tells physicians how the lungs function overall, but does not home in on particular areas that may be causing a problem. Plus, spirometry requires patients to follow instructions and hold their breath, so it is not great for testing young children with pulmonary disease.
In recent years, the cost of helium-3 on Earth has skyrocketed.
Over the past several years, researchers have been developing MRI for lung testing using other hyperpolarized gases. The main alternative to helium-3 is xenon-129. Over the years, researchers have learned to overcome certain disadvantages of the latter, such as its potential to put patients to sleep. Since helium-3 provides the strongest signal, though, it is still the best gas for MRI studies in many lung conditions.
But the supply of helium-3 on Earth has been decreasing in recent years, due to the declining rate of dismantling of warheads, just as the Department of Homeland Security has required more and more of the gas for neutron detection. As a result, the cost of the gas has skyrocketed. Less is available now for medical uses – unless, of course, we begin mining it on the moon.
The question is: Are the benefits worth the 239,000-mile trip?