Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
My Wife's Fight Against Cancer Inspired 38,000 People to Raise Millions for Research
It was 15 years ago this month, but I'll never forget those words. When my wife Jen and I asked her oncologist about our plans to start a family, he calmly replied, "Well, I wouldn't do so unless Dave is prepared to be a single father."
About 50 percent of all people with cancer have a rare type, like the one Jen was fighting.
Time stood still. The danger crystalized — we were in a battle for my beautiful bride's life, and the odds were not in our favor.
We felt every emotion expected. Anger, sadness, confusion, frustration, and especially fear. But we made a very intentional choice to take that fear, put it to the side, and do everything we could to live our lives together to the fullest.
We focused first on Jen's health and learned everything we could about MFH Sarcoma. I was with her every step of the way — for hundreds of medical appointments, six intense surgeries, and twenty different types of chemotherapy. During such a challenging time, our choice to reject fear allowed us to live our best lives. Our careers blossomed, we enjoyed several international vacations, and Jen inspired thousands of fellow patients through her blog and speeches.
When we researched treatment options we learned that Jen was not alone. About 50 percent of all people with cancer have a rare type, like the one Jen was fighting. However, rare cancers don't get the funding they desperately need so effective treatment options are hard to find. The lack of funding felt unfair — and urgent. We didn't worry about everything that can go wrong when starting a new venture. Instead, we jumped in head first and convinced a small group of friends and family to ride stationary bikes with us to raise money for rare cancer research.
Jen Goodman Linn, riding a stationary bike for Cycle for Survival.
(Courtesy David Linn)
From those humble beginnings, Cycle for Survival grew steadily. After starting from scratch, Jen and I ran Cycle for Survival on our own for two years. We quickly realized that if we wanted to help as many people as possible, we needed the best partners. In 2009, we agreed that Memorial Sloan Kettering Cancer Center would take over the ownership of Cycle for Survival and Equinox officially became the Founding Partner. Flash forward to today, and Cycle for Survival has raised more than $220 million! I'm proud that 100% of every donation, yes every penny, goes directly into life-saving rare cancer research within six months of the annual indoor cycling events, which now take place in 17 cities nationwide.
While Cycle for Survival's trajectory was heading straight up, Jen's health struggle was devastatingly swinging up and down. With her incredible spirit and tenacity, Jen would beat the cancer through chemo and surgery, but then it would frustratingly come back again and again. After going into remission six times, it returned with such a vengeance in 2011 that even the world's leading doctors were forced to say, "I'm sorry, there's nothing more we can do."
Those were the most difficult words I've ever heard, by far. I hope no other family has to hear these crushing words.
When Jen died soon after, I didn't know what would happen to me, to my life, and to Cycle for Survival. I do remember making two very important choices at the time. First, I chose to get out of bed and put one foot in front of the other. It wasn't easy. Tears, pain, and grief would hit at any hour of the day or night. I did have a great support network of family and friends who kept me moving forward. One friend in particular changed the route of her morning runs so that I would join her and start getting back to exercising.
My second key choice was to stay involved with Cycle for Survival. At times, it was an excruciatingly difficult decision because I felt the depth of my loss each and every time I stepped into one of the events. However, it was also rewarding and energizing because I could see firsthand how many people it was helping, even though it was too late for Jen.
I began to travel across the country with the Cycle for Survival staff. My hope was to spread the word about rare cancers; along the way I met a lot of wonderful people who shared their stories with me. What I soon realized is that each of us faces obstacles in our lives. For me, it was losing the person who I wanted to spend my life with. For others, it might be challenges with their kids or in their professional lives. The common theme is that we don't have control over the fact that we have to face these challenges. But the biggest lesson I've learned is that we very much do have a choice in how we react.
I made the choice to do everything I can to help rare cancer patients and their families and it has been transformative and healing for me. The small group who rode in the first Cycle for Survival event has grown into a powerful movement of nearly 40,000 riders making a real difference. If Jen were diagnosed today, there are new treatments available– including genomic sequencing, targeted therapies, and immunotherapies – that could help her. Those weren't even options a short time ago. That's the result of funding research.
A recent Cycle for Survival event shows the passion and power of the community.
(Courtesy David Linn)
I also want to share one more choice I made. Remember that friend who changed the route of her morning runs so I could start exercising after Jen died? Well, over the years friendship grew into love, and we're now building a home together and can't wait to see what the future holds for us.
So with all that in mind I ask – when you face those inevitable challenges in your life, how will you choose to react? Remember that even in the midst of hopelessness, you can find choices. Those will be the decisions that define and guide you.
Her Incredible Sense of Smell Led Scientists to Develop the First Parkinson's Test
Thirty-seven years ago, Joy Milne, a nurse from Perth, Scotland, noticed a musky odor coming from her husband, Les.
To her surprise, at a local support group meeting, she caught the familiar scent once again, hanging over the group like a cloud.
At first, Milne thought the smell was a result of bad hygiene and badgered her husband to take longer showers. But when the smell persisted, Milne learned to live with it, not wanting to hurt her husband's feelings.
Twelve years after she first noticed the "woodsy" smell, Les was diagnosed at the age of 44 with Parkinson's Disease, a neurodegenerative condition characterized by lack of dopamine production and loss of movement. Parkinson's Disease currently affects more than 10 million people worldwide.
Milne spent the next several years believing the strange smell was exclusive to her husband. But to her surprise, at a local support group meeting in 2012, she caught the familiar scent once again, hanging over the group like a cloud. Stunned, Milne started to wonder if the smell was the result of Parkinson's Disease itself.
Milne's discovery led her to Dr. Tilo Kunath, a neurobiologist at the Centre for Regenerative Medicine at the University of Edinburgh. Together, Milne, Kunath, and a host of other scientists would use Milne's unusual sense of smell to develop a new diagnostic test, now in development and poised to revolutionize the treatment of Parkinson's Disease.
"Joy was in the audience during a talk I was giving on my work, which has to do with Parkinson's and stem cell biology," Kunath says. "During the patient engagement portion of the talk, she asked me if Parkinson's had a smell to it." Confused, Kunath said he had never heard of this – but for months after his talk he continued to turn the question over in his mind.
Kunath knew from his research that the skin's microbiome changes during different disease processes, releasing metabolites that can give off odors. In the medical literature, diseases like melanoma and Type 2 diabetes have been known to carry a specific scent – but no such connection had been made with Parkinson's. If people could smell Parkinson's, he thought, then it stood to reason that those metabolites could be isolated, identified, and used to potentially diagnose Parkinson's by their presence alone.
First, Kunath and his colleagues decided to test Milne's sense of smell. "I got in touch with Joy again and we designed a protocol to test her sense of smell without her having to be around patients," says Kunath, which could have affected the validity of the test. In his spare time, Kunath collected t-shirt samples from people diagnosed with Parkinson's and from others without the diagnosis and gave them to Milne to smell. In 100 percent of the samples, Milne was able to detect whether a person had Parkinson's based on smell alone. Amazingly, Milne was even able to detect the "Parkinson's scent" in a shirt from the control group – someone who did not have a Parkinson's diagnosis, but would go on to be diagnosed nine months later.
From the initial study, the team discovered that Parkinson's did have a smell, that Milne – inexplicably – could detect it, and that she could detect it long before diagnosis like she had with her husband, Les. But the experiments revealed other things that the team hadn't been expecting.
"One surprising thing we learned from that experiment was that the odor was always located in the back of the shirt – never in the armpit, where we expected the smell to be," Kunath says. "I had a chance meeting with a dermatologist and he said the smell was due to the patient's sebum, which are greasy secretions that are really dense on your upper back. We have sweat glands, instead of sebum, in our armpits." Patients with Parkinson's are also known to have increased sebum production.
With the knowledge that a patient's sebum was the source of the unusual smell, researchers could go on to investigate exactly what metabolites were in the sebum and in what amounts. Kunath, along with his associate, Dr. Perdita Barran, collected and analyzed sebum samples from 64 participants across the United Kingdom. Once the samples were collected, Barran and others analyzed it using a method called gas chromatography mass spectrometry, or GS-MC, which separated, weighed and helped identify the individual compounds present in each sebum sample.
Barran's team can now correctly identify Parkinson's in nine out of 10 patients – a much quicker and more accurate way to diagnose than what clinicians do now.
"The compounds we've identified in the sebum are not unique to people with Parkinson's, but they are differently expressed," says Barran, a professor of mass spectrometry at the University of Manchester. "So this test we're developing now is not a black-and-white, do-you-have-something kind of test, but rather how much of these compounds do you have compared to other people and other compounds." The team identified over a dozen compounds that were present in the sebum of Parkinson's patients in much larger amounts than the control group.
Using only the GC-MS and a sebum swab test, Barran's team can now correctly identify Parkinson's in nine out of 10 patients – a much quicker and more accurate way to diagnose than what clinicians do now.
"At the moment, a clinical diagnosis is based on the patient's physical symptoms," Barran says, and determining whether a patient has Parkinson's is often a long and drawn-out process of elimination. "Doctors might say that a group of symptoms looks like Parkinson's, but there are other reasons people might have those symptoms, and it might take another year before they're certain," Barran says. "Some of those symptoms are just signs of aging, and other symptoms like tremor are present in recovering alcoholics or people with other kinds of dementia." People under the age of 40 with Parkinson's symptoms, who present with stiff arms, are often misdiagnosed with carpal tunnel syndrome, she adds.
Additionally, by the time physical symptoms are present, Parkinson's patients have already lost a substantial amount of dopamine receptors – about sixty percent -- in the brain's basal ganglia. Getting a diagnosis before physical symptoms appear would mean earlier interventions that could prevent dopamine loss and preserve regular movement, Barran says.
"Early diagnosis is good if it means there's a chance of early intervention," says Barran. "It stops the process of dopamine loss, which means that motor symptoms potentially will not happen, or the onset of symptoms will be substantially delayed." Barran's team is in the processing of streamlining the sebum test so that definitive results will be ready in just two minutes.
"What we're doing right now will be a very inexpensive test, a rapid-screen test, and that will encourage people to self-sample and test at home," says Barran. In addition to diagnosing Parkinson's, she says, this test could also be potentially useful to determine if medications were at a therapeutic dose in people who have the disease, since the odor is strongest in people whose symptoms are least controlled by medication.
"When symptoms are under control, the odor is lower," Barran says. "Potentially this would allow patients and clinicians to see whether their symptoms are being managed properly with medication, or perhaps if they're being overmedicated." Hypothetically, patients could also use the test to determine if interventions like diet and exercise are effective at keeping Parkinson's controlled.
"We hope within the next two to five years we will have a test available."
Barran is now running another clinical trial – one that determines whether they can diagnose at an earlier stage and whether they can identify a difference in sebum samples between different forms of Parkinson's or diseases that have Parkinson's-like symptoms, such as Lewy Body Dementia.
"Within the next one to two years, we hope to be running a trial in the Manchester area for those people who do not have motor symptoms but are at risk for developing dementia due to symptoms like loss of smell and sleep difficulty," Barran says. "If we can establish that, we can roll out a test that determines if you have Parkinson's or not with those first pre-motor symptoms, and then at what stage. We hope within the next two to five years we will have a test available."
But a definitive Parkinson's test, however revolutionary, would likely not be made available to the general population – at least, not for a while.
"We would likely first give this test to people who are at risk due to a genetic predisposition, or who are at risk based on prodomal symptoms, like people who suffer from a REM sleep disorder who have a 50 to 70 percent chance of developing Parkinson's within a ten year period," Barran says. "Those would be people who would benefit from early therapeutic intervention. For the normal population, it isn't beneficial at the moment to know until we have therapeutic interventions that can be useful."
Milne's husband, Les, passed away from complications of Parkinson's Disease in 2015. But thanks to him and the dedication of his wife, Joy, science may have found a way to someday prolong the lives of others with this devastating disease.
[Ed. Note: This hit article from our archives originally ran on September 3, 2019.]