Researchers Behaving Badly: Known Frauds Are "the Tip of the Iceberg"
Last week, the whistleblowers in the Paolo Macchiarini affair at Sweden's Karolinska Institutet went on the record here to detail the retaliation they suffered for trying to expose a star surgeon's appalling research misconduct.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise.
The whistleblowers had discovered that in six published papers, Macchiarini falsified data, lied about the condition of patients and circumvented ethical approvals. As a result, multiple patients suffered and died. But Karolinska turned a blind eye for years.
Scientific fraud of the type committed by Macchiarini is rare, but studies suggest that it's on the rise. Just this week, for example, Retraction Watch and STAT together broke the news that a Harvard Medical School cardiologist and stem cell researcher, Piero Anversa, falsified data in a whopping 31 papers, which now have to be retracted. Anversa had claimed that he could regenerate heart muscle by injecting bone marrow cells into damaged hearts, a result that no one has been able to duplicate.
A 2009 study published in the Public Library of Science (PLOS) found that about two percent of scientists admitted to committing fabrication, falsification or plagiarism in their work. That's a small number, but up to one third of scientists admit to committing "questionable research practices" that fall into a gray area between rigorous accuracy and outright fraud.
These dubious practices may include misrepresentations, research bias, and inaccurate interpretations of data. One common questionable research practice entails formulating a hypothesis after the research is done in order to claim a successful premise. Another highly questionable practice that can shape research is ghost-authoring by representatives of the pharmaceutical industry and other for-profit fields. Still another is gifting co-authorship to unqualified but powerful individuals who can advance one's career. Such practices can unfairly bolster a scientist's reputation and increase the likelihood of getting the work published.
The above percentages represent what scientists admit to doing themselves; when they evaluate the practices of their colleagues, the numbers jump dramatically. In a 2012 study published in the Journal of Research in Medical Sciences, researchers estimated that 14 percent of other scientists commit serious misconduct, while up to 72 percent engage in questionable practices. While these are only estimates, the problem is clearly not one of just a few bad apples.
In the PLOS study, Daniele Fanelli says that increasing evidence suggests the known frauds are "just the 'tip of the iceberg,' and that many cases are never discovered" because fraud is extremely hard to detect.
Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
In addition, it's likely that most cases of scientific misconduct go unreported because of the high price of whistleblowing. Those in the Macchiarini case showed extraordinary persistence in their multi-year campaign to stop his deadly trachea implants, while suffering serious damage to their careers. Such heroic efforts to unmask fraud are probably rare.
To make matters worse, there are numerous players in the scientific world who may be complicit in either committing misconduct or covering it up. These include not only primary researchers but co-authors, institutional executives, journal editors, and industry leaders. Essentially everyone wants to be associated with big breakthroughs, and they may overlook scientifically shaky foundations when a major advance is claimed.
Another part of the problem is that it's rare for students in science and medicine to receive an education in ethics. And studies have shown that older, more experienced and possibly jaded researchers are more likely to fudge results than their younger, more idealistic colleagues.
So, given the steep price that individuals and institutions pay for scientific misconduct, what compels them to go down that road in the first place? According to the JRMS study, individuals face intense pressures to publish and to attract grant money in order to secure teaching positions at universities. Once they have acquired positions, the pressure is on to keep the grants and publishing credits coming in order to obtain tenure, be appointed to positions on boards, and recruit flocks of graduate students to assist in research. And not to be underestimated is the human ego.
Paolo Macchiarini is an especially vivid example of a scientist seeking not only fortune, but fame. He liberally (and falsely) claimed powerful politicians and celebrities, even the Pope, as patients or admirers. He may be an extreme example, but we live in an age of celebrity scientists who bring huge amounts of grant money and high prestige to the institutions that employ them.
The media plays a significant role in both glorifying stars and unmasking frauds. In the Macchiarini scandal, the media first lifted him up, as in NBC's laudatory documentary, "A Leap of Faith," which painted him as a kind of miracle-worker, and then brought him down, as in the January 2016 documentary, "The Experiments," which chronicled the agonizing death of one of his patients.
Institutions can also play a crucial role in scientific fraud by putting more emphasis on the number and frequency of papers published than on their quality. The whole course of a scientist's career is profoundly affected by something called the h-index. This is a number based on both the frequency of papers published and how many times the papers are cited by other researchers. Raising one's ranking on the h-index becomes an overriding goal, sometimes eclipsing the kind of patient, time-consuming research that leads to true breakthroughs based on reliable results.
Universities also create a high-pressured environment that encourages scientists to cut corners. They, too, place a heavy emphasis on attracting large monetary grants and accruing fame and prestige. This can lead them, just as it led Karolinska, to protect a star scientist's sloppy or questionable research. According to Dr. Andrew Rosenberg, who is director of the Center for Science and Democracy at the U.S.-based Union of Concerned Scientists, "Karolinska defended its investment in an individual as opposed to the long-term health of the institution. People were dying, and they should have outsourced the investigation from the very beginning."
Having institutions investigate their own practices is a conflict of interest from the get-go, says Rosenberg.
Scientists, universities, and research institutions are also not immune to fads. "Hot" subjects attract grant money and confer prestige, incentivizing scientists to shift their research priorities in a direction that garners more grants. This can mean neglecting the scientist's true area of expertise and interests in favor of a subject that's more likely to attract grant money. In Macchiarini's case, he was allegedly at the forefront of the currently sexy field of regenerative medicine -- a field in which Karolinska was making a huge investment.
The relative scarcity of resources intensifies the already significant pressure on scientists. They may want to publish results rapidly, since they face many competitors for limited grant money, academic positions, students, and influence. The scarcity means that a great many researchers will fail while only a few succeed. Once again, the temptation may be to rush research and to show it in the most positive light possible, even if it means fudging or exaggerating results.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable.
Intense competition can have a perverse effect on researchers, according to a 2007 study in the journal Science of Engineering and Ethics. Not only does it place undue pressure on scientists to succeed, it frequently leads to the withholding of information from colleagues, which undermines a system in which new discoveries build on the previous work of others. Researchers may feel compelled to withhold their results because of the pressure to be the first to publish. The study's authors propose that more investment in basic research from governments could alleviate some of these competitive pressures.
Scientific journals, although they play a part in publishing flawed science, can't be expected to investigate cases of suspected fraud, says the German science blogger Leonid Schneider. Schneider's writings helped to expose the Macchiarini affair.
"They just basically wait for someone to retract problematic papers," he says.
He also notes that, while American scientists can go to the Office of Research Integrity to report misconduct, whistleblowers in Europe have no external authority to whom they can appeal to investigate cases of fraud.
"They have to go to their employer, who has a vested interest in covering up cases of misconduct," he says.
Science is increasingly international. Major studies can include collaborators from several different countries, and he suggests there should be an international body accessible to all researchers that will investigate suspected fraud.
Ultimately, says Rosenberg, the scientific system must incorporate trust. "You trust co-authors when you write a paper, and peer reviewers at journals trust that scientists at research institutions like Karolinska are acting with integrity."
Without trust, the whole system falls apart. It's the trust of the public, an elusive asset once it has been betrayed, that science depends upon for its very existence. Scientific research is overwhelmingly financed by tax dollars, and the need for the goodwill of the public is more than an abstraction.
The Macchiarini affair raises a profound question of trust and responsibility: Should multiple co-authors be held responsible for a lead author's misconduct?
Karolinska apparently believes so. When the institution at last owned up to the scandal, it vindictively found Karl Henrik-Grinnemo, one of the whistleblowers, guilty of scientific misconduct as well. It also designated two other whistleblowers as "blameworthy" for their roles as co-authors of the papers on which Macchiarini was the lead author.
As a result, the whistleblowers' reputations and employment prospects have become collateral damage. Accusations of research misconduct can be a career killer. Research grants dry up, employment opportunities evaporate, publishing becomes next to impossible, and collaborators vanish into thin air.
Grinnemo contends that co-authors should only be responsible for their discrete contributions, not for the data supplied by others.
"Different aspects of a paper are highly specialized," he says, "and that's why you have multiple authors. You cannot go through every single bit of data because you don't understand all the parts of the article."
This is especially true in multidisciplinary, translational research, where there are sometimes 20 or more authors. "You have to trust co-authors, and if you find something wrong you have to notify all co-authors. But you couldn't go through everything or it would take years to publish an article," says Grinnemo.
Though the pressures facing scientists are very real, the problem of misconduct is not inevitable. Along with increased support from governments and industry, a change in academic culture that emphasizes quality over quantity of published studies could help encourage meritorious research.
But beyond that, trust will always play a role when numerous specialists unite to achieve a common goal: the accumulation of knowledge that will promote human health, wealth, and well-being.
[Correction: An earlier version of this story mistakenly credited The New York Times with breaking the news of the Anversa retractions, rather than Retraction Watch and STAT, which jointly published the exclusive on October 14th. The piece in the Times ran on October 15th. We regret the error.]
Tapping into the Power of the Placebo Effect
When Wayne Jonas was in medical school 40 years ago, doctors would write out a prescription for placebos, spelling it out backwards in capital letters, O-B-E-C-A-L-P. The pharmacist would fill the prescription with a sugar pill, recalls Jonas, now director of integrative health programs at the Samueli Foundation. It fulfilled the patient's desire for the doctor to do something when perhaps no drug could help, and the sugar pills did no harm.
Today, that deception is seen as unethical. But time and time again, studies have shown that placebos can have real benefits. Now, researchers are trying to untangle the mysteries of placebo effect in an effort to better treat patients.
The use of placebos took off in the post-WWII period, when randomized controlled clinical trials became the gold standard for medical research. One group in a study would be treated with a placebo, a supposedly inert pill or procedure that would not affect normal healing and recovery, while another group in the study would receive an "active" component, most commonly a pill under investigation. Presumably, the group receiving the active treatment would have a better response and the difference from the placebo group would represent the efficacy of the drug being tested. That was the basis for drug approval by the U.S. Food and Drug Administration.
"Placebo responses were marginalized," says Ted Kaptchuk, director of the Program in Placebo Studies & Therapeutic Encounters at Harvard Medical School. "Doctors were taught they have to overcome it when they were thinking about using an effective drug."
But that began to change around the turn of the 21st century. The National Institutes of Health held a series of meetings to set a research agenda and fund studies to answer some basic questions, led by Jonas who was in charge of the office of alternative medicine at the time. "People spontaneously get better all the time," says Kaptchuk. The crucial question was, is the placebo effect real? Is it more than just spontaneous healing?
Brain mechanisms
A turning point came in 2001 in a paper in Science that showed physical evidence of the placebo effect. It used positron emission tomography (PET) scans to measure release patterns of dopamine — a chemical messenger involved in how we feel pleasure — in the brains of patients with Parkinson's disease. Surprisingly, the placebo activated the same patterns that were activated by Parkinson's drugs, such as levodopa. It proved the placebo effect was real; now the search was on to better understand and control it.
A key part of the effect can be the beliefs, expectations, context, and "rituals" of the encounter between doctor and patient. Belief by the doctor and patient that the treatment would work, and the formalized practices of administering the treatment can all contribute to a positive outcome.
Conditioning can be another important component in generating a response, as Pavlov demonstrated more than a century ago in his experiments with dogs. They were trained with a bell prior to feeding such that they would begin to salivate in anticipation at the sound of a bell even with no food present.
Translating that to humans, studies with pain medications and sleeping aids showed that patients who had a positive response with a certain dose of those medications could have the same response if the doses was reduced and a dummy pill substituted, even to the point where there was no longer any active ingredient.
Researchers think placebo treatments can work particularly well in helping people deal with pain and psychological disorders.
Those types of studies troubled Kaptchuk because they often relied on deception; patients weren't told they were receiving a placebo, or at best there was a possibility that they might be randomized to receive a placebo. He believed the placebo effect could work even if patients were told upfront that they were going to receive a placebo. More than a dozen so call "open-label placebo" studies across numerous medical conditions, by Kaptchuk and others, have shown that you don't have to lie to patients for a placebo to work.
Jonas likes to tell the story of a patient who used methotrexate, a potent immunosuppressant, to control her rheumatoid arthritis. She was planning a long trip and didn't want to be bothered with the injections and monitoring required in using the drug, So she began to drink a powerful herbal extract of anise, a licorice flavor that she hated, prior to each injection. She reduced the amount of methotrexate over a period of months and finally stopped, but continued to drink the anise. That process had conditioned her body "to alter her immune function and her autoimmunity" as if she were taking the drug, much like Pavlov's dogs had been trained. She has not taken methotrexate for more than a year.
An intriguing paper published in May 2021 found that mild, non-invasive electric stimulation to the brain could not only boost the placebo effect on pain but also reduce the "nocebo" effect — when patients report a negative effect to a sham treatment. While the work is very preliminary, it may open the door to directly manipulating these responses.
Researchers think placebo treatments can work particularly well in helping people deal with pain and psychological disorders, areas where drugs often are of little help. Still, placebos aren't a cure and only a portion of patients experience a placebo effect.
Nocebo
If medicine were a soap opera, the nocebo would be the evil twin of the placebo. It's what happens when patients have adverse side effects because of the expectation that they will. It's commonly seem when patients claims to experience pain or gastric distress that can occur with a drug even when they've received a placebo. The side effects were either imagined or caused by something else.
"Up to 97% of reported pharmaceutical side effects are not caused by the drug itself but rather by nocebo effects and symptom misattribution," according to one 2019 paper.
One way to reduce a nocebo response is to simply not tell patients that specific side effects might occur. An example is a liver biopsy, in which a large-gauge needle is used to extract a tissue sample for examination. Those told ahead of time that they might experience some pain were more likely to report pain and greater pain than those who weren't offered this information.
Interestingly, a nocebo response plays out in the hippocampus, a part of the brain that is never activated in a placebo response. "I think what we are dealing with with nocebo is anxiety," says Kaptchuk, but he acknowledges that others disagree.
Distraction may be another way to minimize the nocebo effect. Pediatricians are using virtual reality (VR) to engage children and distract them during routine procedures such as blood draws and changing wound dressings, and burn patients of all ages have found relief with specially created VRs.
Treatment response
Jonas argues that what we commonly call the placebo effect is misnamed and leading us astray. "The fact is people heal and that inherent healing capacity is both powerful and influenced by mental, social, and contextual factors that are embedded in every medical encounter since the idea of treatment began," he wrote in a 2019 article in the journal Frontiers in Psychiatry. "Our understanding of healing and ability to enhance it will be accelerated if we stop using the term 'placebo response' and call it what it is—the meaning response, and its special application in medicine called the healing response."
He cites evidence that "only 15% to 20% of the healing of an individual or a population comes from health care. The rest—nearly 80%—comes from other factors rarely addressed in the health care system: behavioral and lifestyle choices that people make in their daily life."
To better align treatments and maximize their effectiveness, Jonas has created HOPE (Healing Oriented Practices & Environments) Note, "a patient-guided process designed to identify the patient's values and goals in their life and for healing." Essentially, it seeks to make clear to both doctor and patient what the patient's goals are in seeking treatment. In an extreme example of terminal cancer, some patients may choose to extend life despite the often brutal treatments, while others might prefer to optimize quality of life in the remaining time that they have. It builds on practices already taught in medical schools. Jonas believes doctors and patients can use tools like these to maximize the treatment response and achieve better outcomes.
Much of the medical profession has been resistant to these approaches. Part of that is simply tradition and limited data on their effectiveness, but another very real factor is the billing process for how they are reimbursed. Jonas says a new medical billing code added this year gives doctors another way to be compensated for the extra time and effort that a more holistic approach to medicine may initially require. Other moves away from fee-for-service payments to bundling and payment for outcomes, and the integrated care provided by the Veterans Affairs, Kaiser Permanente and other groups offer longer term hope for the future of approaches that might enhance the healing response.
This article was first published by Leaps.org on July 7, 2021.
New tech helps people of all ages stay social
In March, Sonja Bauman, 39, used an online platform called Papa, which offers “family on demand,” to meet Mariela Florez, an 83-year-old retiree. Despite living with her adult children, Florez was bored and lonely when they left for work, and her recoveries from a stroke and broken hip were going slowly. That's when Bauman began visiting twice per week. They take walks, strengthening Florez’s hip, and play games like Connect Four for mental stimulation. “It’s very important for me so I don’t feel lonely all day long,” said Florez. Her memories, blurred by the stroke, are gradually returning.
Papa is one of a growing number of tech approaches that are bringing together people of all ages. In addition to platforms like Papa that connect people in real life, other startups use virtual reality and video, with some of them focusing especially on deepening social connections between the generations — relationships that support the health of older and younger people alike. “I enjoy seeing Mariela as much as she enjoys seeing me,” Bauman said.
Connecting in real life
Telehealth expert Andrew Parker founded Papa in 2017 to improve the health outcomes of older adults and families. Seniors can meet people — some their grandkids’ age — for healthy activities, while working parents find retirees to watch their children. These “Papa Pals” are provided as a benefit through Medicare, Medicaid and some employer health plans.
In 2020, Papa connected Bauman, the 39-year-old Floridian, with another woman in her mid-70s who lives alone and has very limited mobility. Bauman began driving her to doctor’s appointments and helping her with chores around the house. “When I’m not there, she doesn’t leave her apartment,” said Bauman. The two have gone to the gym together, and they walk slowly through the neighborhood, chatting so it feels less like exercise.
Parker was driven to start Papa by the problem of social isolation among seniors, exacerbated by the pandemic, but he believes users of all ages can benefit. “Many of our Pals feel more comfortable opening up with older members than their same-aged friends,” he said.
Other platforms aim for similar, in-person connections. Generation Tech unites teens with seniors for technology training. And Mon Ami, which provides case management software for aging and disability service providers, has an app that connects isolated older people with college-age volunteers.
Making new connections through video
Several new sites match you with strangers for real-time video chatting on various topics, such as finding common ground on political issues. Other video platforms focus on intergenerational connections.
S. Jay Olshansky, a gerontology professor at the University of Illinois-Chicago, recalls the first time he saw Hyunseung Lee, an 11-year-old from Seoul, through his computer screen. The kid was shy, but Olshansky, 67, encouraged him to ask questions. “Turns out, he was thirsting for this kind of interaction.”
They’d connected through Eldera, a platform that pairs mentors age 60 and up with mentees, using an algorithm, for video conversations. “The time and wisdom of older adults is the most important natural resource we can give future generations,” said Dana Griffin, Eldera's CEO. “Connecting through a screen is the opposite of social media.”
In weekly meetings, Olshansky noticed Lee’s unique interest in math. “There’s something special in you,” Olshansky told him. “How do we bring it to the surface?” He suggested Lee write a book on his favorite subject, and the preteen ran with it, cranking out 70 pages in two weeks. Lee has published his love letter to theorems on Amazon.
Hyunseung Lee, age 11, of Korea, and U.S. college professor Jay Olshanksy, 67, discuss math, strategy and Hyunsung's budding career as a book author during their video chats through a platform called Eldera. (Photo by Dana Palmer/Eldera)
Lee’s parents told Olshansky that their son has become more assertive — a recurring theme, Griffin said. “Confidence is the number one thing parents tell us about.” Since Eldera’s inception last year, the number of mentors has grown exponentially. Even so, Griffin said the waitlist for mentors typically numbers 200 kids.
Another site, Big and Mini, hosts video interactions between seniors and young adults; about 10,000 active users have joined since 2019, said co-founder Aditi Merchant.
Users often bring the benefits of their video interactions to their real-world relationships. Olshansky views Lee as an older version of his grandkids. “Eldera teaches me how to interact with them.” Lee, high on confidence, began instructing his classmates in math. Griffin noted that a group of Eldera mentors in Memphis, who met initially on Eldera, now take walks together in-person to trade ideas for helping each other’s Eldera kids solve problems in their schools and communities.
“We’ve evolved into a community for older adults who want to give back to the world,” said Griffin. Other new tools for connection take the form of virtual reality apps.
Connecting in virtual reality
During pandemic isolation, record numbers of people bought devices for virtual and augmented reality. Such gadgets can convince you that you’re hanging out with friends, even if they’re in another hemisphere. Lifelike simulations from miles away could be especially useful for meaningful interactions between people of different generations, since they’re often geographically segregated.
VR’s benefits require further study, but users report less social isolation and depression, according to MIT research. The immersive, 3-D experience is more compelling than FaceTime or Zoom. “It’s like the difference between a phone call and video call,” said Rick Robinson, Vice President of AARP’s Innovation Labs.
“When VR is designed right, the medium disappears,” said Jeremy Bailenson of Stanford.
Dana Pierce, a 56-year-old government employee in Indiana, got Meta's VR headset in May, 2021, thinking she’d enjoy it more than a new laptop. After many virtual group tours of exotic destinations, she has no regrets. Her adventures occur on Alcove, an app made by Robinson’s Innovation Labs. He co-created it with VR-company Rendever and sought input from people over age 50 to tailor it to their interests. “I’m an introvert,” said Pierce. “I’ve been more socially active since getting my headset than I am in real life.”
Tagging along with her to places like Paris are avatars representing real people around the world. She’s gotten to know VR users in their 70s, 80s and 90s, as well as younger people and some her own age. One is a new friend she plays chess with in relaxing nature settings. Another is her oldest son. He lives 90 minutes away but, earlier this year, Pierce welcomed him and his girlfriend to her virtual house on Alcove. They chatted in the living room decorated with family photos uploaded by Pierce. Then they took out a boat to go VR fishing — because why not — until 2 a.m.
“When VR is designed right, the medium disappears,” said Jeremy Bailenson, a communications professor who directs Stanford’s Virtual Human Interaction Lab. He’s teaching a class of 175 students entirely in VR. After months of covid isolation, the first time the class met, “there was a big catharsis. It really feels like you’re in a big crowd.” Like-minded people meet in VR for events such as comedy shows and creative writing meetups, while the Swedish pop group ABBA has performed this year as digital versions of themselves (“ABBA-tars”) during a virtual concert tour.
Karen Fingerman, a psychologist and director of the Texas Aging and Longevity Center at the University of Texas-Austin, supports the idea of VR for social connection, though she added that some people need it more than others. Hospitals and assisted-living facilities are using products such as Penumbra’s REAL I-Series and MyndVR to bring VR excursions to isolated patients and seniors. “If you’re in a bed or facility, this gives you something to talk about,” said Gita Barry, Penumbra’s executive vice president.
Pierce uses it on most days. She may see another adult son, who lives with her, less often as a result. But VR helps her manage real-world stressors, more than escaping them. After a long workday, she visits her back porch on Alcove, which overlooks a pond. “It’s my little retreat,” she said. “VR improves my mood. It’s added a lot to my life.”
Some seniors are using more than one technology. Olshansky and Lee discuss strategy while playing Internet chess. And Olshansky recently began using VR. He sees his sister, who lives far away, in a virtual beach house. “It’d be a great way to interact with Hyunseung,” he said. “I should get him a headset.”
A version of this article first appeared in The Washington Post on December 3, 2021.