Is There a Blind Spot in the Oversight of Human Subject Research?
Human experimentation has come a long way since congressional hearings in the 1970s exposed patterns of abuse. Where yesterday's patients were protected only by the good conscience of physician-researchers, today's patients are spirited past hazards through an elaborate system of oversight and informed consent. Yet in many ways, the project of grounding human research on ethical foundations remains incomplete.
As human research has become a mainstay of career and commercial advancement among academics, research centers, and industry, new threats to research integrity have emerged.
To be sure, much of the medical research we do meets exceedingly high standards. Progress in cancer immunotherapy, or infectious disease, reflects the best of what can be accomplished when medical scientists and patients collaborate productively. And abuses of the earlier part of the 20th century--like those perpetrated by the U.S. Public Health Service in Guatemala--are for the history books.
Yet as human research has become a mainstay of career and commercial advancement among academics, research centers, and industry, new threats to research integrity have emerged. Many flourish in the blind spot of current oversight systems.
Take, for example, the tendency to publish only "positive" findings ("publication bias"). When patients participate in studies, they are told that their contributions will promote medical discovery. That can't happen if results of experiments never get beyond the hard drives of researchers. While researchers are often eager to publish trials showing a drug works, according to a study my own team conducted, fewer than 4 in 10 trials of drugs that never receive FDA approval get published. This tendency- which occurs in academia as well as industry- deprives other scientists of opportunities to build on these failures and make good on the sacrifice of patients. It also means the trials may be inadvertently repeated by other researchers, subjecting more patients to risks.
On the other hand, many clinical trials test treatments that have already been proven effective beyond a shadow of doubt. Consider the drug aprotinin, used for the management of bleeding during surgery. An analysis in 2005 showed that, not long after the drug was proven effective, researchers launched dozens of additional placebo-controlled trials. These redundant trials are far in excess of what regulators required for drug approval, and deprived patients in placebo arms of a proven effective therapy. Whether because of an oversight or deliberately (does it matter?), researchers conducting these trials often failed in publications to describe previous evidence of efficacy. What's the point of running a trial if no one reads the results?
It is surprisingly easy for companies to hijack research to market their treatments.
At the other extreme are trials that are little more than shots in the dark. In one case, patients with spinal cord injury were enrolled in a safety trial testing a cell-based regenerative medicine treatment. After the trial stopped (results were negative), laboratory scientists revealed that the cells had been shown ineffective in animal experiments. Though this information had been available to the company and FDA, researchers pursued the trial anyway.
It is surprisingly easy for companies to hijack research to market their treatments. One way this happens is through "seeding trials"- studies that are designed not to address a research question, but instead to habituate doctors to using a new drug and to generate publications that serve as advertisements. Such trials flood the medical literature with findings that are unreliable because studies are small and not well designed. They also use the prestige of science to pursue goals that are purely commercial. Yet because they harm science- not patients (many such studies are minimally risky because all patients receive proven effective medications)- ethics committees rarely block them.
Closely related is the phenomenon of small uninformative trials. After drugs get approved by the FDA, companies often launch dozens of small trials in new diseases other than the one the drug was approved to treat. Because these studies are small, they often overestimate efficacy. Indeed, the way trials are often set up, if a company tests an ineffective drug in 40 different studies, one will typically produce a false positive by chance alone. Because companies are free to run as many trials as they like and to circulate "positive" results, they have incentives to run lots of small trials that don't provide a definitive test of their drug's efficacy.
Universities, funding bodies, and companies should be scored by a neutral third-party based on the impact of their trials -- like Moody's for credit ratings.
Don't think public agencies are much better. Funders like the National Institutes of Health secure their appropriations by gratifying Congress. This means that NIH gets more by spreading its funding among small studies in different Congressional districts than by concentrating budgets among a few research institutions pursuing large trials. The result is that some NIH-funded clinical trials are not especially equipped to inform medical practice.
It's tempting to think that FDA, medical journals, ethics committees, and funding agencies can fix these problems. However, these practices continue in part because FDA, ethics committees, and researchers often do not see what is at stake for patients by acquiescing to low scientific standards. This behavior dishonors the patients who volunteer for research, and also threatens the welfare of downstream patients, whose care will be determined by the output of research.
To fix this, deficiencies in study design and reporting need to be rendered visible. Universities, funding bodies, and companies should be scored by a neutral third-party based on the impact of their trials, or the extent to which their trials are published in full -- like Moody's for credit ratings, or the Kelley Blue Book for cars. This system of accountability would allow everyone to see which institutions make the most of the contributions of research subjects. It could also harness the competitive instincts of institutions to improve research quality.
Another step would be for researchers to level with patients when they enroll in studies. Patients who agree to research are usually offered bromides about how their participation may help future patients. However, not all studies are created equal with respect to merit. Patients have a right to know when they are entering studies that are unlikely to have a meaningful impact on medicine.
Ethics committees and drug regulators have done a good job protecting research volunteers from unchecked scientific ambition. However, today's research is plagued by studies that have poor scientific credentials. Such studies free-ride on the well-earned reputation of serious medical science. They also potentially distort the evidence available to physicians and healthcare systems. Regulators, academic medical centers, and others should establish policies that better protect human research volunteers by protecting the quality of the research itself.
Podcast: The Friday Five Weekly Roundup in Health Research
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Here are the promising studies covered in this week's Friday Five:
- A new mask can detect Covid and send an alert to your phone
- More promising research for a breakthrough drug to treat schizophrenia
- AI tool can create new proteins
- Connections between an unhealthy gut and breast cancer
- Progress on the longevity drug, rapamycin
And an honorable mention this week: Certain exercises may benefit some types of memory more than others
Life is Emerging: Review of Siddhartha Mukherjee’s Song of the Cell
The DNA double helix is often the image spiraling at the center of 21st century advances in biomedicine and the growing bioeconomy. And yet, DNA is molecularly inert. DNA, the code for genes, is not alive and is not strictly necessary for life. Ought life be at the center of our communication of living systems? Is not the Cell a superior symbol of life and our manipulation of living systems?
A code for life isn’t a code without the life that instantiates it. A code for life must be translated. The cell is the basic unit of that translation. The cell is the minimal viable package of life as we know it. Therefore, cell biology is at the center of biomedicine’s greatest transformations, suggests Pulitzer-winning physician-scientist Siddhartha Mukherjee in his latest book, The Song of the Cell: The Exploration of Medicine and the New Human.
The Song of the Cell begins with the discovery of cells and of germ theory, featuring characters such as Louis Pasteur and Robert Koch, who brought the cell “into intimate contact with pathology and medicine.” This intercourse would transform biomedicine, leading to the insight that we can treat disease by thinking at the cellular level. The slightest rearrangement of sick cells might be the path toward alleviating suffering for the organism: eroding the cell walls of a bacterium while sparing our human cells; inventing a medium that coaxes sperm and egg to dance into cellular union for in vitro fertilization (IVF); designing molecular missiles that home to the receptors decorating the exterior of cancer cells; teaching adult skin cells to remember their embryonic state for regenerative medicines.
Mukherjee uses the bulk of the book to elucidate key cell types in the human body, along with their “connective relationships” that enable key organs and organ systems to function. This includes the immune system, the heart, the brain, and so on. Mukherjee’s distinctive style features compelling anecdotes and human stories that animate the scientific (and unscientific) processes that have led to our current state of understanding. In his chapter on neurons and the brain, for example, he integrates Santiago Ramon y Cajal’s meticulous black ink sketches of neurons into Mukherjee’s own personal encounter with clinical depression. In one lucid section, he interviews Dr. Helen Mayberg, a pioneering neurologist who takes seriously the descriptive power of her patients’ metaphors, as they suffer from “caves,” “holes,” “voids,” and “force fields” that render their lives gray. Dr. Mayberg aims to stimulate patients’ neuronal cells in a manner that brings back the color.
Beyond exposing the insight and inventiveness that has arisen out of cell-based thinking, it seems that Mukherjee’s bigger project is an epistemological one. The early chapters of The Song of the Cell continually hint at the potential for redefining the basic unit of biology as the cell rather than the gene. The choice to center biomedicine around cells is, above all, a conspicuous choice not to center it around genes (the subject of Mukherjee’s previous book, The Gene), because genes dominate popular science communication.
This choice of cells over genes is most welcome. Cells are alive. Genes are not. Letters—such as the As, Cs, Gs, and Ts that represent the nucleotides of DNA, which make up our genes—must be synthesized into a word or poem or song that offers a glimpse into deeper truths. A key idea embedded in this thinking is that of emergence. Whether in ancient myth or modern art, creation tends to be an emergent process, not a linearly coded script. The cell is our current best guess for the basic unit of life’s emergence, turning a finite set of chemical building blocks—nucleic acids, proteins, sugars, fats—into a replicative, evolving system for fighting stasis and entropy. The cell’s song is one for our times, for it is the song of biology’s emergence out of chemistry and physics, into the “frenetically active process” of homeostasis.
Re-centering our view of biology has practical consequences, too, for how we think about diagnosing and treating disease, and for inventing new medicines. Centering cells presents a challenge: which type of cell to place at the center? Rather than default to the apparent simplicity of DNA as a symbol because it represents the one master code for life, the tension in defining the diversity of cells—a mapping process still far from complete in cutting-edge biology laboratories—can help to create a more thoughtful library of cellular metaphors to shape both the practice and communication of biology.
Further, effective problem solving is often about operating at the right level, or the right scale. The cell feels like appropriate level at which to interrogate many of the diseases that ail us, because the senses that guide our own perceptions of sickness and health—the smoldering pain of inflammation, the tunnel vision of a migraine, the dizziness of a fluttering heart—are emergent.
This, unfortunately, is sort of where Mukherjee leaves the reader, under-exploring the consequences of a biology of emergence. Many practical and profound questions have to do with the ways that each scale of life feeds back on the others. In a tome on Cells and “the future human” I wished that Mukherjee had created more space for seeking the ways that cells will shape and be shaped by the future, of humanity and otherwise.
We are entering a phase of real-world bioengineering that features the modularization of cellular parts within cells, of cells within organs, of organs within bodies, and of bodies within ecosystems. In this reality, we would be unwise to assume that any whole is the mere sum of its parts.
For example, when discussing the regenerative power of pluripotent stem cells, Mukherjee raises the philosophical thought experiment of the Delphic boat, also known as the Ship of Theseus. The boat is made of many pieces of wood, each of which is replaced for repairs over the years, with the boat’s structure unchanged. Eventually none of the boat’s original wood remains: Is it the same boat?
Mukherjee raises the Delphic boat in one paragraph at the end of the chapter on stem cells, as a metaphor related to the possibility of stem cell-enabled regeneration in perpetuity. He does not follow any of the threads of potential answers. Given the current state of cellular engineering, about which Mukherjee is a world expert from his work as a physician-scientist, this book could have used an entire section dedicated to probing this question and, importantly, the ways this thought experiment falls apart.
We are entering a phase of real-world bioengineering that features the modularization of cellular parts within cells, of cells within organs, of organs within bodies, and of bodies within ecosystems. In this reality, we would be unwise to assume that any whole is the mere sum of its parts. Wholeness at any one of these scales of life—organelle, cell, organ, body, ecosystem—is what is at stake if we allow biological reductionism to assume away the relation between those scales.
In other words, Mukherjee succeeds in providing a masterful and compelling narrative of the lives of many of the cells that emerge to enliven us. Like his previous books, it is a worthwhile read for anyone curious about the role of cells in disease and in health. And yet, he fails to offer the broader context of The Song of the Cell.
As leading agronomist and essayist Wes Jackson has written, “The sequence of amino acids that is at home in the human cell, when produced inside the bacterial cell, does not fold quite right. Something about the E. coli internal environment affects the tertiary structure of the protein and makes it inactive. The whole in this case, the E. coli cell, affects the part—the newly made protein. Where is the priority of part now?” [1]
Beyond the ways that different kingdoms of life translate the same genetic code, the practical situation for humanity today relates to the ways that the different disciplines of modern life use values and culture to influence our genes, cells, bodies, and environment. It may be that humans will soon become a bit like the Delphic boat, infused with the buzz of fresh cells to repopulate different niches within our bodies, for healthier, longer lives. But in biology, as in writing, a mixed metaphor can cause something of a cacophony. For we are not boats with parts to be replaced piecemeal. And nor are whales, nor alpine forests, nor topsoil. Life isn’t a sum of parts, and neither is a song that rings true.
[1] Wes Jackson, "Visions and Assumptions," in Nature as Measure (p. 52-53).