Who’s Responsible If a Scientist’s Work Is Used for Harm?
Are scientists morally responsible for the uses of their work? To some extent, yes. Scientists are responsible for both the uses that they intend with their work and for some of the uses they don't intend. This is because scientists bear the same moral responsibilities that we all bear, and we are all responsible for the ends we intend to help bring about and for some (but not all) of those we don't.
To not think about plausible unintended effects is to be negligent -- and to recognize, but do nothing about, such effects is to be reckless.
It should be obvious that the intended outcomes of our work are within our sphere of moral responsibility. If a scientist intends to help alleviate hunger (by, for example, breeding new drought-resistant crop strains), and they succeed in that goal, they are morally responsible for that success, and we would praise them accordingly. If a scientist intends to produce a new weapon of mass destruction (by, for example, developing a lethal strain of a virus), and they are unfortunately successful, they are morally responsible for that as well, and we would blame them accordingly. Intention matters a great deal, and we are most praised or blamed for what we intend to accomplish with our work.
But we are responsible for more than just the intended outcomes of our choices. We are also responsible for unintended but readily foreseeable uses of our work. This is in part because we are all responsible for thinking not just about what we intend, but also what else might follow from our chosen course of action. In cases where severe and egregious harms are plausible, we should act in ways that strive to prevent such outcomes. To not think about plausible unintended effects is to be negligent -- and to recognize, but do nothing about, such effects is to be reckless. To be negligent or reckless is to be morally irresponsible, and thus blameworthy. Each of us should think beyond what we intend to do, reflecting carefully on what our course of action could entail, and adjusting our choices accordingly.
It is this area, of unintended but readily foreseeable (and plausible) impacts, that often creates the most difficulty for scientists. Many scientists can become so focused on their work (which is often demanding) and so focused on achieving their intended goals, that they fail to stop and think about other possible implications.
Debates over "dual-use" research exemplify these concerns, where harmful potential uses of research might mean the work should not be pursued, or the full publication of results should be curtailed. When researchers perform gain-of-function research, pushing viruses to become more transmissible or more deadly, it is clear how dangerous such work could be in the wrong hands. In these cases, it is not enough to simply claim that such uses were not intended and that it is someone else's job to ensure that the materials remain secure. We know securing infectious materials can be error-prone (recall events at the CDC and the FDA).
In some areas of research, scientists are already worrying about the unintended possible downsides of their work.
Further, securing viral strains does nothing to secure the knowledge that could allow for reproducing the viral strain (particularly when the methodologies and/or genetic sequences are published after the fact, as was the case for H5N1 and horsepox). It is, in fact, the researcher's moral responsibility to be concerned not just about the biosafety controls in their own labs, but also which projects should be pursued (Will the gain in knowledge be worth the possible downsides?) and which results should be published (Will a result make it easier for a malicious actor to deploy a new bioweapon?).
We have not yet had (to my knowledge) a use of gain-of-function research to harm people. If that does happen, those who actually released the virus on the public will be most blameworthy–-intentions do matter. But the scientists who developed the knowledge deployed by the malicious actors may also be held blameworthy, especially if the malicious use was easy to foresee, even if it was not pleasant to think about.
In some areas of research, scientists are already worrying about the unintended possible downsides of their work. Scientists investigating gene drives have thought beyond the immediate desired benefits of their work (e.g. reducing invasive species populations) and considered the possible spread of gene drives to untargeted populations. Modeling the impacts of such possibilities has led some researchers to pull back from particular deployment possibilities. It is precisely such thinking through both the intended and unintended possible outcomes that is needed for responsible work.
The world has gotten too small, too vulnerable for scientists to act as though they are not responsible for the uses of their work, intended or not. They must seek to ensure that, as the recent AAAS Statement on Scientific Freedom and Responsibility demands, their work is done "in the interest of humanity." This requires thinking beyond one's intentions, potentially drawing on the expertise of others, sometimes from other disciplines, to help explore implications. The need for such thinking does not guarantee good outcomes, but it will ensure that we are doing the best we can, and that is what being morally responsible is all about.
A new injection is helping stave off RSV this season
In November 2021, Mickayla Wininger’s then one-month-old son, Malcolm, endured a terrifying bout with RSV, the respiratory syncytial (sin-SISH-uhl) virus—a common ailment that affects all age groups. Most people recover from mild, cold-like symptoms in a week or two, but RSV can be life-threatening in others, particularly infants.
Wininger, who lives in southern Illinois, was dressing Malcolm for bed when she noticed what seemed to be a minor irregularity with this breathing. She and her fiancé, Gavin McCullough, planned to take him to the hospital the next day. The matter became urgent when, in the morning, the boy’s breathing appeared to have stopped.
After they dialed 911, Malcolm started breathing again, but he ended up being hospitalized three times for RSV and defects in his heart. Eventually, he recovered fully from RSV, but “it was our worst nightmare coming to life,” Wininger recalled.
It’s a scenario that the federal government is taking steps to prevent. In July, the Food and Drug Administration approved a single-dose, long-acting injection to protect babies and toddlers. The injection, called Beyfortus, or nirsevimab, became available this October. It reduces the incidence of RSV in pre-term babies and other infants for their first RSV season. Children at highest risk for severe RSV are those who were born prematurely and have either chronic lung disease of prematurity or congenital heart disease. In those cases, RSV can progress to lower respiratory tract diseases such as pneumonia and bronchiolitis, or swelling of the lung’s small airway passages.
Each year, RSV is responsible for 2.1 million outpatient visits among children younger than five-years-old, 58,000 to 80,000 hospitalizations in this age group, and between 100 and 300 deaths, according to the Centers for Disease Control and Prevention. Transmitted through close contact with an infected person, the virus circulates on a seasonal basis in most regions of the country, typically emerging in the fall and peaking in the winter.
In August, however, the CDC issued a health advisory on a late-summer surge in severe cases of RSV among young children in Florida and Georgia. The agency predicts "increased RSV activity spreading north and west over the following two to three months.”
Infants are generally more susceptible to RSV than older people because their airways are very small, and their mechanisms to clear these passages are underdeveloped. RSV also causes mucus production and inflammation, which is more of a problem when the airway is smaller, said Jennifer Duchon, an associate professor of newborn medicine and pediatrics in the Icahn School of Medicine at Mount Sinai in New York.
In 2021 and 2022, RSV cases spiked, sending many to emergency departments. “RSV can cause serious disease in infants and some children and results in a large number of emergency department and physician office visits each year,” John Farley, director of the Office of Infectious Diseases in the FDA’s Center for Drug Evaluation and Research, said in a news release announcing the approval of the RSV drug. The decision “addresses the great need for products to help reduce the impact of RSV disease on children, families and the health care system.”
Sean O’Leary, chair of the committee on infectious diseases for the American Academy of Pediatrics, says that “we’ve never had a product like this for routine use in children, so this is very exciting news.” It is recommended for all kids under eight months old for their first RSV season. “I would encourage nirsevimab for all eligible children when it becomes available,” O’Leary said.
For those children at elevated risk of severe RSV and between the ages of 8 and 19 months, the CDC recommends one dose in their second RSV season.
The drug will be “really helpful to keep babies healthy and out of the hospital,” said O’Leary, a professor of pediatrics at the University of Colorado Anschutz Medical Campus/Children’s Hospital Colorado in Denver.
An antiviral drug called Synagis (palivizumab) has been an option to prevent serious RSV illness in high-risk infants since it was approved by the FDA in 1998. The injection must be given monthly during RSV season. However, its use is limited to “certain children considered at high risk for complications, does not help cure or treat children already suffering from serious RSV disease, and cannot prevent RSV infection,” according to the National Foundation for Infectious Diseases.
Until the approval this summer of the new monoclonal antibody, nirsevimab, there wasn’t a reliable method to prevent infection in most healthy infants.
Both nirsevimab and palivizumab are monoclonal antibodies that act against RSV. Monoclonal antibodies are lab-made proteins that mimic the immune system’s ability to fight off harmful pathogens such as viruses. A single intramuscular injection of nirsevimab preceding or during RSV season may provide protection.
The strategy with the new monoclonal antibody is “to extend protection to healthy infants who nonetheless are at risk because of their age, as well as infants with additional medical risk factors,” said Philippa Gordon, a pediatrician and infectious disease specialist in Brooklyn, New York, and medical adviser to Park Slope Parents, an online community support group.
No specific preventive measure is needed for older and healthier kids because they will develop active immunity, which is more durable. Meanwhile, older adults, who are also vulnerable to RSV, can receive one of two new vaccines. So can pregnant women, who pass on immunity to the fetus, Gordon said.
Until the approval this summer of the new monoclonal antibody, nirsevimab, there wasn’t a reliable method to prevent infection in most healthy infants, “nor is there any treatment other than giving oxygen or supportive care,” said Stanley Spinner, chief medical officer and vice president of Texas Children’s Pediatrics and Texas Children’s Urgent Care.
As with any virus, washing hands frequently and keeping infants and children away from sick people are the best defenses, Duchon said. This approach isn’t foolproof because viruses can run rampant in daycare centers, schools and parents’ workplaces, she added.
Mickayla Wininger, Malcolm’s mother, insists that family and friends wear masks, wash their hands and use hand sanitizer when they’re around her daughter and two sons. She doesn’t allow them to kiss or touch the children. Some people take it personally, but she would rather be safe than sorry.
Wininger recalls the severe anxiety caused by Malcolm's ordeal with RSV. After returning with her infant from his hospital stays, she was terrified to go to sleep. “My fiancé and I would trade shifts, so that someone was watching over our son 24 hours a day,” she said. “I was doing a night shift, so I would take caffeine pills to try and keep myself awake and would end up crashing early hours in the morning and wake up frantically thinking something happened to my son.”
Two years later, her anxiety has become more manageable, and Malcolm is doing well. “He is thriving now,” Wininger said. He recently had his second birthday and "is just the spunkiest boy you will ever meet. He looked death straight in the eyes and fought to be here today.”
Story by Big Think
For most of history, artificial intelligence (AI) has been relegated almost entirely to the realm of science fiction. Then, in late 2022, it burst into reality — seemingly out of nowhere — with the popular launch of ChatGPT, the generative AI chatbot that solves tricky problems, designs rockets, has deep conversations with users, and even aces the Bar exam.
But the truth is that before ChatGPT nabbed the public’s attention, AI was already here, and it was doing more important things than writing essays for lazy college students. Case in point: It was key to saving the lives of tens of millions of people.
AI-designed mRNA vaccines
As Dave Johnson, chief data and AI officer at Moderna, told MIT Technology Review‘s In Machines We Trust podcast in 2022, AI was integral to creating the company’s highly effective mRNA vaccine against COVID. Moderna and Pfizer/BioNTech’s mRNA vaccines collectively saved between 15 and 20 million lives, according to one estimate from 2022.
Johnson described how AI was hard at work at Moderna, well before COVID arose to infect billions. The pharmaceutical company focuses on finding mRNA therapies to fight off infectious disease, treat cancer, or thwart genetic illness, among other medical applications. Messenger RNA molecules are essentially molecular instructions for cells that tell them how to create specific proteins, which do everything from fighting infection, to catalyzing reactions, to relaying cellular messages.
Johnson and his team put AI and automated robots to work making lots of different mRNAs for scientists to experiment with. Moderna quickly went from making about 30 per month to more than one thousand. They then created AI algorithms to optimize mRNA to maximize protein production in the body — more bang for the biological buck.
For Johnson and his team’s next trick, they used AI to automate science, itself. Once Moderna’s scientists have an mRNA to experiment with, they do pre-clinical tests in the lab. They then pore over reams of data to see which mRNAs could progress to the next stage: animal trials. This process is long, repetitive, and soul-sucking — ill-suited to a creative scientist but great for a mindless AI algorithm. With scientists’ input, models were made to automate this tedious process.
“We don’t think about AI in the context of replacing humans,” says Dave Johnson, chief data and AI officer at Moderna. “We always think about it in terms of this human-machine collaboration, because they’re good at different things. Humans are really good at creativity and flexibility and insight, whereas machines are really good at precision and giving the exact same result every single time and doing it at scale and speed.”
All these AI systems were in put in place over the past decade. Then COVID showed up. So when the genome sequence of the coronavirus was made public in January 2020, Moderna was off to the races pumping out and testing mRNAs that would tell cells how to manufacture the coronavirus’s spike protein so that the body’s immune system would recognize and destroy it. Within 42 days, the company had an mRNA vaccine ready to be tested in humans. It eventually went into hundreds of millions of arms.
Biotech harnesses the power of AI
Moderna is now turning its attention to other ailments that could be solved with mRNA, and the company is continuing to lean on AI. Scientists are still coming to Johnson with automation requests, which he happily obliges.
“We don’t think about AI in the context of replacing humans,” he told the Me, Myself, and AI podcast. “We always think about it in terms of this human-machine collaboration, because they’re good at different things. Humans are really good at creativity and flexibility and insight, whereas machines are really good at precision and giving the exact same result every single time and doing it at scale and speed.”
Moderna, which was founded as a “digital biotech,” is undoubtedly the poster child of AI use in mRNA vaccines. Moderna recently signed a deal with IBM to use the company’s quantum computers as well as its proprietary generative AI, MoLFormer.
Moderna’s success is encouraging other companies to follow its example. In January, BioNTech, which partnered with Pfizer to make the other highly effective mRNA vaccine against COVID, acquired the company InstaDeep for $440 million to implement its machine learning AI across its mRNA medicine platform. And in May, Chinese technology giant Baidu announced an AI tool that designs super-optimized mRNA sequences in minutes. A nearly countless number of mRNA molecules can code for the same protein, but some are more stable and result in the production of more proteins. Baidu’s AI, called “LinearDesign,” finds these mRNAs. The company licensed the tool to French pharmaceutical company Sanofi.
Writing in the journal Accounts of Chemical Research in late 2021, Sebastian M. Castillo-Hair and Georg Seelig, computer engineers who focus on synthetic biology at the University of Washington, forecast that AI machine learning models will further accelerate the biotechnology research process, putting mRNA medicine into overdrive to the benefit of all.
This article originally appeared on Big Think, home of the brightest minds and biggest ideas of all time.