“Deep Fake” Video Technology Is Advancing Faster Than Our Policies Can Keep Up
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Alethea.ai sports a grid of faces smiling, blinking and looking about. Some are beautiful, some are oddly familiar, but all share one thing in common—they are fake.
Alethea creates "synthetic media"— including digital faces customers can license saying anything they choose with any voice they choose. Companies can hire these photorealistic avatars to appear in explainer videos, advertisements, multimedia projects or any other applications they might dream up without running auditions or paying talent agents or actor fees. Licenses begin at a mere $99. Companies may also license digital avatars of real celebrities or hire mashups created from real celebrities including "Don Exotic" (a mashup of Donald Trump and Joe Exotic) or "Baby Obama" (a large-eared toddler that looks remarkably similar to a former U.S. President).
Naturally, in the midst of the COVID pandemic, the appeal is understandable. Rather than flying to a remote location to film a beer commercial, an actor can simply license their avatar to do the work for them. The question is—where and when this tech will cross the line between legitimately licensed and authorized synthetic media to deep fakes—synthetic videos designed to deceive the public for financial and political gain.
Deep fakes are not new. From written quotes that are manipulated and taken out of context to audio quotes that are spliced together to mean something other than originally intended, misrepresentation has been around for centuries. What is new is the technology that allows this sort of seamless and sophisticated deception to be brought to the world of video.
"At one point, video content was considered more reliable, and had a higher threshold of trust," said Alethea CEO and co-founder, Arif Khan. "We think video is harder to fake and we aren't yet as sensitive to detecting those fakes. But the technology is definitely there."
"In the future, each of us will only trust about 15 people and that's it," said Phil Lelyveld, who serves as Immersive Media Program Lead at the Entertainment Technology Center at the University of Southern California. "It's already very difficult to tell true footage from fake. In the future, I expect this will only become more difficult."
How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
As the U.S. 2020 Presidential Election nears, the potential moral and ethical implications of this technology are startling. A number of cases of truth tampering have recently been widely publicized. On August 5, President Donald Trump's campaign released an ad featuring several photos of Joe Biden that were altered to make it seem like was hiding all alone in his basement. In one photo, at least ten people who had been sitting with Biden in the original shot were cut out. In other photos, Biden's image was removed from a nature preserve and praying in church to make it appear Biden was in that same basement. Recently several videos of Speaker of the House Nancy Pelosi were slowed down by 75 percent to make her sound as if her speech was slurred.
During a campaign event in Florida on September 15 of this year, former Vice President Joe Biden was introduced by Puerto Rican singer-songwriter Luis Fonsi. After he was introduced, Biden paid tribute to the singer-songwriter—he held up his cell phone and played the hit song "Despecito". Shortly afterward, a doctored version of this video appeared on self-described parody site the United Spot replacing the Despicito with N.W.A.'s "F—- Tha Police". By September 16, Donald Trump retweeted the video, twice—first with the line "What is this all about" and second with the line "China is drooling. They can't believe this!" Twitter was quick to mark the video in these tweets as manipulated media.
Twitter had previously addressed several of Donald Trump's tweets—flagging a video shared in June as manipulated media and removing altogether a video shared by Trump in July showing a group promoting the hydroxychloroquine as an effective cure for COVID-19. Many of these manipulated videos are ultimately flagged or taken down, but not before they are seen and shared by millions of online viewers.
These faked videos were exposed rather quickly, as they could be compared with the original, publicly available source material. But what happens when there is no original source material? How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
"This type of fake media is a profound threat to our democracy," said Reid Blackman, the CEO of VIRTUE--an ethics consultancy for AI leaders. "Democracy depends on well-informed citizens. When citizens can't or won't discern between real and fake news, the implications are huge."
In light of the importance of reliable information in the political system, there's a clear and present need to verify that the images and news we consume is authentic. So how can anyone ever know that the content they are viewing is real?
"This will not be a simple technological solution," said Blackman. "There is no 'truth' button to push to verify authenticity. There's plenty of blame and condemnation to go around. Purveyors of information have a responsibility to vet the reliability of their sources. And consumers also have a responsibility to vet their sources."
Yet the process of verifying sources has never been more challenging. More and more citizens are choosing to live in a "media bubble"—gathering and sharing news only from and with people who share their political leanings and opinions. At one time, United States broadcasters were bound by the Fairness Doctrine—requiring them to present controversial issues important to the public in a way that the FCC deemed honest, equitable and balanced. The repeal of this doctrine in 1987 paved the way for new forms of cable news channels such as Fox News and MSNBC that appealed to viewers with a particular point of view. The Internet has only exacerbated these tendencies. Social media algorithms are designed to keep people clicking within their comfort zones by presenting members with only the thoughts and opinions they want to hear.
"I sometimes laugh when I hear people tell me they can back a particular opinion they hold with research," said Blackman. "Having conducted a fair bit of true scientific research, I am aware that clicking on one article on the Internet hardly qualifies. But a surprising number of people believe that finding any source online that states the fact they choose to believe is the same as proving it true."
Back to the fundamental challenge: How do we as a society root out what's false online? Lelyveld suggests that it will begin by verifying things that are known to be true rather than trying to call out everything that is fake. "The EU called me in to talk about how to deal with fake news coming out of Russia," said Lelyveld. "I told them Hollywood has spent 100 years developing special effects technology to make things that are wholly fictional indistinguishable from the truth. I told them that you'll never chase down every source of fake news. You're better off focusing on what can be proved true."
Arif Khan agrees. "There are probably 100 accounts attributed to Elon Musk on Twitter, but only one has the blue checkmark," said Khan. "That means Twitter has verified that an account of public interest is real. That's what we're trying to do with our platform. Allow celebrities to verify that specific videos were licensed and authorized directly by them."
Alethea will use another key technology called blockchain to mark all authentic authorized videos with celebrity avatars. Blockchain uses a distributed ledger technology to make sure that no undetected changes have been made to the content. Think of the difference between editing a document in a traditional word processing program and editing in a distributed online editing system like Google Docs. In a traditional word processing program, you can edit and copy a document without revealing any changes. In a shared editing system like Google Docs, every person who shares the document can see a record of every edit, addition and copy made of any portion of the document. In a similar way, blockchain helps Alethea ensure that approved videos have not been copied or altered inappropriately.
While AI companies like Alethea are moving to ensure that avatars based on real individuals aren't wrongly identified, the situation becomes a bit murkier when it comes to the question of representing groups, races, creeds, and other forms of identity. Alethea is rightly proud that the completely artificial avatars visually represent a variety of ages, races and sexes. However, companies could conceivably license an avatar to represent a marginalized group without actually hiring a person within that group to decide what the avatar will do or say.
"I don't know if I would call this tokenism, as that is difficult to identify without understanding the hiring company's intent," said Blackman. "Where this becomes deeply troubling is when avatars are used to represent a marginalized group without clearly pointing out the actor is an avatar. It's one thing for an African American woman avatar to say, 'I like ice cream.' It's entirely different thing for an African American woman avatar to say she supports a particular political candidate. In the second case, the avatar is being used as social proof that real people of a certain type back a certain political idea. And there the deception is far more problematic."
"It always comes down to unintended consequences of technology," said Lelyveld. "Technology is neutral—it's only the implementation that has the power to be good or bad. Without a thoughtful approach to the cultural, moral and political implications of technology, it often drifts towards the bad. We need to make a conscious decision as we release new technology to ensure it moves towards the good."
When presented with the idea that his avatars might be used to misrepresent marginalized groups, Khan was thoughtful. "Yes, I can see that is an unintended consequence of our technology. We would like to encourage people to license the avatars of real people, who would have final approval over what their avatars say or do. As to what people do with our completely artificial avatars, we will have to consider that moving forward."
Lelyveld frankly sees the ability for advertisers to create avatars that are our assistants or even our friends as a greater moral concern. "Once our digital assistant or avatar becomes an integral part of our life—even a friend as it were, what's to stop marketers from having those digital friends make suggestions about what drink we buy, which shirt we wear or even which candidate we elect? The possibilities for bad actors to reach us through our digital circle is mind-boggling."
Ultimately, Blackman suggests, we as a society will need to make decisions about what matters to us. "We will need to build policies and write laws—tackling the biggest problems like political deep fakes first. And then we have to figure out how to make the penalties stiff enough to matter. Fining a multibillion-dollar company a few million for a major offense isn't likely to move the needle. The punishment will need to fit the crime."
Until then, media consumers will need to do their own due diligence—to do the difficult work of uncovering the often messy and deeply uncomfortable news that's the truth.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
Opioid prescription policies may hurt those in chronic pain
Tinu Abayomi-Paul works as a writer and activist, plus one unwanted job: Trying to fill her opioid prescription. She says that some pharmacists laugh and tell her that no one needs the amount of pain medication that she is seeking. Another pharmacist near her home in Venus, Tex., refused to fill more than seven days of a 30-day prescription.
To get a new prescription—partially filled opioid prescriptions can’t be dispensed later—Abayomi-Paul needed to return to her doctor’s office. But without her medication, she was having too much pain to travel there, much less return to the pharmacy. She rationed out the pills over several weeks, an agonizing compromise that left her unable to work, interact with her children, sleep restfully, or leave the house. “Don’t I deserve to do more than survive?” she says.
Abayomi-Paul’s pain results from a degenerative spine disorder, chronic lymphocytic leukemia, and more than a dozen other diagnoses and disabilities. She is part of a growing group of people with chronic pain who have been negatively impacted by the fallout from efforts to prevent opioid overdose deaths.
Guidelines for dispensing these pills are complicated because many opioids, like codeine, oxycodone, and morphine, are prescribed legally for pain. Yet, deaths from opioids have increased rapidly since 1999 and become a national emergency. Many of them, such as heroin, are used illegally. The CDC identified three surges in opioid use: an increase in opioid prescriptions in the ‘90s, a surge of heroin around 2010, and an influx of fentanyl and other powerful synthetic opioids in 2013.
As overdose deaths grew, so did public calls to address them, prompting the CDC to change its prescription guidelines in 2016. The new guidelines suggested limiting medication for acute pain to a seven-day supply, capping daily doses of morphine, and other restrictions. Some statistics suggest that these policies have worked; from 2016 to 2019, prescriptions for opiates fell 44 percent. Physicians also started progressively lowering opioid doses for patients, a practice called tapering. A study tracking nearly 100,000 Medicare subscribers on opioids found that about 13 percent of patients were tapering in 2012, and that number increased to about 23 percent by 2017.
But some physicians may be too aggressive with this tapering strategy. About one in four people had doses reduced by more than 10 percent per week, a rate faster than the CDC recommends. The approach left people like Abayomi-Paul without the medication they needed. Every year, Abayomi-Paul says, her prescriptions are harder to fill. David Brushwood, a pharmacy professor who specializes in policy and outcomes at the University of Florida in Gainesville, says opioid dosing isn’t one-size-fits-all. “Patients need to be taken care of individually, not based on what some government agency says they need,” he says.
‘This is not survivable’
Health policy and disability rights attorney Erin Gilmer advocated for people with pain, using her own experience with chronic pain and a host of medical conditions as a guidepost. She launched an advocacy website, Healthcare as a Human Right, and shared her struggles on Twitter: “This pain is more than anything I've endured before and I've already been through too much. Yet because it's not simply identified no one believes it's as bad as it is. This is not survivable.”
When her pain dramatically worsened midway through 2021, Gilmer’s posts grew ominous: “I keep thinking it can't possibly get worse but somehow every day is worse than the last.”
The CDC revised its guidelines in 2022 after criticisms that people with chronic pain were being undertreated, enduring dangerous withdrawal symptoms, and suffering psychological distress. (Long-term opioid use can cause physical dependency, an adaptive reaction that is different than the compulsive misuse associated with a substance use disorder.) It was too late for Gilmer. On July 7, 2021, the 38-year-old died by suicide.
Last August, an Ohio district court ruling set forth a new requirement for Walgreens, Walmart, and CVS pharmacists in two counties. These pharmacists must now document opioid prescriptions that are turned down, even for customers who have no previous purchases at that pharmacy, and they’re required to share this information with other locations in the same chain. None of the three pharmacies responded to an interview request from Leaps.org.
In a practice called red flagging, pharmacists may label a prescription suspicious for a variety of reasons, such as if a pharmacist observes an unusually high dose, a long distance from the patient’s home to the pharmacy, or cash payment. Pharmacists may question patients or prescribers to resolve red flags but, regardless of the explanation, they’re free to refuse to fill a prescription.
As the risk of litigation has grown, so has finger-pointing, says Seth Whitelaw, a compliance consultant at Whitelaw Compliance Group in West Chester, PA, who advises drug, medical device, and biotech companies. Drugmakers accused in National Prescription Opioid Litigation (NPOL), a complex set of thousands of cases on opioid epidemic deaths, which includes the Ohio district case, have argued that they shouldn’t be responsible for the large supply of opiates and overdose deaths. Yet, prosecutors alleged that these pharmaceutical companies hid addiction and overdose risks when labeling opioids, while distributors and pharmacists failed to identify suspicious orders or scripts.
Patients and pharmacists fear red flags
The requirements that pharmacists document prescriptions they refuse to fill so far only apply to two counties in Ohio. But Brushwood fears they will spread because of this precedent, and because there’s no way for pharmacists to predict what new legislation is on the way. “There is no definition of a red flag, there are no lists of red flags. There is no instruction on what to do when a red flag is detected. There’s no guidance on how to document red flags. It is a standardless responsibility,” Brushwood says. This adds trepidation for pharmacists—and more hoops to jump through for patients.
“I went into the doctor one day here and she said, ‘I'm going to stop prescribing opioids to all my patients effective immediately,” Nicolson says.
“We now have about a dozen studies that show that actually ripping somebody off their medication increases their risk of overdose and suicide by three to five times, destabilizes their health and mental health, often requires some hospitalization or emergency care, and can cause heart attacks,” says Kate Nicolson, founder of the National Pain Advocacy Center based in Boulder, Colorado. “It can kill people.” Nicolson was in pain for decades due to a surgical injury to the nerves leading to her spinal cord before surgeries fixed the problem.
Another issue is that primary care offices may view opioid use as a reason to turn down new patients. In a 2021 study, secret shoppers called primary care clinics in nine states, identifying themselves as long-term opioid users. When callers said their opioids were discontinued because their former physician retired, as opposed to an unspecified reason, they were more likely to be offered an appointment. Even so, more than 40 percent were refused an appointment. The study authors say their findings suggest that some physicians may try to avoid treating people who use opioids.
Abayomi-Paul says red flagging has changed how she fills prescriptions. “Once I go to one place, I try to [continue] going to that same place because of the amount of records that I have and making sure my medications don’t conflict,” Abayomi-Paul says.
Nicolson moved to Colorado from Washington D.C. in 2015, before the CDC issued its 2016 guidelines. When the guidelines came out, she found the change to be shockingly abrupt. “I went into the doctor one day here and she said, ‘I'm going to stop prescribing opioids to all my patients effective immediately.’” Since then, she’s spoken with dozens of patients who have been red-flagged or simply haven’t been able to access pain medication.
Despite her expertise, Nicolson isn’t positive she could successfully fill an opioid prescription today even if she needed one. At this point, she’s not sure exactly what various pharmacies would view as a red flag. And she’s not confident that these red flags even work. “You can have very legitimate reasons for being 50 miles away or having to go to multiple pharmacies, given that there are drug shortages now, as well as someone refusing to fill [a prescription.] It doesn't mean that you’re necessarily ‘drug seeking.’”
While there’s no easy solution. Whitelaw says clarifying the role of pharmacists and physicians in patient access to opioids could help people get the medication they need. He is seeking policy changes that focus on the needs of people in pain more than the number of prescriptions filled. He also advocates standardizing the definition of red flags and procedures for resolving them. Still, there will never be a single policy that can be applied to all people, explains Brushwood, the University of Florida professor. “You have to make a decision about each individual prescription.”
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
When COVID-19 cases were surging in New York City in early spring, Chitra Mohan, a postdoctoral fellow at Weill Cornell, was overwhelmed with worry. But the pandemic was only part of her anxieties. Having come to the United States from India on a student visa that allowed her to work for a year after completing her degree, she had applied for a two-year extension, typically granted for those in STEM fields. But due to a clerical error—Mohan used an electronic signatureinstead of a handwritten one— her application was denied and she could no longerwork in the United States.
"I was put on unpaid leave and I lost my apartment and my health insurance—and that was in the middle of COVID!" she says.
Meanwhile her skills were very much needed in those unprecedented times. A molecular biologist studying how DNA can repair itself, Mohan was trained in reverse transcription polymerase chain reaction or RT-PCR—a lab technique that detects pathogens and is used to diagnose COVID-19. Mohan wanted to volunteer at testing centers, but because she couldn't legally work in the U.S., she wasn't allowed to help either. She moved to her cousin's house, hired a lawyer, and tried to restore her work status.
"I spent about $4,000 on lawyer fees and another $1,200 to pay for the motions I filed," she recalls. "I had to borrow money from my parents and my cousin because without my salary I just didn't have the $7,000 at hand." But the already narrow window of opportunity slammed completely shut when the Trump administration suspended issuing new visas for foreign researchers in June. All Mohan's attempts were denied. In August, she had to leave the country. "Given the recent work visa ban by the administration, all my options in the U.S. are closed," she wrote a bitter note on Twitter. "I have to uproot my entire life in NY for the past 6 years and leave." She eventually found a temporary position in Calcutta, where she can continue research.
Mohan is hardly alone in her visa saga. Many foreign scholars on H- and J-type visas and other permits that let them remain employed in America had been struggling to keep their rights to continue research, which in certain cases is crucial to battling the pandemic. Some had to leave the country, some filed every possible extension to buy time, and others are stuck in their home countries, unable to return. The already cumbersome process of applying for visas and extensions became crippled during the lockdowns. But in June, when President Trump extended and expanded immigration restrictions to cut the number of immigrant workers entering the U.S., the new limits left researchers' projects and careers in limbo—and some in jeopardy.
"We have been a beneficiary of this flow of human capacity and resource investment for many generations—and this is now threatened."
Rakesh Ramachandran, whose computational biology work contributed to one of the first coronavirus studies to map out its protein structures—is stranded in India. In early March, he had travelled there to attend a conference and visit the American consulate to stamp his H1 visa for a renewal, already granted. The pandemic shut down both the conference and the consulates, and Ramachandran hasn't been able to come back since. The consulates finally opened in September, but so far the online portal has no available appointment slots. "I'm told to keep trying," Ramachandran says.
The visa restrictions affected researchers worldwide, regardless of disciplines or countries. A Ph.D. student in neuroscience, Morgane Leroux had to do her experiments with mice at Gladstone Institutes in America and analyze the data back home at Sorbonne University in France. She had finished her first round of experiments when the lockdowns forced her to return to Paris, and she hasn't been able to come back to resume her work since. "I can't continue the experiments, which is really frustrating," she says, especially because she doesn't know what it means for her Ph.D. "I may have to entirely change my subject," she says, which she doesn't want to do—it would be a waste of time and money.
But besides wreaking havoc in scholars' personal lives and careers, the visa restrictions had—and will continue to have—tremendous deleterious effects on America's research and its global scientific competitiveness. "It's incredibly short-sighted and self-destructing to restrict the immigration of scientists into the U.S.," says Benjamin G. Neel, who directs the Laura and Isaac Perlmutter Cancer Center at New York University. "If they can't come here, they will go elsewhere," he says, causing a brain drain.
Neel in his lab with postdocs
(Courtesy of Neel)
Neel felt the outcomes of the shortsighted policies firsthand. In the past few months, his lab lost two postdoctoral researchers who had made major strides in understanding the biology of several particularly stubborn, treatment-resistant malignancies. One postdoc studied the underlying mechanisms responsible for 90 percent of pancreatic cancers and half of the colon ones. The other one devised a new system of modeling ovarian cancer in mice to test new therapeutic drug combinations for the deadliest tumor types—but had to return home to China.
"By working around the clock, she was able to get her paper accepted, but she hasn't been able to train us to use this new system, which can set us back six months," Neel says.
Her discoveries also helped the lab secure about $900,000 in grants for new research. Losing people like this is "literally killing the goose that lays the golden eggs," Neel adds. "If you want to make America poor again, this is the way to do it."
Cassidy R. Sugimoto at Indiana University Bloomington, who studies how scientific knowledge is produced and disseminated, says that scientists are the most productive when they are free to move, exchange ideas, and work at labs with the best equipment. Restricting that freedom reduces their achievement.
"Several empirical studied demonstrated the benefits to the U.S. by attracting and retaining foreign scientists. The disproportional number of our Nobel Prize winners were not only foreign-born but also foreign-educated," she says. Scientific advancement bolsters the country's economic prowess, too, so turning scholars away is bad for the economy long-term. "We have been a beneficiary of this flow of human capacity and resource investment for many generations—and this is now threatened," Sugimoto adds—because scientists will look elsewhere. "We are seeing them shifting to other countries that are more hospitable, both ideologically and in terms of health security. Many visiting scholars, postdocs, and graduate students who would otherwise come to the United States are now moving to Canada."
It's not only the Ph.D. students and postdocs who are affected. In some cases, even well-established professors who have already made their marks in the field and direct their own labs at prestigious research institutions may have to pack up and leave the country in the next few months. One scientist who directs a prominent neuroscience lab is betting on his visa renewal and a green card application, but if that's denied, the entire lab may be in jeopardy, as many grants hinge on his ability to stay employed in America.
"It's devastating to even think that it can happen," he says—after years of efforts invested. "I can't even comprehend how it would feel. It would be terrifying and really sad." (He asked to withhold his name for fear that it may adversely affect his applications.) Another scientist who originally shared her story for this article, later changed her mind and withdrew, worrying that speaking out may hurt the entire project, a high-profile COVID-19 effort. It's not how things should work in a democratic country, scientists admit, but that's the reality.
Still, some foreign scholars are speaking up. Mehmet Doğan, a physicist at University of California Berkeley who has been fighting a visa extension battle all year, says it's important to push back in an organized fashion with petitions and engage legislators. "This administration was very creative in finding subtle and not so subtle ways to make our lives more difficult," Doğan says. He adds that the newest rules, proposed by the Department of Homeland Security on September 24, could further limit the time scholars can stay, forcing them into continuous extension battles. That's why the upcoming election might be a turning point for foreign academics. "This election will decide if many of us will see the U.S. as the place to stay and work or whether we look at other countries," Doğan says, echoing the worries of Neel, Sugimoto, and others in academia.
Dogan on Zoom talking to his fellow union members of the Academic Researchers United, a union of almost 5,000 Academic Researchers.
(Credit: Ceyda Durmaz Dogan)
If this year has shown us anything, it is that viruses and pandemics know no borders as they sweep across the globe. Likewise, science can't be restrained by borders either. "Science is an international endeavor," says Neel—and right now humankind now needs unified scientific research more than ever, unhindered by immigration hurdles and visa wars. Humanity's wellbeing in America and beyond depends on it.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
Lina Zeldovich has written about science, medicine and technology for Popular Science, Smithsonian, National Geographic, Scientific American, Reader’s Digest, the New York Times and other major national and international publications. A Columbia J-School alumna, she has won several awards for her stories, including the ASJA Crisis Coverage Award for Covid reporting, and has been a contributing editor at Nautilus Magazine. In 2021, Zeldovich released her first book, The Other Dark Matter, published by the University of Chicago Press, about the science and business of turning waste into wealth and health. You can find her on http://linazeldovich.com/ and @linazeldovich.