“Deep Fake” Video Technology Is Advancing Faster Than Our Policies Can Keep Up
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Alethea.ai sports a grid of faces smiling, blinking and looking about. Some are beautiful, some are oddly familiar, but all share one thing in common—they are fake.
Alethea creates "synthetic media"— including digital faces customers can license saying anything they choose with any voice they choose. Companies can hire these photorealistic avatars to appear in explainer videos, advertisements, multimedia projects or any other applications they might dream up without running auditions or paying talent agents or actor fees. Licenses begin at a mere $99. Companies may also license digital avatars of real celebrities or hire mashups created from real celebrities including "Don Exotic" (a mashup of Donald Trump and Joe Exotic) or "Baby Obama" (a large-eared toddler that looks remarkably similar to a former U.S. President).
Naturally, in the midst of the COVID pandemic, the appeal is understandable. Rather than flying to a remote location to film a beer commercial, an actor can simply license their avatar to do the work for them. The question is—where and when this tech will cross the line between legitimately licensed and authorized synthetic media to deep fakes—synthetic videos designed to deceive the public for financial and political gain.
Deep fakes are not new. From written quotes that are manipulated and taken out of context to audio quotes that are spliced together to mean something other than originally intended, misrepresentation has been around for centuries. What is new is the technology that allows this sort of seamless and sophisticated deception to be brought to the world of video.
"At one point, video content was considered more reliable, and had a higher threshold of trust," said Alethea CEO and co-founder, Arif Khan. "We think video is harder to fake and we aren't yet as sensitive to detecting those fakes. But the technology is definitely there."
"In the future, each of us will only trust about 15 people and that's it," said Phil Lelyveld, who serves as Immersive Media Program Lead at the Entertainment Technology Center at the University of Southern California. "It's already very difficult to tell true footage from fake. In the future, I expect this will only become more difficult."
How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
As the U.S. 2020 Presidential Election nears, the potential moral and ethical implications of this technology are startling. A number of cases of truth tampering have recently been widely publicized. On August 5, President Donald Trump's campaign released an ad featuring several photos of Joe Biden that were altered to make it seem like was hiding all alone in his basement. In one photo, at least ten people who had been sitting with Biden in the original shot were cut out. In other photos, Biden's image was removed from a nature preserve and praying in church to make it appear Biden was in that same basement. Recently several videos of Speaker of the House Nancy Pelosi were slowed down by 75 percent to make her sound as if her speech was slurred.
During a campaign event in Florida on September 15 of this year, former Vice President Joe Biden was introduced by Puerto Rican singer-songwriter Luis Fonsi. After he was introduced, Biden paid tribute to the singer-songwriter—he held up his cell phone and played the hit song "Despecito". Shortly afterward, a doctored version of this video appeared on self-described parody site the United Spot replacing the Despicito with N.W.A.'s "F—- Tha Police". By September 16, Donald Trump retweeted the video, twice—first with the line "What is this all about" and second with the line "China is drooling. They can't believe this!" Twitter was quick to mark the video in these tweets as manipulated media.
Twitter had previously addressed several of Donald Trump's tweets—flagging a video shared in June as manipulated media and removing altogether a video shared by Trump in July showing a group promoting the hydroxychloroquine as an effective cure for COVID-19. Many of these manipulated videos are ultimately flagged or taken down, but not before they are seen and shared by millions of online viewers.
These faked videos were exposed rather quickly, as they could be compared with the original, publicly available source material. But what happens when there is no original source material? How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
"This type of fake media is a profound threat to our democracy," said Reid Blackman, the CEO of VIRTUE--an ethics consultancy for AI leaders. "Democracy depends on well-informed citizens. When citizens can't or won't discern between real and fake news, the implications are huge."
In light of the importance of reliable information in the political system, there's a clear and present need to verify that the images and news we consume is authentic. So how can anyone ever know that the content they are viewing is real?
"This will not be a simple technological solution," said Blackman. "There is no 'truth' button to push to verify authenticity. There's plenty of blame and condemnation to go around. Purveyors of information have a responsibility to vet the reliability of their sources. And consumers also have a responsibility to vet their sources."
Yet the process of verifying sources has never been more challenging. More and more citizens are choosing to live in a "media bubble"—gathering and sharing news only from and with people who share their political leanings and opinions. At one time, United States broadcasters were bound by the Fairness Doctrine—requiring them to present controversial issues important to the public in a way that the FCC deemed honest, equitable and balanced. The repeal of this doctrine in 1987 paved the way for new forms of cable news channels such as Fox News and MSNBC that appealed to viewers with a particular point of view. The Internet has only exacerbated these tendencies. Social media algorithms are designed to keep people clicking within their comfort zones by presenting members with only the thoughts and opinions they want to hear.
"I sometimes laugh when I hear people tell me they can back a particular opinion they hold with research," said Blackman. "Having conducted a fair bit of true scientific research, I am aware that clicking on one article on the Internet hardly qualifies. But a surprising number of people believe that finding any source online that states the fact they choose to believe is the same as proving it true."
Back to the fundamental challenge: How do we as a society root out what's false online? Lelyveld suggests that it will begin by verifying things that are known to be true rather than trying to call out everything that is fake. "The EU called me in to talk about how to deal with fake news coming out of Russia," said Lelyveld. "I told them Hollywood has spent 100 years developing special effects technology to make things that are wholly fictional indistinguishable from the truth. I told them that you'll never chase down every source of fake news. You're better off focusing on what can be proved true."
Arif Khan agrees. "There are probably 100 accounts attributed to Elon Musk on Twitter, but only one has the blue checkmark," said Khan. "That means Twitter has verified that an account of public interest is real. That's what we're trying to do with our platform. Allow celebrities to verify that specific videos were licensed and authorized directly by them."
Alethea will use another key technology called blockchain to mark all authentic authorized videos with celebrity avatars. Blockchain uses a distributed ledger technology to make sure that no undetected changes have been made to the content. Think of the difference between editing a document in a traditional word processing program and editing in a distributed online editing system like Google Docs. In a traditional word processing program, you can edit and copy a document without revealing any changes. In a shared editing system like Google Docs, every person who shares the document can see a record of every edit, addition and copy made of any portion of the document. In a similar way, blockchain helps Alethea ensure that approved videos have not been copied or altered inappropriately.
While AI companies like Alethea are moving to ensure that avatars based on real individuals aren't wrongly identified, the situation becomes a bit murkier when it comes to the question of representing groups, races, creeds, and other forms of identity. Alethea is rightly proud that the completely artificial avatars visually represent a variety of ages, races and sexes. However, companies could conceivably license an avatar to represent a marginalized group without actually hiring a person within that group to decide what the avatar will do or say.
"I don't know if I would call this tokenism, as that is difficult to identify without understanding the hiring company's intent," said Blackman. "Where this becomes deeply troubling is when avatars are used to represent a marginalized group without clearly pointing out the actor is an avatar. It's one thing for an African American woman avatar to say, 'I like ice cream.' It's entirely different thing for an African American woman avatar to say she supports a particular political candidate. In the second case, the avatar is being used as social proof that real people of a certain type back a certain political idea. And there the deception is far more problematic."
"It always comes down to unintended consequences of technology," said Lelyveld. "Technology is neutral—it's only the implementation that has the power to be good or bad. Without a thoughtful approach to the cultural, moral and political implications of technology, it often drifts towards the bad. We need to make a conscious decision as we release new technology to ensure it moves towards the good."
When presented with the idea that his avatars might be used to misrepresent marginalized groups, Khan was thoughtful. "Yes, I can see that is an unintended consequence of our technology. We would like to encourage people to license the avatars of real people, who would have final approval over what their avatars say or do. As to what people do with our completely artificial avatars, we will have to consider that moving forward."
Lelyveld frankly sees the ability for advertisers to create avatars that are our assistants or even our friends as a greater moral concern. "Once our digital assistant or avatar becomes an integral part of our life—even a friend as it were, what's to stop marketers from having those digital friends make suggestions about what drink we buy, which shirt we wear or even which candidate we elect? The possibilities for bad actors to reach us through our digital circle is mind-boggling."
Ultimately, Blackman suggests, we as a society will need to make decisions about what matters to us. "We will need to build policies and write laws—tackling the biggest problems like political deep fakes first. And then we have to figure out how to make the penalties stiff enough to matter. Fining a multibillion-dollar company a few million for a major offense isn't likely to move the needle. The punishment will need to fit the crime."
Until then, media consumers will need to do their own due diligence—to do the difficult work of uncovering the often messy and deeply uncomfortable news that's the truth.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
The future of non-hormonal birth control: Antibodies can stop sperm in their tracks
Unwanted pregnancy can now be added to the list of preventions that antibodies may be fighting in the near future. For decades, really since the 1980s, engineered monoclonal antibodies have been knocking out invading germs — preventing everything from cancer to COVID. Sperm, which have some of the same properties as germs, may be next.
Not only is there an unmet need on the market for alternatives to hormonal contraceptives, the genesis for the original research was personal for the then 22-year-old scientist who led it. Her findings were used to launch a company that could, within the decade, bring a new kind of contraceptive to the marketplace.
The genesis
It’s Suruchi Shrestha’s research — published in Science Translational Medicine in August 2021 and conducted as part of her dissertation while she was a graduate student at the University of North Carolina at Chapel Hill — that could change the future of contraception for many women worldwide. According to a Guttmacher Institute report, in the U.S. alone, there were 46 million sexually active women of reproductive age (15–49) who did not want to get pregnant in 2018. With the overturning of Roe v. Wade this year, Shrestha’s research could, indeed, be life changing for millions of American women and their families.
Now a scientist with NextVivo, Shrestha is not directly involved in the development of the contraceptive that is based on her research. But, back in 2016 when she was going through her own problems with hormonal contraceptives, she “was very personally invested” in her research project, Shrestha says. She was coping with a long list of negative effects from an implanted hormonal IUD. According to the Mayo Clinic, those can include severe pelvic pain, headaches, acute acne, breast tenderness, irregular bleeding and mood swings. After a year, she had the IUD removed, but it took another full year before all the side effects finally subsided; she also watched her sister suffer the “same tribulations” after trying a hormonal IUD, she says.
For contraceptive use either daily or monthly, Shrestha says, “You want the antibody to be very potent and also cheap.” That was her goal when she launched her study.
Shrestha unshelved antibody research that had been sitting idle for decades. It was in the late 80s that scientists in Japan first tried to develop anti-sperm antibodies for contraceptive use. But, 35 years ago, “Antibody production had not been streamlined as it is now, so antibodies were very expensive,” Shrestha explains. So, they shifted away from birth control, opting to focus on developing antibodies for vaccines.
Over the course of the last three decades, different teams of researchers have been working to make the antibody more effective, bringing the cost down, though it’s still expensive, according to Shrestha. For contraceptive use either daily or monthly, she says, “You want the antibody to be very potent and also cheap.” That was her goal when she launched her study.
The problem
The problem with contraceptives for women, Shrestha says, is that all but a few of them are hormone-based or have other negative side effects. In fact, some studies and reports show that millions of women risk unintended pregnancy because of medical contraindications with hormone-based contraceptives or to avoid the risks and side effects. While there are about a dozen contraceptive choices for women, there are two for men: the condom, considered 98% effective if used correctly, and vasectomy, 99% effective. Neither of these choices are hormone-based.
On the non-hormonal side for women, there is the diaphragm which is considered only 87 percent effective. It works better with the addition of spermicides — Nonoxynol-9, or N-9 — however, they are detergents; they not only kill the sperm, they also erode the vaginal epithelium. And, there’s the non-hormonal IUD which is 99% effective. However, the IUD needs to be inserted by a medical professional, and it has a number of negative side effects, including painful cramping at a higher frequency and extremely heavy or “abnormal” and unpredictable menstrual flows.
The hormonal version of the IUD, also considered 99% effective, is the one Shrestha used which caused her two years of pain. Of course, there’s the pill, which needs to be taken daily, and the birth control ring which is worn 24/7. Both cause side effects similar to the other hormonal contraceptives on the market. The ring is considered 93% effective mostly because of user error; the pill is considered 99% effective if taken correctly.
“That’s where we saw this opening or gap for women. We want a safe, non-hormonal contraceptive,” Shrestha says. Compounding the lack of good choices, is poor access to quality sex education and family planning information, according to the non-profit Urban Institute. A focus group survey suggested that the sex education women received “often lacked substance, leaving them feeling unprepared to make smart decisions about their sexual health and safety,” wrote the authors of the Urban Institute report. In fact, nearly half (45%, or 2.8 million) of the pregnancies that occur each year in the US are unintended, reports the Guttmacher Institute. Globally the numbers are similar. According to a new report by the United Nations, each year there are 121 million unintended pregnancies, worldwide.
The science
The early work on antibodies as a contraceptive had been inspired by women with infertility. It turns out that 9 to 12 percent of women who are treated for infertility have antibodies that develop naturally and work against sperm. Shrestha was encouraged that the antibodies were specific to the target — sperm — and therefore “very safe to use in women.” She aimed to make the antibodies more stable, more effective and less expensive so they could be more easily manufactured.
Since antibodies tend to stick to things that you tell them to stick to, the idea was, basically, to engineer antibodies to stick to sperm so they would stop swimming. Shrestha and her colleagues took the binding arm of an antibody that they’d isolated from an infertile woman. Then, targeting a unique surface antigen present on human sperm, they engineered a panel of antibodies with as many as six to 10 binding arms — “almost like tongs with prongs on the tongs, that bind the sperm,” explains Shrestha. “We decided to add those grabbers on top of it, behind it. So it went from having two prongs to almost 10. And the whole goal was to have so many arms binding the sperm that it clumps it” into a “dollop,” explains Shrestha, who earned a patent on her research.
Suruchi Shrestha works in the lab with a colleague. In 2016, her research on antibodies for birth control was inspired by her own experience with side effects from an implanted hormonal IUD.
UNC - Chapel Hill
The sperm stays right where it met the antibody, never reaching the egg for fertilization. Eventually, and naturally, “Our vaginal system will just flush it out,” Shrestha explains.
“She showed in her early studies that [she] definitely got the sperm immotile, so they didn't move. And that was a really promising start,” says Jasmine Edelstein, a scientist with an expertise in antibody engineering who was not involved in this research. Shrestha’s team at UNC reproduced the effect in the sheep, notes Edelstein, who works at the startup Be Biopharma. In fact, Shrestha’s anti-sperm antibodies that caused the sperm to agglutinate, or clump together, were 99.9% effective when delivered topically to the sheep’s reproductive tracts.
The future
Going forward, Shrestha thinks the ideal approach would be delivering the antibodies through a vaginal ring. “We want to use it at the source of the spark,” Shrestha says, as opposed to less direct methods, such as taking a pill. The ring would dissolve after one month, she explains, “and then you get another one.”
Engineered to have a long shelf life, the anti-sperm antibody ring could be purchased without a prescription, and women could insert it themselves, without a doctor. “That's our hope, so that it is accessible,” Shrestha says. “Anybody can just go and grab it and not worry about pregnancy or unintended pregnancy.”
Her patented research has been licensed by several biotech companies for clinical trials. A number of Shrestha’s co-authors, including her lab advisor, Sam Lai, have launched a company, Mucommune, to continue developing the contraceptives based on these antibodies.
And, results from a small clinical trial run by researchers at Boston University Chobanian & Avedisian School of Medicine show that a dissolvable vaginal film with antibodies was safe when tested on healthy women of reproductive age. That same group of researchers earlier this year received a $7.2 million grant from the National Institute of Health for further research on monoclonal antibody-based contraceptives, which have also been shown to block transmission of viruses, like HIV.
“As the costs come down, this becomes a more realistic option potentially for women,” says Edelstein. “The impact could be tremendous.”
The Friday Five: An mRNA vaccine works against cancer, new research suggests
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five:
- An mRNA vaccine that works against cancer
- These cameras inside the body have an unusual source of power
- A new theory for what causes aging
- Can bacteria make you excited to work out?
- Why women get Alzheimer's more often than men