“Deep Fake” Video Technology Is Advancing Faster Than Our Policies Can Keep Up
Artificial avatars for hire and sophisticated video manipulation carry profound implications for society.
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Alethea.ai sports a grid of faces smiling, blinking and looking about. Some are beautiful, some are oddly familiar, but all share one thing in common—they are fake.
Alethea creates "synthetic media"— including digital faces customers can license saying anything they choose with any voice they choose. Companies can hire these photorealistic avatars to appear in explainer videos, advertisements, multimedia projects or any other applications they might dream up without running auditions or paying talent agents or actor fees. Licenses begin at a mere $99. Companies may also license digital avatars of real celebrities or hire mashups created from real celebrities including "Don Exotic" (a mashup of Donald Trump and Joe Exotic) or "Baby Obama" (a large-eared toddler that looks remarkably similar to a former U.S. President).
Naturally, in the midst of the COVID pandemic, the appeal is understandable. Rather than flying to a remote location to film a beer commercial, an actor can simply license their avatar to do the work for them. The question is—where and when this tech will cross the line between legitimately licensed and authorized synthetic media to deep fakes—synthetic videos designed to deceive the public for financial and political gain.
Deep fakes are not new. From written quotes that are manipulated and taken out of context to audio quotes that are spliced together to mean something other than originally intended, misrepresentation has been around for centuries. What is new is the technology that allows this sort of seamless and sophisticated deception to be brought to the world of video.
"At one point, video content was considered more reliable, and had a higher threshold of trust," said Alethea CEO and co-founder, Arif Khan. "We think video is harder to fake and we aren't yet as sensitive to detecting those fakes. But the technology is definitely there."
"In the future, each of us will only trust about 15 people and that's it," said Phil Lelyveld, who serves as Immersive Media Program Lead at the Entertainment Technology Center at the University of Southern California. "It's already very difficult to tell true footage from fake. In the future, I expect this will only become more difficult."
How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
As the U.S. 2020 Presidential Election nears, the potential moral and ethical implications of this technology are startling. A number of cases of truth tampering have recently been widely publicized. On August 5, President Donald Trump's campaign released an ad featuring several photos of Joe Biden that were altered to make it seem like was hiding all alone in his basement. In one photo, at least ten people who had been sitting with Biden in the original shot were cut out. In other photos, Biden's image was removed from a nature preserve and praying in church to make it appear Biden was in that same basement. Recently several videos of Speaker of the House Nancy Pelosi were slowed down by 75 percent to make her sound as if her speech was slurred.
During a campaign event in Florida on September 15 of this year, former Vice President Joe Biden was introduced by Puerto Rican singer-songwriter Luis Fonsi. After he was introduced, Biden paid tribute to the singer-songwriter—he held up his cell phone and played the hit song "Despecito". Shortly afterward, a doctored version of this video appeared on self-described parody site the United Spot replacing the Despicito with N.W.A.'s "F—- Tha Police". By September 16, Donald Trump retweeted the video, twice—first with the line "What is this all about" and second with the line "China is drooling. They can't believe this!" Twitter was quick to mark the video in these tweets as manipulated media.
Twitter had previously addressed several of Donald Trump's tweets—flagging a video shared in June as manipulated media and removing altogether a video shared by Trump in July showing a group promoting the hydroxychloroquine as an effective cure for COVID-19. Many of these manipulated videos are ultimately flagged or taken down, but not before they are seen and shared by millions of online viewers.
These faked videos were exposed rather quickly, as they could be compared with the original, publicly available source material. But what happens when there is no original source material? How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
"This type of fake media is a profound threat to our democracy," said Reid Blackman, the CEO of VIRTUE--an ethics consultancy for AI leaders. "Democracy depends on well-informed citizens. When citizens can't or won't discern between real and fake news, the implications are huge."
In light of the importance of reliable information in the political system, there's a clear and present need to verify that the images and news we consume is authentic. So how can anyone ever know that the content they are viewing is real?
"This will not be a simple technological solution," said Blackman. "There is no 'truth' button to push to verify authenticity. There's plenty of blame and condemnation to go around. Purveyors of information have a responsibility to vet the reliability of their sources. And consumers also have a responsibility to vet their sources."
Yet the process of verifying sources has never been more challenging. More and more citizens are choosing to live in a "media bubble"—gathering and sharing news only from and with people who share their political leanings and opinions. At one time, United States broadcasters were bound by the Fairness Doctrine—requiring them to present controversial issues important to the public in a way that the FCC deemed honest, equitable and balanced. The repeal of this doctrine in 1987 paved the way for new forms of cable news channels such as Fox News and MSNBC that appealed to viewers with a particular point of view. The Internet has only exacerbated these tendencies. Social media algorithms are designed to keep people clicking within their comfort zones by presenting members with only the thoughts and opinions they want to hear.
"I sometimes laugh when I hear people tell me they can back a particular opinion they hold with research," said Blackman. "Having conducted a fair bit of true scientific research, I am aware that clicking on one article on the Internet hardly qualifies. But a surprising number of people believe that finding any source online that states the fact they choose to believe is the same as proving it true."
Back to the fundamental challenge: How do we as a society root out what's false online? Lelyveld suggests that it will begin by verifying things that are known to be true rather than trying to call out everything that is fake. "The EU called me in to talk about how to deal with fake news coming out of Russia," said Lelyveld. "I told them Hollywood has spent 100 years developing special effects technology to make things that are wholly fictional indistinguishable from the truth. I told them that you'll never chase down every source of fake news. You're better off focusing on what can be proved true."
Arif Khan agrees. "There are probably 100 accounts attributed to Elon Musk on Twitter, but only one has the blue checkmark," said Khan. "That means Twitter has verified that an account of public interest is real. That's what we're trying to do with our platform. Allow celebrities to verify that specific videos were licensed and authorized directly by them."
Alethea will use another key technology called blockchain to mark all authentic authorized videos with celebrity avatars. Blockchain uses a distributed ledger technology to make sure that no undetected changes have been made to the content. Think of the difference between editing a document in a traditional word processing program and editing in a distributed online editing system like Google Docs. In a traditional word processing program, you can edit and copy a document without revealing any changes. In a shared editing system like Google Docs, every person who shares the document can see a record of every edit, addition and copy made of any portion of the document. In a similar way, blockchain helps Alethea ensure that approved videos have not been copied or altered inappropriately.
While AI companies like Alethea are moving to ensure that avatars based on real individuals aren't wrongly identified, the situation becomes a bit murkier when it comes to the question of representing groups, races, creeds, and other forms of identity. Alethea is rightly proud that the completely artificial avatars visually represent a variety of ages, races and sexes. However, companies could conceivably license an avatar to represent a marginalized group without actually hiring a person within that group to decide what the avatar will do or say.
"I don't know if I would call this tokenism, as that is difficult to identify without understanding the hiring company's intent," said Blackman. "Where this becomes deeply troubling is when avatars are used to represent a marginalized group without clearly pointing out the actor is an avatar. It's one thing for an African American woman avatar to say, 'I like ice cream.' It's entirely different thing for an African American woman avatar to say she supports a particular political candidate. In the second case, the avatar is being used as social proof that real people of a certain type back a certain political idea. And there the deception is far more problematic."
"It always comes down to unintended consequences of technology," said Lelyveld. "Technology is neutral—it's only the implementation that has the power to be good or bad. Without a thoughtful approach to the cultural, moral and political implications of technology, it often drifts towards the bad. We need to make a conscious decision as we release new technology to ensure it moves towards the good."
When presented with the idea that his avatars might be used to misrepresent marginalized groups, Khan was thoughtful. "Yes, I can see that is an unintended consequence of our technology. We would like to encourage people to license the avatars of real people, who would have final approval over what their avatars say or do. As to what people do with our completely artificial avatars, we will have to consider that moving forward."
Lelyveld frankly sees the ability for advertisers to create avatars that are our assistants or even our friends as a greater moral concern. "Once our digital assistant or avatar becomes an integral part of our life—even a friend as it were, what's to stop marketers from having those digital friends make suggestions about what drink we buy, which shirt we wear or even which candidate we elect? The possibilities for bad actors to reach us through our digital circle is mind-boggling."
Ultimately, Blackman suggests, we as a society will need to make decisions about what matters to us. "We will need to build policies and write laws—tackling the biggest problems like political deep fakes first. And then we have to figure out how to make the penalties stiff enough to matter. Fining a multibillion-dollar company a few million for a major offense isn't likely to move the needle. The punishment will need to fit the crime."
Until then, media consumers will need to do their own due diligence—to do the difficult work of uncovering the often messy and deeply uncomfortable news that's the truth.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
A company uses AI to fight muscle loss and unhealthy aging
In December 2022, a company called BioAge Labs published findings on a drug that worked to prevent muscular atrophy, or the loss of muscle strength and mass, in older people.
There’s a growing need to slow down the aging process. The world’s population is getting older and, according to one estimate, 80 million Americans will be 65 or older by 2040. As we age, the risk of many chronic diseases goes up, from cancer to heart disease to Alzheimer’s.
BioAge Labs, a company based in California, is using genetic data to help people stay healthy for longer. CEO Kristen Fortney was inspired by the genetics of people who live long lives and resist many age-related diseases. In 2015, she started BioAge to study them and develop drug therapies based on the company’s learnings.
The team works with special biobanks that have been collecting blood samples and health data from individuals for up to 45 years. Using artificial intelligence, BioAge is able to find the distinctive molecular features that distinguish those who have healthy longevity from those who don’t.
In December 2022, BioAge published findings on a drug that worked to prevent muscular atrophy, or the loss of muscle strength and mass, in older people. Much of the research on aging has been in worms and mice, but BioAge is focused on human data, Fortney says. “This boosts our chances of developing drugs that will be safe and effective in human patients.”
How it works
With assistance from AI, BioAge measures more than 100,000 molecules in each blood sample, looking at proteins, RNA and metabolites, or small molecules that are produced through chemical processes. The company uses many techniques to identify these molecules, some of which convert the molecules into charged atoms and then separating them according to their weight and charge. The resulting data is very complex, with many thousands of data points from patients being followed over the decades.
BioAge validates its targets by examining whether a pathway going awry is actually linked to the development of diseases, based on the company’s analysis of biobank health records and blood samples. The team uses AI and machine learning to identify these pathways, and the key proteins in the unhealthy pathways become their main drug targets. “The approach taken by BioAge is an excellent example of how we can harness the power of big data and advances in AI technology to identify new drugs and therapeutic targets,” says Lorna Harries, a professor of molecular genetics at the University of Exeter Medical School.
Martin Borch Jensen is the founder of Gordian Biotechnology, a company focused on using gene therapy to treat aging. He says BioAge’s use of AI allows them to speed up the process of finding promising drug candidates. However, it remains a challenge to separate pathologies from aspects of the natural aging process that aren’t necessarily bad. “Some of the changes are likely protective responses to things going wrong,” Jensen says. “Their data doesn’t…distinguish that so they’ll need to validate and be clever.”
Developing a drug for muscle loss
BioAge decided to focus on muscular atrophy because it affects many elderly people, making it difficult to perform everyday activities and increasing the risk of falls. Using the biobank samples, the team modeled different pathways that looked like they could improve muscle health. They found that people who had faster walking speeds, better grip strength and lived longer had higher levels of a protein called apelin.
Apelin is a peptide, or a small protein, that circulates in the blood. It is involved in the process by which exercise increases and preserves muscle mass. BioAge wondered if they could prevent muscular atrophy by increasing the amount of signaling in the apelin pathway. Instead of the long process of designing a drug, they decided to repurpose an existing drug made by another biotech company. This company, called Amgen, had explored the drug as a way to treat heart failure. It didn’t end up working for that purpose, but BioAge took note that the drug did seem to activate the apelin pathway.
BioAge tested its new, repurposed drug, BGE-105, and, in a phase 1 clinical trial, it protected subjects from getting muscular atrophy compared to a placebo group that didn’t receive the drug. Healthy volunteers over age 65 received infusions of the drug during 10 days spent in bed, as if they were on bed rest while recovering from an illness or injury; the elderly are especially vulnerable to muscle loss in this situation. The 11 people taking BGE-105 showed a 100 percent improvement in thigh circumference compared to 10 people taking the placebo. Ultrasound observations also revealed that the group taking the durg had enhanced muscle quality and a 73 percent increase in muscle thickness. One volunteer taking BGE-105 did have muscle loss compared to the the placebo group.
Heather Whitson, the director of the Duke University Centre for the study of aging and human development, says that, overall, the results are encouraging. “The clinical findings so far support the premise that AI can help us sort through enormous amounts of data and identify the most promising points for beneficial interventions.”
More studies are needed to find out which patients benefit the most and whether there are side effects. “I think further studies will answer more questions,” Whitson says, noting that BGE-105 was designed to enhance only one aspect of physiology associated with exercise, muscle strength. But exercise itself has many other benefits on mood, sleep, bones and glucose metabolism. “We don’t know whether BGE-105 will impact these other outcomes,” she says.
The future
BioAge is planning phase 2 trials for muscular atrophy in patients with obesity and those who have been hospitalized in an intensive care unit. Using the data from biobanks, they’ve also developed another drug, BGE-100, to treat chronic inflammation in the brain, a condition that can worsen with age and contributes to neurodegenerative diseases. The team is currently testing the drug in animals to assess its effects and find the right dose.
BioAge envisions that its drugs will have broader implications for health than treating any one specific disease. “Ultimately, we hope to pioneer a paradigm shift in healthcare, from treatment to prevention, by targeting the root causes of aging itself,” Fortney says. “We foresee a future where healthy longevity is within reach for all.”
How old fishing nets turn into chairs, car mats and Prada bags
A company called Aquafil is turning the fibers from fishing nets and old carpets into new threads for chairs, car mats, bikinis and Prada bags.
Discarded nylon fishing nets in the oceans are among the most harmful forms of plastic pollution. Every year, about 640,000 tons of fishing gear are left in our oceans and other water bodies to turn into death traps for marine life. London-based non-profit World Animal Protection estimates that entanglement in this “ghost gear” kills at least 136,000 seals, sea lions and large whales every year. Experts are challenged to estimate how many birds, turtles, fish and other species meet the same fate because the numbers are so high.
Since 2009, Giulio Bonazzi, the son of a small textile producer in northern Italy, has been working on a solution: an efficient recycling process for nylon. As CEO and chairman of a company called Aquafil, Bonazzi is turning the fibers from fishing nets – and old carpets – into new threads for car mats, Adidas bikinis, environmentally friendly carpets and Prada bags.
For Bonazzi, shifting to recycled nylon was a question of survival for the family business. His parents founded a textile company in 1959 in a garage in Verona, Italy. Fifteen years later, they started Aquafil to produce nylon for making raincoats, an enterprise that led to factories on three continents. But before the turn of the century, cheap products from Asia flooded the market and destroyed Europe’s textile production. When Bonazzi had finished his business studies and prepared to take over the family company, he wondered how he could produce nylon, which is usually produced from petrochemicals, in a way that was both successful and ecologically sustainable.
The question led him on an intellectual journey as he read influential books by activists such as world-renowned marine biologist Sylvia Earle and got to know Michael Braungart, who helped develop the Cradle-to-Cradle ethos of a circular economy. But the challenges of applying these ideologies to his family business were steep. Although fishing nets have become a mainstay of environmental fashion ads—and giants like Dupont and BASF have made breakthroughs in recycling nylon—no one had been able to scale up these efforts.
For ten years, Bonazzi tinkered with ideas for a proprietary recycling process. “It’s incredibly difficult because these products are not made to be recycled,” Bonazzi says. One complication is the variety of materials used in older carpets. “They are made to be beautiful, to last, to be useful. We vastly underestimated the difficulty when we started.”
Soon it became clear to Bonazzi that he needed to change the entire production process. He found a way to disintegrate old fibers with heat and pull new strings from the discarded fishing nets and carpets. In 2022, his company Aquafil produced more than 45,000 tons of Econyl, which is 100% recycled nylon, from discarded waste.
More than half of Aquafil’s recyclate is from used goods. According to the company, the recycling saves 90 percent of the CO2 emissions compared to the production of conventional nylon. That amounts to saving 57,100 tons of CO2 equivalents for every 10,000 tons of Econyl produced.
Bonazzi collects fishing nets from all over the world, including Norway and Chile—which have the world’s largest salmon productions—in addition to the Mediterranean, Turkey, India, Japan, Thailand, the Philippines, Pakistan, and New Zealand. He counts the government leadership of Seychelles as his most recent client; the island has prohibited ships from throwing away their fishing nets, creating the demand for a reliable recycler. With nearly 3,000 employees, Aquafil operates almost 40 collection and production sites in a dozen countries, including four collection sites for old carpets in the U.S., located in California and Arizona.
First, the dirty nets are gathered, washed and dried. Bonazzi explains that nets often have been treated with antifouling agents such as copper oxide. “We recycle the coating separately,” he says via Zoom from his home near Verona. “Copper oxide is a useful substance, why throw it away?”
Still, only a small percentage of Aquafil’s products are made from nets fished out of the ocean, so your new bikini may not have saved a strangled baby dolphin. “Generally, nylon recycling is a good idea,” says Christian Schiller, the CEO of Cirplus, the largest global marketplace for recyclates and plastic waste. “But contrary to what consumers think, people rarely go out to the ocean to collect ghost nets. Most are old, discarded nets collected on land. There’s nothing wrong with this, but I find it a tad misleading to label the final products as made from ‘ocean plastic,’ prompting consumers to think they’re helping to clean the oceans by buying these products.”
Aquafil gets most of its nets from aqua farms. Surprisingly, one of Aquafil’s biggest problems is finding enough waste. “I know, it’s hard to believe because waste is everywhere,” Bonazzi says. “But we need to find it in reliable quantity and quality.” He has invested millions in establishing reliable logistics to source the fishing nets. Then the nets get shredded into granules that can be turned into car mats for the new Hyundai Ioniq 5 or a Gucci swimsuit.
The process works similarly with carpets. In the U.S. alone, 3.5 billion pounds of carpet are discarded in landfills every year, and less than 3 percent are currently recycled. Aquafil has built a recycling plant in Phoenix to help divert 12,500 tons of carpets from the landfill every year. The carpets are shredded and deconstructed into three components: fillers such as calcium carbonate will be reused in the cement industry, synthetic fibers like polypropylene can be used for engineering plastics, and nylon. Only the pelletized nylon gets shipped back to Europe for the production of Econyl. “We ship only what’s necessary,” Bonazzi says. Nearly 50 percent of his nylon in Italy and Slovenia is produced from recyclate, and he hopes to increase the percentage to two-thirds in the next two years.
His clients include Interface, the leading world pioneer for sustainable flooring, and many other carpet producers plus more than 2500 fashion labels, including Gucci, Prada, Patagonia, Louis Vuitton, Adidas and Stella McCartney. “Stella McCartney just introduced a parka that’s made 100 percent from Econyl,” Bonazzi says. “We’re also in a lot of sportswear because Nylon is a good fabric for swimwear and for yoga clothes.” Next, he’s looking into sunglasses and chairs made with Econyl - for instance, the flexible ergonomic noho chair, designed by New Zealand company Formway.
“When I look at a landfill, I see a gold mine," Bonazzi says.
“Bonazzi decided many years ago to invest in the production of recycled nylon though industry giants halted similar plans after losing large investments,” says Anika Herrmann, vice president of the German Greentech-competitor Camm Solutions, which creates bio-based polymers from cane sugar and other ag waste. “We need role models like Bonazzi who create sustainable solutions with courage and a pioneering spirit. Like Aquafil, we count on strategic partnerships to enable fast upscaling along the entire production chain.”
Bonazzi’s recycled nylon is still five to 10 percent more expensive than conventionally produced material. However, brands are increasingly bending to the pressure of eco-conscious consumers who demand sustainable fashion. What helped Bonazzi was the recent rise of oil prices and the pressure on industries to reduce their carbon footprint. Now Bonazzi says, “When I look at a landfill, I see a gold mine.”
Ideally, the manufacturers take the products back when the client is done with it, and because the nylon can theoretically be reused nearly infinitely, the chair or bikini could be made into another chair or bikini. “But honestly,” Bonazzi half-jokes, “if someone returns a McCartney parka to me, I’ll just resell it because it’s so expensive.”
The next step: Bonazzi wants to reshape the entire nylon industry by pivoting from post-consumer nylon to plant-based nylon. In 2017, he began producing “nylon-6,” together with Genomatica in San Diego. The process uses sugar instead of petroleum. “The idea is to make the very same molecule from sugar, not from oil,” he says. The demonstration plant in Ljubljana, Slovenia, has already produced several hundred tons of nylon, and Genomatica is collaborating with Lululemon to produce plant-based yoga wear.
Bonazzi acknowledges that his company needs a few more years before the technology is ready to meet his ultimate goal, producing only recyclable products with no petrochemicals, low emissions and zero waste on an industrial scale. “Recycling is not enough,” he says. “You also need to produce the primary material in a sustainable way, with a low carbon footprint.”