“Deep Fake” Video Technology Is Advancing Faster Than Our Policies Can Keep Up
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Alethea.ai sports a grid of faces smiling, blinking and looking about. Some are beautiful, some are oddly familiar, but all share one thing in common—they are fake.
Alethea creates "synthetic media"— including digital faces customers can license saying anything they choose with any voice they choose. Companies can hire these photorealistic avatars to appear in explainer videos, advertisements, multimedia projects or any other applications they might dream up without running auditions or paying talent agents or actor fees. Licenses begin at a mere $99. Companies may also license digital avatars of real celebrities or hire mashups created from real celebrities including "Don Exotic" (a mashup of Donald Trump and Joe Exotic) or "Baby Obama" (a large-eared toddler that looks remarkably similar to a former U.S. President).
Naturally, in the midst of the COVID pandemic, the appeal is understandable. Rather than flying to a remote location to film a beer commercial, an actor can simply license their avatar to do the work for them. The question is—where and when this tech will cross the line between legitimately licensed and authorized synthetic media to deep fakes—synthetic videos designed to deceive the public for financial and political gain.
Deep fakes are not new. From written quotes that are manipulated and taken out of context to audio quotes that are spliced together to mean something other than originally intended, misrepresentation has been around for centuries. What is new is the technology that allows this sort of seamless and sophisticated deception to be brought to the world of video.
"At one point, video content was considered more reliable, and had a higher threshold of trust," said Alethea CEO and co-founder, Arif Khan. "We think video is harder to fake and we aren't yet as sensitive to detecting those fakes. But the technology is definitely there."
"In the future, each of us will only trust about 15 people and that's it," said Phil Lelyveld, who serves as Immersive Media Program Lead at the Entertainment Technology Center at the University of Southern California. "It's already very difficult to tell true footage from fake. In the future, I expect this will only become more difficult."
How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
As the U.S. 2020 Presidential Election nears, the potential moral and ethical implications of this technology are startling. A number of cases of truth tampering have recently been widely publicized. On August 5, President Donald Trump's campaign released an ad featuring several photos of Joe Biden that were altered to make it seem like was hiding all alone in his basement. In one photo, at least ten people who had been sitting with Biden in the original shot were cut out. In other photos, Biden's image was removed from a nature preserve and praying in church to make it appear Biden was in that same basement. Recently several videos of Speaker of the House Nancy Pelosi were slowed down by 75 percent to make her sound as if her speech was slurred.
During a campaign event in Florida on September 15 of this year, former Vice President Joe Biden was introduced by Puerto Rican singer-songwriter Luis Fonsi. After he was introduced, Biden paid tribute to the singer-songwriter—he held up his cell phone and played the hit song "Despecito". Shortly afterward, a doctored version of this video appeared on self-described parody site the United Spot replacing the Despicito with N.W.A.'s "F—- Tha Police". By September 16, Donald Trump retweeted the video, twice—first with the line "What is this all about" and second with the line "China is drooling. They can't believe this!" Twitter was quick to mark the video in these tweets as manipulated media.
Twitter had previously addressed several of Donald Trump's tweets—flagging a video shared in June as manipulated media and removing altogether a video shared by Trump in July showing a group promoting the hydroxychloroquine as an effective cure for COVID-19. Many of these manipulated videos are ultimately flagged or taken down, but not before they are seen and shared by millions of online viewers.
These faked videos were exposed rather quickly, as they could be compared with the original, publicly available source material. But what happens when there is no original source material? How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
"This type of fake media is a profound threat to our democracy," said Reid Blackman, the CEO of VIRTUE--an ethics consultancy for AI leaders. "Democracy depends on well-informed citizens. When citizens can't or won't discern between real and fake news, the implications are huge."
In light of the importance of reliable information in the political system, there's a clear and present need to verify that the images and news we consume is authentic. So how can anyone ever know that the content they are viewing is real?
"This will not be a simple technological solution," said Blackman. "There is no 'truth' button to push to verify authenticity. There's plenty of blame and condemnation to go around. Purveyors of information have a responsibility to vet the reliability of their sources. And consumers also have a responsibility to vet their sources."
Yet the process of verifying sources has never been more challenging. More and more citizens are choosing to live in a "media bubble"—gathering and sharing news only from and with people who share their political leanings and opinions. At one time, United States broadcasters were bound by the Fairness Doctrine—requiring them to present controversial issues important to the public in a way that the FCC deemed honest, equitable and balanced. The repeal of this doctrine in 1987 paved the way for new forms of cable news channels such as Fox News and MSNBC that appealed to viewers with a particular point of view. The Internet has only exacerbated these tendencies. Social media algorithms are designed to keep people clicking within their comfort zones by presenting members with only the thoughts and opinions they want to hear.
"I sometimes laugh when I hear people tell me they can back a particular opinion they hold with research," said Blackman. "Having conducted a fair bit of true scientific research, I am aware that clicking on one article on the Internet hardly qualifies. But a surprising number of people believe that finding any source online that states the fact they choose to believe is the same as proving it true."
Back to the fundamental challenge: How do we as a society root out what's false online? Lelyveld suggests that it will begin by verifying things that are known to be true rather than trying to call out everything that is fake. "The EU called me in to talk about how to deal with fake news coming out of Russia," said Lelyveld. "I told them Hollywood has spent 100 years developing special effects technology to make things that are wholly fictional indistinguishable from the truth. I told them that you'll never chase down every source of fake news. You're better off focusing on what can be proved true."
Arif Khan agrees. "There are probably 100 accounts attributed to Elon Musk on Twitter, but only one has the blue checkmark," said Khan. "That means Twitter has verified that an account of public interest is real. That's what we're trying to do with our platform. Allow celebrities to verify that specific videos were licensed and authorized directly by them."
Alethea will use another key technology called blockchain to mark all authentic authorized videos with celebrity avatars. Blockchain uses a distributed ledger technology to make sure that no undetected changes have been made to the content. Think of the difference between editing a document in a traditional word processing program and editing in a distributed online editing system like Google Docs. In a traditional word processing program, you can edit and copy a document without revealing any changes. In a shared editing system like Google Docs, every person who shares the document can see a record of every edit, addition and copy made of any portion of the document. In a similar way, blockchain helps Alethea ensure that approved videos have not been copied or altered inappropriately.
While AI companies like Alethea are moving to ensure that avatars based on real individuals aren't wrongly identified, the situation becomes a bit murkier when it comes to the question of representing groups, races, creeds, and other forms of identity. Alethea is rightly proud that the completely artificial avatars visually represent a variety of ages, races and sexes. However, companies could conceivably license an avatar to represent a marginalized group without actually hiring a person within that group to decide what the avatar will do or say.
"I don't know if I would call this tokenism, as that is difficult to identify without understanding the hiring company's intent," said Blackman. "Where this becomes deeply troubling is when avatars are used to represent a marginalized group without clearly pointing out the actor is an avatar. It's one thing for an African American woman avatar to say, 'I like ice cream.' It's entirely different thing for an African American woman avatar to say she supports a particular political candidate. In the second case, the avatar is being used as social proof that real people of a certain type back a certain political idea. And there the deception is far more problematic."
"It always comes down to unintended consequences of technology," said Lelyveld. "Technology is neutral—it's only the implementation that has the power to be good or bad. Without a thoughtful approach to the cultural, moral and political implications of technology, it often drifts towards the bad. We need to make a conscious decision as we release new technology to ensure it moves towards the good."
When presented with the idea that his avatars might be used to misrepresent marginalized groups, Khan was thoughtful. "Yes, I can see that is an unintended consequence of our technology. We would like to encourage people to license the avatars of real people, who would have final approval over what their avatars say or do. As to what people do with our completely artificial avatars, we will have to consider that moving forward."
Lelyveld frankly sees the ability for advertisers to create avatars that are our assistants or even our friends as a greater moral concern. "Once our digital assistant or avatar becomes an integral part of our life—even a friend as it were, what's to stop marketers from having those digital friends make suggestions about what drink we buy, which shirt we wear or even which candidate we elect? The possibilities for bad actors to reach us through our digital circle is mind-boggling."
Ultimately, Blackman suggests, we as a society will need to make decisions about what matters to us. "We will need to build policies and write laws—tackling the biggest problems like political deep fakes first. And then we have to figure out how to make the penalties stiff enough to matter. Fining a multibillion-dollar company a few million for a major offense isn't likely to move the needle. The punishment will need to fit the crime."
Until then, media consumers will need to do their own due diligence—to do the difficult work of uncovering the often messy and deeply uncomfortable news that's the truth.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
Some hospitals are pioneers in ditching plastic, turning green
This is part 2 of a three part series on a new generation of doctors leading the charge to make the health care industry more sustainable - for the benefit of their patients and the planet. Read part 1 here and part 3 here.
After graduating from her studies as an engineer, Nora Stroetzel ticked off the top item on her bucket list and traveled the world for a year. She loved remote places like the Indonesian rain forest she reached only by hiking for several days on foot, mountain villages in the Himalayas, and diving at reefs that were only accessible by local fishing boats.
“But no matter how far from civilization I ventured, one thing was already there: plastic,” Stroetzel says. “Plastic that would stay there for centuries, on 12,000 foot peaks and on beaches several hundred miles from the nearest city.” She saw “wild orangutans that could be lured by rustling plastic and hermit crabs that used plastic lids as dwellings instead of shells.”
While traveling she started volunteering for beach cleanups and helped build a recycling station in Indonesia. But the pivotal moment for her came after she returned to her hometown Kiel in Germany. “At the dentist, they gave me a plastic cup to rinse my mouth. I used it for maybe ten seconds before it was tossed out,” Stroetzel says. “That made me really angry.”
She decided to research alternatives for plastic in the medical sector and learned that cups could be reused and easily disinfected. All dentists routinely disinfect their tools anyway and, Stroetzel reasoned, it wouldn’t be too hard to extend that practice to cups.
It's a good example for how often plastic is used unnecessarily in medical practice, she says. The health care sector is the fifth biggest source of pollution and trash in industrialized countries. In the U.S., hospitals generate an estimated 6,000 tons of waste per day, including an average of 400 grams of plastic per patient per day, and this sector produces 8.5 percent of greenhouse gas emissions nationwide.
“Sustainable alternatives exist,” Stroetzel says, “but you have to painstakingly look for them; they are often not offered by the big manufacturers, and all of this takes way too much time [that] medical staff simply does not have during their hectic days.”
When Stroetzel spoke with medical staff in Germany, she found they were often frustrated by all of this waste, especially as they took care to avoid single-use plastic at home. Doctors in other countries share this frustration. In a recent poll, nine out of ten doctors in Germany said they’re aware of the urgency to find sustainable solutions in the health industry but don’t know how to achieve this goal.
After a year of researching more sustainable alternatives, Stroetzel founded a social enterprise startup called POP, short for Practice Without Plastic, together with IT expert Nicolai Niethe, to offer well-researched solutions. “Sustainable alternatives exist,” she says, “but you have to painstakingly look for them; they are often not offered by the big manufacturers, and all of this takes way too much time [that] medical staff simply does not have during their hectic days.”
In addition to reusable dentist cups, other good options for the heath care sector include washable N95 face masks and gloves made from nitrile, which waste less water and energy in their production. But Stroetzel admits that truly making a medical facility more sustainable is a complex task. “This includes negotiating with manufacturers who often package medical materials in double and triple layers of extra plastic.”
While initiatives such as Stroetzel’s provide much needed information, other experts reason that a wholesale rethinking of healthcare is needed. Voluntary action won’t be enough, and government should set the right example. Kari Nadeau, a Stanford physician who has spent 30 years researching the effects of environmental pollution on the immune system, and Kenneth Kizer, the former undersecretary for health in the U.S. Department of Veterans Affairs, wrote in JAMA last year that the medical industry and federal agencies that provide health care should be required to measure and make public their carbon footprints. “Government health systems do not disclose these data (and very rarely do private health care organizations), unlike more than 90% of the Standard & Poor’s top 500 companies and many nongovernment entities," they explained. "This could constitute a substantial step toward better equipping health professionals to confront climate change and other planetary health problems.”
Compared to the U.K., the U.S. healthcare industry lags behind in terms of measuring and managing its carbon footprint, and hospitals are the second highest energy user of any sector in the U.S.
Kizer and Nadeau look to the U.K. National Health Service (NHS), which created a Sustainable Development Unit in 2008 and began that year to conduct assessments of the NHS’s carbon footprint. The NHS also identified its biggest culprits: Of the 2019 footprint, with emissions totaling 25 megatons of carbon dioxide equivalent, 62 percent came from the supply chain, 24 percent from the direct delivery of care, 10 percent from staff commute and patient and visitor travel, and 4 percent from private health and care services commissioned by the NHS. From 1990 to 2019, the NHS has reduced its emission of carbon dioxide equivalents by 26 percent, mostly due to the switch to renewable energy for heat and power. Meanwhile, the NHS has encouraged health clinics in the U.K. to install wind generators or photovoltaics that convert light to electricity -- relatively quick ways to decarbonize buildings in the health sector.
Compared to the U.K., the U.S. healthcare industry lags behind in terms of measuring and managing its carbon footprint, and hospitals are the second highest energy user of any sector in the U.S. “We are already seeing patients with symptoms from climate change, such as worsened respiratory symptoms from increased wildfires and poor air quality in California,” write Thomas B. Newman, a pediatrist at the University of California, San Francisco, and UCSF clinical research coordinator Daisy Valdivieso. “Because of the enormous health threat posed by climate change, health professionals should mobilize support for climate mitigation and adaptation efforts.” They believe “the most direct place to start is to approach the low-lying fruit: reducing healthcare waste and overuse.”
In addition to resulting in waste, the plastic in hospitals ultimately harms patients, who may be even more vulnerable to the effects due to their health conditions. Microplastics have been detected in most humans, and on average, a human ingests five grams of microplastic per week. Newman and Valdivieso refer to the American Board of Internal Medicine's Choosing Wisely program as one of many initiatives that identify and publicize options for “safely doing less” as a strategy to reduce unnecessary healthcare practices, and in turn, reduce cost, resource use, and ultimately reduce medical harm.
A few U.S. clinics are pioneers in transitioning to clean energy sources. In Wisconsin, the nonprofit Gundersen Health network became the first hospital to cut its reliance on petroleum by switching to locally produced green energy in 2015, and it saved $1.2 million per year in the process. Kaiser Permanente eliminated its 800,000 ton carbon footprint through energy efficiency and purchasing carbon offsets, reaching a balance between carbon emissions and removing carbon from the atmosphere in 2020, the first U.S. health system to do so.
Cleveland Clinic has pledged to join Kaiser in becoming carbon neutral by 2027. Realizing that 80 percent of its 2008 carbon emissions came from electricity consumption, the Clinic started switching to renewable energy and installing solar panels, and it has invested in researching recyclable products and packaging. The Clinic’s sustainability report outlines several strategies for producing less waste, such as reusing cases for sterilizing instruments, cutting back on materials that can’t be recycled, and putting pressure on vendors to reduce product packaging.
The Charité Berlin, Europe’s biggest university hospital, has also announced its goal to become carbon neutral. Its sustainability managers have begun to identify the biggest carbon culprits in its operations. “We’ve already reduced CO2 emissions by 21 percent since 2016,” says Simon Batt-Nauerz, the director of infrastructure and sustainability.
The hospital still emits 100,000 tons of CO2 every year, as much as a city with 10,000 residents, but it’s making progress through ride share and bicycle programs for its staff of 20,000 employees, who can get their bikes repaired for free in one of the Charité-operated bike workshops. Another program targets doctors’ and nurses’ scrubs, which cause more than 200 tons of CO2 during manufacturing and cleaning. The staff is currently testing lighter, more sustainable scrubs made from recycled cellulose that is grown regionally and requires 80 percent less land use and 30 percent less water.
The Charité hospital in Berlin still emits 100,000 tons of CO2 every year, but it’s making progress through ride share and bicycle programs for its staff of 20,000 employees.
Wiebke Peitz | Specific to Charité
Anesthesiologist Susanne Koch spearheads sustainability efforts in anesthesiology at the Charité. She says that up to a third of hospital waste comes from surgery rooms. To reduce medical waste, she recommends what she calls the 5 Rs: Reduce, Reuse, Recycle, Rethink, Research. “In medicine, people don’t question the use of plastic because of safety concerns,” she says. “Nobody wants to be sued because something is reused. However, it is possible to reduce plastic and other materials safely.”
For instance, she says, typical surgery kits are single-use and contain more supplies than are actually needed, and the entire kit is routinely thrown out after the surgery. “Up to 20 percent of materials in a surgery room aren’t used but will be discarded,” Koch says. One solution could be smaller kits, she explains, and another would be to recycle the plastic. Another example is breathing tubes. “When they became scarce during the pandemic, studies showed that they can be used seven days instead of 24 hours without increased bacteria load when we change the filters regularly,” Koch says, and wonders, “What else can we reuse?”
In the Netherlands, TU Delft researchers Tim Horeman and Bart van Straten designed a method to melt down the blue polypropylene wrapping paper that keeps medical instruments sterile, so that the material can be turned it into new medical devices. Currently, more than a million kilos of the blue paper are used in Dutch hospitals every year. A growing number of Dutch hospitals are adopting this approach.
Another common practice that’s ripe for improvement is the use of a certain plastic, called PVC, in hospital equipment such as blood bags, tubes and masks. Because of its toxic components, PVC is almost never recycled in the U.S., but University of Michigan researchers Danielle Fagnani and Anne McNeil have discovered a chemical process that can break it down into material that could be incorporated back into production. This could be a step toward a circular economy “that accounts for resource inputs and emissions throughout a product’s life cycle, including extraction of raw materials, manufacturing, transport, use and reuse, and disposal,” as medical experts have proposed. “It’s a failure of humanity to have created these amazing materials which have improved our lives in many ways, but at the same time to be so shortsighted that we didn’t think about what to do with the waste,” McNeil said in a press release.
Susanne Koch puts it more succinctly: “What’s the point if we save patients while killing the planet?”
The Friday Five: A surprising health benefit for people who have kids
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five:
- Kids stressing you out? They could be protecting your health.
- A new device unlocks the heart's secrets
- Super-ager gene transplants
- Surgeons could 3D print your organs before operations
- A skull cap looks into the brain like an fMRI