“Deep Fake” Video Technology Is Advancing Faster Than Our Policies Can Keep Up
Artificial avatars for hire and sophisticated video manipulation carry profound implications for society.
This article is part of the magazine, "The Future of Science In America: The Election Issue," co-published by LeapsMag, the Aspen Institute Science & Society Program, and GOOD.
Alethea.ai sports a grid of faces smiling, blinking and looking about. Some are beautiful, some are oddly familiar, but all share one thing in common—they are fake.
Alethea creates "synthetic media"— including digital faces customers can license saying anything they choose with any voice they choose. Companies can hire these photorealistic avatars to appear in explainer videos, advertisements, multimedia projects or any other applications they might dream up without running auditions or paying talent agents or actor fees. Licenses begin at a mere $99. Companies may also license digital avatars of real celebrities or hire mashups created from real celebrities including "Don Exotic" (a mashup of Donald Trump and Joe Exotic) or "Baby Obama" (a large-eared toddler that looks remarkably similar to a former U.S. President).
Naturally, in the midst of the COVID pandemic, the appeal is understandable. Rather than flying to a remote location to film a beer commercial, an actor can simply license their avatar to do the work for them. The question is—where and when this tech will cross the line between legitimately licensed and authorized synthetic media to deep fakes—synthetic videos designed to deceive the public for financial and political gain.
Deep fakes are not new. From written quotes that are manipulated and taken out of context to audio quotes that are spliced together to mean something other than originally intended, misrepresentation has been around for centuries. What is new is the technology that allows this sort of seamless and sophisticated deception to be brought to the world of video.
"At one point, video content was considered more reliable, and had a higher threshold of trust," said Alethea CEO and co-founder, Arif Khan. "We think video is harder to fake and we aren't yet as sensitive to detecting those fakes. But the technology is definitely there."
"In the future, each of us will only trust about 15 people and that's it," said Phil Lelyveld, who serves as Immersive Media Program Lead at the Entertainment Technology Center at the University of Southern California. "It's already very difficult to tell true footage from fake. In the future, I expect this will only become more difficult."
How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
As the U.S. 2020 Presidential Election nears, the potential moral and ethical implications of this technology are startling. A number of cases of truth tampering have recently been widely publicized. On August 5, President Donald Trump's campaign released an ad featuring several photos of Joe Biden that were altered to make it seem like was hiding all alone in his basement. In one photo, at least ten people who had been sitting with Biden in the original shot were cut out. In other photos, Biden's image was removed from a nature preserve and praying in church to make it appear Biden was in that same basement. Recently several videos of Speaker of the House Nancy Pelosi were slowed down by 75 percent to make her sound as if her speech was slurred.
During a campaign event in Florida on September 15 of this year, former Vice President Joe Biden was introduced by Puerto Rican singer-songwriter Luis Fonsi. After he was introduced, Biden paid tribute to the singer-songwriter—he held up his cell phone and played the hit song "Despecito". Shortly afterward, a doctored version of this video appeared on self-described parody site the United Spot replacing the Despicito with N.W.A.'s "F—- Tha Police". By September 16, Donald Trump retweeted the video, twice—first with the line "What is this all about" and second with the line "China is drooling. They can't believe this!" Twitter was quick to mark the video in these tweets as manipulated media.
Twitter had previously addressed several of Donald Trump's tweets—flagging a video shared in June as manipulated media and removing altogether a video shared by Trump in July showing a group promoting the hydroxychloroquine as an effective cure for COVID-19. Many of these manipulated videos are ultimately flagged or taken down, but not before they are seen and shared by millions of online viewers.
These faked videos were exposed rather quickly, as they could be compared with the original, publicly available source material. But what happens when there is no original source material? How do we know what's true in a world where original videos created with avatars of celebrities and politicians can be manipulated to say virtually anything?
"This type of fake media is a profound threat to our democracy," said Reid Blackman, the CEO of VIRTUE--an ethics consultancy for AI leaders. "Democracy depends on well-informed citizens. When citizens can't or won't discern between real and fake news, the implications are huge."
In light of the importance of reliable information in the political system, there's a clear and present need to verify that the images and news we consume is authentic. So how can anyone ever know that the content they are viewing is real?
"This will not be a simple technological solution," said Blackman. "There is no 'truth' button to push to verify authenticity. There's plenty of blame and condemnation to go around. Purveyors of information have a responsibility to vet the reliability of their sources. And consumers also have a responsibility to vet their sources."
Yet the process of verifying sources has never been more challenging. More and more citizens are choosing to live in a "media bubble"—gathering and sharing news only from and with people who share their political leanings and opinions. At one time, United States broadcasters were bound by the Fairness Doctrine—requiring them to present controversial issues important to the public in a way that the FCC deemed honest, equitable and balanced. The repeal of this doctrine in 1987 paved the way for new forms of cable news channels such as Fox News and MSNBC that appealed to viewers with a particular point of view. The Internet has only exacerbated these tendencies. Social media algorithms are designed to keep people clicking within their comfort zones by presenting members with only the thoughts and opinions they want to hear.
"I sometimes laugh when I hear people tell me they can back a particular opinion they hold with research," said Blackman. "Having conducted a fair bit of true scientific research, I am aware that clicking on one article on the Internet hardly qualifies. But a surprising number of people believe that finding any source online that states the fact they choose to believe is the same as proving it true."
Back to the fundamental challenge: How do we as a society root out what's false online? Lelyveld suggests that it will begin by verifying things that are known to be true rather than trying to call out everything that is fake. "The EU called me in to talk about how to deal with fake news coming out of Russia," said Lelyveld. "I told them Hollywood has spent 100 years developing special effects technology to make things that are wholly fictional indistinguishable from the truth. I told them that you'll never chase down every source of fake news. You're better off focusing on what can be proved true."
Arif Khan agrees. "There are probably 100 accounts attributed to Elon Musk on Twitter, but only one has the blue checkmark," said Khan. "That means Twitter has verified that an account of public interest is real. That's what we're trying to do with our platform. Allow celebrities to verify that specific videos were licensed and authorized directly by them."
Alethea will use another key technology called blockchain to mark all authentic authorized videos with celebrity avatars. Blockchain uses a distributed ledger technology to make sure that no undetected changes have been made to the content. Think of the difference between editing a document in a traditional word processing program and editing in a distributed online editing system like Google Docs. In a traditional word processing program, you can edit and copy a document without revealing any changes. In a shared editing system like Google Docs, every person who shares the document can see a record of every edit, addition and copy made of any portion of the document. In a similar way, blockchain helps Alethea ensure that approved videos have not been copied or altered inappropriately.
While AI companies like Alethea are moving to ensure that avatars based on real individuals aren't wrongly identified, the situation becomes a bit murkier when it comes to the question of representing groups, races, creeds, and other forms of identity. Alethea is rightly proud that the completely artificial avatars visually represent a variety of ages, races and sexes. However, companies could conceivably license an avatar to represent a marginalized group without actually hiring a person within that group to decide what the avatar will do or say.
"I don't know if I would call this tokenism, as that is difficult to identify without understanding the hiring company's intent," said Blackman. "Where this becomes deeply troubling is when avatars are used to represent a marginalized group without clearly pointing out the actor is an avatar. It's one thing for an African American woman avatar to say, 'I like ice cream.' It's entirely different thing for an African American woman avatar to say she supports a particular political candidate. In the second case, the avatar is being used as social proof that real people of a certain type back a certain political idea. And there the deception is far more problematic."
"It always comes down to unintended consequences of technology," said Lelyveld. "Technology is neutral—it's only the implementation that has the power to be good or bad. Without a thoughtful approach to the cultural, moral and political implications of technology, it often drifts towards the bad. We need to make a conscious decision as we release new technology to ensure it moves towards the good."
When presented with the idea that his avatars might be used to misrepresent marginalized groups, Khan was thoughtful. "Yes, I can see that is an unintended consequence of our technology. We would like to encourage people to license the avatars of real people, who would have final approval over what their avatars say or do. As to what people do with our completely artificial avatars, we will have to consider that moving forward."
Lelyveld frankly sees the ability for advertisers to create avatars that are our assistants or even our friends as a greater moral concern. "Once our digital assistant or avatar becomes an integral part of our life—even a friend as it were, what's to stop marketers from having those digital friends make suggestions about what drink we buy, which shirt we wear or even which candidate we elect? The possibilities for bad actors to reach us through our digital circle is mind-boggling."
Ultimately, Blackman suggests, we as a society will need to make decisions about what matters to us. "We will need to build policies and write laws—tackling the biggest problems like political deep fakes first. And then we have to figure out how to make the penalties stiff enough to matter. Fining a multibillion-dollar company a few million for a major offense isn't likely to move the needle. The punishment will need to fit the crime."
Until then, media consumers will need to do their own due diligence—to do the difficult work of uncovering the often messy and deeply uncomfortable news that's the truth.
[Editor's Note: To read other articles in this special magazine issue, visit the beautifully designed e-reader version.]
The Friday Five: Artificial DNA Could Give Cancer the Hook
In this week's Friday Five, artificial DNA could give cancer the hook. Plus, research suggests that this daily practice can improve relationships, social media could be good for finding factual information, injecting a gel may speed up recovery from injuries, and a blood pressure medicine is promising for a long healthy life.
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five:
- Artificial DNA gives cancer the hook
- This daily practice could improve relationships
- Can social media handle the truth?
- Injecting a gel could speed up recovery
- A blood pressure medicine for a long healthy life
9 Tips for Online Mental Health Therapy
Research shows that, for most patients, online therapy offers the same benefits as in-person therapy, yet many people still resist it. A behavioral scientist explains how you can use it to improve mental health.
Telehealth offers a vast improvement in access and convenience to all sorts of medical services, and online therapy for mental health is one of the most promising case studies for telehealth. With many online therapy options available, you can choose whatever works best for you. Yet many people are hesitant about using online therapy. Even if they do give it a try, they often don’t know how to make the most effective use of this treatment modality.
Why do so many feel uncertain about online therapy? A major reason stems from its novelty. Humans are creatures of habit, prone to falling for what behavioral scientists like myself call the status quo bias, a predisposition to stick to traditional practices and behaviors. Many people reject innovative solutions even when they would be helpful. Thus, while teletherapy was available long before the pandemic, and might have fit the needs of many potential clients, relatively few took advantage of this option.
Even when we do try new methodologies, we often don’t do so effectively, because we cling to the same approaches that worked in previous situations. Scientists call this behavior functional fixedness. It’s kind of like the saying about the hammer-nail syndrome: “when you have a hammer, everything looks like a nail.”
These two mental blindspots, the status quo bias and functional fixedness, impact decision making in many areas of life. Fortunately, recent research has shown effective and pragmatic strategies to defeat these dangerous errors in judgment. The nine tips below will help you make the best decisions to get effective online therapy, based on the latest research.
Trust the science of online therapy
Extensive research shows that, for most patients, online therapy offers the same benefits as in-person therapy.
For instance, a 2014 study in the Journal of Affective Disorders reported that online treatment proved just as effective as face-to-face treatment for depression. A 2018 study, published in Journal of Psychological Disorders, found that online cognitive behavioral therapy, or CBT, was just as effective as face-to-face treatment for major depression, panic disorder, social anxiety disorder, and generalized anxiety disorder. And a 2014 study in Behaviour Research and Therapy discovered that online CBT proved effective in treating anxiety disorders, and helped lower costs of treatment.
During the forced teletherapy of COVID, therapists worried that those with serious mental health conditions would be less likely to convert to teletherapy. Yet research published in Counselling Psychology Quarterly has helped to alleviate that concern. It found that those with schizophrenia, bipolar disorder, severe depression, PTSD, and even suicidality converted to teletherapy at about the same rate as those with less severe mental health challenges.
Yet teletherapy may not be for everyone. For example, adolescents had the most varied response to teletherapy, according to a 2020 study in Family Process. Some adapted quickly and easily, while others found it awkward and anxiety-inducing. On the whole, children with trauma respond worse to online therapy, per a 2020 study in Child Abuse & Neglect. The treatment of mental health issues can sometimes require in-person interactions, such as the use of eye movement desensitization and reprocessing to treat post-traumatic stress disorder. And according to a 2020 study from the Journal of Humanistic Psychology, online therapy may not be as effective for those suffering from loneliness.
Leverage the strengths of online therapy
Online therapy is much more accessible than in-person therapy for those with a decent internet connection, webcam, mic, and digital skills. You don’t have to commute to your therapist’s office, wasting money and time. You can take much less medical leave from work, saving you money and hassle with your boss. If you live in a sparsely populated area, online therapy could allow you to access many specialized kinds of therapy that isn’t accessible locally.
Online options are much quicker compared to the long waiting lines for in-person therapy. You also have much more convenient scheduling options. And you won’t have to worry about running into someone you know in the waiting room. Online therapy is easier to conceal from others and reduces stigma. Many patients may feel more comfortable and open to sharing in the privacy and comfort of their own home.
You can use a variety of communication tools suited to your needs at any given time. Video can be used to start a relationship with a therapist and have more intense and nuanced discussions, but can be draining, especially for those with social anxiety. Voice-only may work well for less intense discussions. Email offers a useful option for long-form, well-thought-out messages. Texting is useful for quick, real-time questions, answers, and reinforcement.
Plus, online therapy is often cheaper than in-person therapy. In the midst of COVID, many insurance providers have decided to cover online therapy.
Address the weaknesses
One weakness is the requirement for appropriate technology and skills to engage in online therapy. Another is the difficulty of forming a close therapeutic relationship with your therapist. You won’t be able to communicate non-verbals as fully and the therapist will not be able to read you as well, requiring you to be more deliberate in how you express yourself.
Another important issue is that online therapy is subject to less government oversight compared to the in-person approach, which is regulated in each state, providing a baseline of quality control. As a result, you have to do more research on the providers that offer online therapy to make sure they’re reputable, use only licensed therapists, and have a clear and transparent pay structure.
Be intentional about advocating for yourself
Figure out what kind of goals you want to achieve. Consider how, within the context of your goals, you can leverage the benefits of online therapy while addressing the weaknesses. Write down and commit to achieving your goals. Remember, you need to be your own advocate, especially in the less regulated space of online therapy, so focus on being proactive in achieving your goals.
Develop your Hero’s Journey
Because online therapy can occur at various times of day through videos calls, emails and text, it might feel more open-ended and less organized, which can have advantages and disadvantages. One way you can give it more structure is to ground these interactions in the story of your self-improvement. Our minds perceive the world through narratives. Create a story of how you’ll get from where you are to where you want to go, meaning your goals.
A good template to use is the Hero’s Journey. Start the narrative with where you are, and what caused you to seek therapy. Write about the obstacles you will need to overcome, and the kind of help from a therapist that you’ll need in the process. Then, describe the final end state: how will you be better off after this journey, including what you will have learned.
Especially in online therapy, you need to be on top of things. Too many people let the therapist manage the treatment plan. As you pursue your hero’s journey, another way to organize for success is to take notes on your progress, and reevaluate how you’re doing every month with your therapist.
Identify your ideal mentor
Since it’s more difficult to be confident about the quality of service providers in an online setting, you should identify in advance the traits of your desired therapist. Every Hero’s Journey involves a mentor figure who guides the protagonist through this journey. So who’s your ideal mentor? Write out their top 10 characteristics, from most to least important.
For example, you might want someone who is:
- Empathetic
- Caring
- Good listener
- Logical
- Direct
- Questioning
- Non-judgmental
- Organized
- Curious
- Flexible
That’s my list. Depending on what challenge you’re facing and your personality and preferences, you should make your own. Then, when you are matched with a therapist, evaluate how well they fit your ideal list.
Fail fast
When you first match with a therapist, try to fail fast. That means, instead of focusing on getting treatment, focus on figuring out if the therapist is a good match based on the traits you identified above. That will enable you to move on quickly if they’re not, and it’s very much worth it to figure that out early.
Tell them your goals, your story, and your vision of your ideal mentor. Ask them whether they think they are a match, and what kind of a treatment plan they would suggest based on the information you provided. And observe them yourself in your initial interactions, focusing on whether they’re a good match. Often, you’ll find that your initial vision of your ideal mentor is incomplete, and you’ll learn through doing therapy what kind of a therapist is the best fit for you.
Choose a small but meaningful subgoal to work on first
This small subgoal should be sufficient to be meaningful and impactful for improving your mental health, but not a big stretch for you to achieve. This subgoal should be a tool for you to use to evaluate whether the therapist is indeed a good fit for you. It will also help you evaluate whether the treatment plan makes sense, or whether it needs to be revised.
Know when to wrap things up
As you approach the end of your planned work and you see you’re reaching your goals, talk to the therapist about how to wrap up rather than letting things drag on for too long. You don’t want to become dependent on therapy: it’s meant to be a temporary intervention. Some less scrupulous therapists will insist that therapy should never end and we should all stay in therapy forever, and you want to avoid falling for this line. When you reach your goals, end your therapy, unless you discover a serious new reason to continue it. Still, it may be wise to set up occasional check-ins once every three to six months to make sure you’re staying on the right track.