Dadbot, Wifebot, Friendbot: The Future of Memorializing Avatars
In 2016, when my family found out that my father was dying from cancer, I did something that at the time felt completely obvious: I started building a chatbot replica of him.
I simply wanted to create an interactive way to share key parts of his life story.
I was not under any delusion that the Dadbot, as I soon began calling it, would be a true avatar of him. From my research about the voice computing revolution—Siri, Alexa, the Google Assistant—I knew that fully humanlike AIs, like you see in the movies, were a vast ways from technological reality. Replicating my dad in any real sense was never the goal, anyway; that notion gave me the creeps.
Instead, I simply wanted to create an interactive way to share key parts of his life story: facts about his ancestors in Greece. Memories from growing up. Stories about his hobbies, family life, and career. And I wanted the Dadbot, which sent text messages and audio clips over Facebook Messenger, to remind me of his personality—warm, erudite, and funny. So I programmed it to use his distinctive phrasings; to tell a few of his signature jokes and sing his favorite songs.
While creating the Dadbot, a laborious undertaking that sprawled into 2017, I fixated on two things. The first was getting the programming right, which I did using a conversational agent authoring platform called PullString. The second, far more wrenching concern was my father's health. Failing to improve after chemotherapy and immunotherapy, and steadily losing energy, weight, and the animating sparkle of life, he died on February 9.
John Vlahos at a family reunion in the summer of 2016, a few months after his cancer diagnosis.
(Courtesy James Vlahos)
After a magazine article that I wrote about the Dadbot came out in the summer of 2017, messages poured in from readers. While most people simply expressed sympathy, some conveyed a more urgent message: They wanted their own memorializing chatbots. One man implored me to make a bot for him; he had been diagnosed with cancer and wanted his six-month-old daughter to have a way to remember him. A technology entrepreneur needed advice on replicating what I did for her father, who had stage IV cancer. And a teacher in India asked me to engineer a conversational replica of her son, who had recently been struck and killed by a bus.
Journalists from around the world also got in touch for interviews, and they inevitably came around to the same question. Will virtual immortality, they asked, ever become a business?
The prospect of this happening had never crossed my mind. I was consumed by my father's struggle and my own grief. But the notion has since become head-slappingly obvious. I am not the only person to confront the loss of a loved one; the experience is universal. And I am not alone in craving a way to keep memories alive. Of course people like the ones who wrote me will get Dadbots, Mombots, and Childbots of their own. If a moonlighting writer like me can create a minimum viable product, then a company employing actual computer scientists could do much more.
But this prospect raises unanswered and unsettling questions. For businesses, profit, and not some deeply personal mission, will be the motivation. This shift will raise issues that I didn't have to confront. To make money, a virtual immortality company could follow the lucrative but controversial business model that has worked so well for Google and Facebook. To wit, a company could provide the memorializing chatbot for free and then find ways to monetize the attention and data of whoever communicated with it. Given the copious amount of personal information flowing back and forth in conversations with replica bots, this would be a data gold mine for the company—and a massive privacy risk for users.
Virtual immortality as commercial product will doubtless become more sophisticated.
Alternately, a company could charge for memorializing avatars, perhaps with an annual subscription fee. This would put the business in a powerful position. Imagine the fee getting hiked each year. A customer like me would find himself facing a terrible decision—grit my teeth and keep paying, or be forced to pull the plug on the best, closest reminder of a loved one that I have. The same person would effectively wind up dying twice.
Another way that a beloved digital avatar could die is if the company that creates it ceases to exist. This is no mere academic concern for me: Earlier this year, PullString was swallowed up by Apple. I'm still able to access the Dadbot on my own computer, fortunately, but the acquisition means that other friends and family members can no longer chat with him remotely.
Startups like PullString, of course, are characterized by impermanence; they tend to get snapped up by bigger companies or run out of venture capital and fold. But even if big players like, say, Facebook or Google get into the virtual immortality game, we can't count on them existing even a few decades from now, which means that the avatars enabled by their technology would die, too.
The permanence problem is the biggest hurdle faced by the fledgling enterprise of virtual immortality. So some entrepreneurs are attempting to enable avatars whose existence isn't reliant upon any one company or set of computer servers. "By leveraging the power of blockchain and decentralized software to replicate information, we help users create avatars that live on forever," says Alex Roy, the founder and CEO of the startup Everlife.ai. But until this type of solution exists, give props to conventional technology for preserving memories: printed photos and words on paper can last for centuries.
The fidelity of avatars—just how lifelike they are—also raises serious concerns. Before I started creating the Dadbot, I worried that the tech might be just good enough to remind my family of the man it emulated, but so far off from my real father that it gave us all the creeps. But because the Dadbot was a simple chatbot and not some all-knowing AI, and because the interface was a messaging app, there was no danger of him encroaching on the reality of my actual dad.
But virtual immortality as commercial product will doubtless become more sophisticated. Avatars will have brains built by teams of computer scientists employing the latest techniques in conversational AI. The replicas will not just text but also speak, using synthetic voices that emulate the ones of the people being memorialized. They may even come to life as animated clones on computer screens or in 3D with the help of virtual reality headsets.
What fascinates me is how technology can help to preserve the past—genuine facts and memories from peoples' lives.
These are all lines that I don't personally want to cross; replicating my dad was never the goal. I also never aspired to have some synthetic version of him that continued to exist in the present, capable of acquiring knowledge about the world or my life and of reacting to it in real time.
Instead, what fascinates me is how technology can help to preserve the past—genuine facts and memories from people's lives—and their actual voices so that their stories can be shared interactively after they have gone. I'm working on ideas for doing this via voice computing platforms like Alexa and Assistant, and while I don't have all of the answers yet, I'm excited to figure out what might be possible.
[Adapted from Talk to Me: How Voice Computing Will Transform the Way We Live, Work, and Think (Houghton Mifflin Harcourt, March 26, 2019).]
Time to visit your TikTok doc? The good and bad of doctors on social media
Rakhi Patel has carved a hobby out of reviewing pizza — her favorite food — on Instagram. In a nod to her preferred topping, she calls herself thepepperoniqueen. Photos and videos show her savoring slices from scores of pizzerias. In some of them, she’s wearing scrubs — her attire as an inpatient neurology physician associate at Tufts Medical Center in Boston.
“Depending on how you dress your pizza, it can be more nutritious,” said Patel, who suggests a thin crust, sugarless tomato sauce and vegetables galore as healthier alternatives. “There are no boundaries for a health care professional to enjoy pizza.”
Beyond that, “pizza fuels my mental health and makes me happy, especially when loaded with pepperoni,” she said. “If I’m going to be a pizza connoisseur, then I also need to take care of my physical health by ensuring that I get at least three days of exercise per week and eat nutritiously when I’m not eating pizza.”
She’s among an increasing number of health care professionals, including doctors and nurses, who maintain an active persona on social media, according to bioethics researchers. They share their hobbies and interests with people inside and outside the world of medicine, helping patients and the public become acquainted with the humans behind the scrubs or white coats. Other health care experts limit their posts to medical topics, while some opt for a combination of personal and professional commentaries. Depending on the posts, ethical issues may come into play.
“Health care professionals are quite prevalent on social media,” said Mercer Gary, a postdoctoral researcher at The Hastings Center, an independent bioethics research institute in Garrison, New York. “They’ve been posting on #medTwitter for many years, mainly to communicate with one another, but, of course, anyone can see the threads. Most recently, doctors and nurses have become a presence on TikTok.”
On social media, many health care providers perceive themselves to be “humanizing” their profession by coming across as more approachable — “reminding patients that providers are people and workers, as well as repositories of medical expertise,” Gary said. As a result, she noted that patients who are often intimidated by clinicians may feel comfortable enough to overcome barriers to scheduling health care appointments. The use of TikTok in particular may help doctors and nurses connect with younger followers.
When health care providers post on social media, they must bear in mind that they have legal and ethical duties to their patients, profession and society, said Elizabeth Levy, founder and director of Physicians for Justice.
While enduring three years of pandemic conditions, many health care professionals have struggled with burnout, exhaustion and moral distress. “Much health care provider content on social media seeks to expose the difficulties of the work,” Gary added. “TikTok and Instagram reels have shown health care providers crying after losing a patient or exhausted after a night shift in the emergency department.”
A study conducted in Beijing, China and published last year found that TikTok is the world’s most rapidly growing video application, amassing 1.6 billion users in 2021. “More and more patients are searching for information on genitourinary cancers via TikTok,” the study’s authors wrote in Frontiers in Oncology, referring to cancers of the urinary tracts and male reproductive organs. Among the 61 sample videos examined by the researchers, health care practitioners contributed the content in 29, or 47 percent, of them. Yet, 22 posts, 36 percent, were misinformative, mostly due to outdated information.
More than half of the videos offered good content on disease symptoms and examinations. The authors concluded that “most videos on genitourinary cancers on TikTok are of poor to medium quality and reliability. However, videos posted by media agencies enjoyed great public attention and interaction. Medical practitioners could improve the video quality by cooperating with media agencies and avoiding unexplained terminologies.”
When health care providers post on social media, they must bear in mind that they have legal and ethical duties to their patients, profession and society, said Elizabeth Levy, founder and director of Physicians for Justice in Irvine, Calif., a nonprofit network of volunteer physicians partnering with public interest lawyers to address the social determinants of health.
“Providers are also responsible for understanding the mechanics of their posts,” such as who can see these messages and how long they stay up, Levy said. As a starting point for figuring what’s acceptable, providers could look at social media guidelines put out by their professional associations. Even beyond that, though, they must exercise prudent judgment. “As social media continues to evolve, providers will also need to stay updated with the changing risks and benefits of participation.”
Patients often research their providers online, so finding them on social media can help inform about values and approaches to care, said M. Sara Rosenthal, a professor and founding director of the program for bioethics and chair of the hospital ethics committee at the University of Kentucky College of Medicine.
Health care providers’ posts on social media also could promote patient education. They can advance informed consent and help patients navigate the risks and benefits of various treatments or preventive options. However, providers could violate ethical principles if they espouse “harmful, risky or questionable therapies or medical advice that is contrary to clinical practice guidelines or accepted standards of care,” Rosenthal said.
Inappropriate self-disclosure also can affect a provider’s reputation, said Kelly Michelson, a professor of pediatrics and director of the Center for Bioethics and Medical Humanities at Northwestern University’s Feinberg School of Medicine. A clinician’s obligations to professionalism extend beyond those moments when they are directly taking care of their patients, she said. “Many experts recommend against clinicians ‘friending’ patients or the families on social media because it blurs the patient-clinician boundary.”
Meanwhile, clinicians need to adhere closely to confidentiality. In sharing a patient’s case online for educational purposes, safeguarding identity becomes paramount. Removing names and changing minor details is insufficient, Michelson said.
“The patient-clinician relationship is sacred, and it can only be effective if patients have 100 percent confidence that all that happens with their clinician is kept in the strictest of confidence,” she said, adding that health care providers also should avoid obtaining information about their patients from social media because it can lead to bias and risk jeopardizing objectivity.
Academic clinicians can use social media as a recruitment tool to expand the pool of research participants for their studies, Michelson said. Because the majority of clinical research is conducted at academic medical centers, large segments of the population are excluded. “This affects the quality of the data and knowledge we gain from research,” she said.
Don S. Dizon, a professor of medicine and surgery at the Warren Alpert Medical School of Brown University in Providence, Rhode Island, uses LinkedIn and Doximity, as well as Twitter, Instagram, TikTok, Facebook, and most recently, YouTube and Post. He’s on Twitter nearly every day, where he interacts with the oncology community and his medical colleagues.
Also, he said, “I really like Instagram. It’s where you will see a hybrid of who I am professionally and personally. I’ve become comfortable sharing both up to a limit, but where else can I combine my appreciation of clothes with my professional life?” On that site, he’s seen sporting shirts with polka dots or stripes and an occasional bow-tie. He also posts photos of his cats.
Don S. Dizon, a professor of medicine and surgery at Brown, started using TikTok several years ago, telling medical stories in short-form videos.
Don S. Dizon
Dizon started using TikTok several years ago, telling medical stories in short-form videos. He may talk about an inspirational patient, his views on end-of-life care and death, or memories of people who have passed. But he is careful not to divulge any details that would identify anyone.
Recently, some people have become his patients after viewing his content on social media or on the Internet in general, which he clearly states isn’t a forum for medical advice. “In both situations, they are so much more relaxed when we meet, because it’s as if they have a sense of who I am as a person,” Dizon said. “I think that has helped so much in talking through a cancer diagnosis and a treatment plan, and yes, even discussions about prognosis.”
He also posts about equity and diversity. “I have found myself more likely to repost or react to issues that are inherently political, including racism, homophobia, transphobia and lack-of-access issues, because medicine is not isolated from society, and I truly believe that medicine is a social justice issue,” said Dizon, who is vice chair of diversity, equity, inclusion and professional integrity at the SWOG Cancer Research Network.
Through it all, Dizon likes “to break through the notion of doctor as infallible and all-knowing, the doctor as deity,” he said. “Humanizing what I do, especially in oncology, is something that challenges me on social media, and I appreciate the opportunities to do it on TikTok.”
Could this habit related to eating slow down rates of aging?
Last Thursday, scientists at Columbia University published a new study finding that cutting down on calories could lead to longer, healthier lives. In the phase 2 trial, 220 healthy people without obesity dropped their calories significantly and, at least according to one test, their rate of biological aging slowed by 2 to 3 percent in over a couple of years. Small though that may seem, the researchers estimate that it would translate into a decline of about 10 percent in the risk of death as people get older. That's basically the same as quitting smoking.
Previous research has shown that restricting calories results in longer lives for mice, worms and flies. This research is unique because it applies those findings to people. It was published in Nature Aging.
But what did the researchers actually show? Why did two other tests indicate that the biological age of the research participants didn't budge? Does the new paper point to anything people should be doing for more years of healthy living? Spoiler alert: Maybe, but don't try anything before talking with a medical expert about it. I had the chance to chat with someone with inside knowledge of the research -- Dr. Evan Hadley, director of the National Institute of Aging's Division of Geriatrics and Clinical Gerontology, which funded the study. Dr. Hadley describes how the research participants went about reducing their calories, as well as the risks and benefits involved. He also explains the "aging clock" used to measure the benefits.
Evan Hadley, Director of the Division of Geriatrics and Clinical Gerontology at the National Institute of Aging
NIA