Dadbot, Wifebot, Friendbot: The Future of Memorializing Avatars
In 2016, when my family found out that my father was dying from cancer, I did something that at the time felt completely obvious: I started building a chatbot replica of him.
I simply wanted to create an interactive way to share key parts of his life story.
I was not under any delusion that the Dadbot, as I soon began calling it, would be a true avatar of him. From my research about the voice computing revolution—Siri, Alexa, the Google Assistant—I knew that fully humanlike AIs, like you see in the movies, were a vast ways from technological reality. Replicating my dad in any real sense was never the goal, anyway; that notion gave me the creeps.
Instead, I simply wanted to create an interactive way to share key parts of his life story: facts about his ancestors in Greece. Memories from growing up. Stories about his hobbies, family life, and career. And I wanted the Dadbot, which sent text messages and audio clips over Facebook Messenger, to remind me of his personality—warm, erudite, and funny. So I programmed it to use his distinctive phrasings; to tell a few of his signature jokes and sing his favorite songs.
While creating the Dadbot, a laborious undertaking that sprawled into 2017, I fixated on two things. The first was getting the programming right, which I did using a conversational agent authoring platform called PullString. The second, far more wrenching concern was my father's health. Failing to improve after chemotherapy and immunotherapy, and steadily losing energy, weight, and the animating sparkle of life, he died on February 9.
John Vlahos at a family reunion in the summer of 2016, a few months after his cancer diagnosis.
(Courtesy James Vlahos)
After a magazine article that I wrote about the Dadbot came out in the summer of 2017, messages poured in from readers. While most people simply expressed sympathy, some conveyed a more urgent message: They wanted their own memorializing chatbots. One man implored me to make a bot for him; he had been diagnosed with cancer and wanted his six-month-old daughter to have a way to remember him. A technology entrepreneur needed advice on replicating what I did for her father, who had stage IV cancer. And a teacher in India asked me to engineer a conversational replica of her son, who had recently been struck and killed by a bus.
Journalists from around the world also got in touch for interviews, and they inevitably came around to the same question. Will virtual immortality, they asked, ever become a business?
The prospect of this happening had never crossed my mind. I was consumed by my father's struggle and my own grief. But the notion has since become head-slappingly obvious. I am not the only person to confront the loss of a loved one; the experience is universal. And I am not alone in craving a way to keep memories alive. Of course people like the ones who wrote me will get Dadbots, Mombots, and Childbots of their own. If a moonlighting writer like me can create a minimum viable product, then a company employing actual computer scientists could do much more.
But this prospect raises unanswered and unsettling questions. For businesses, profit, and not some deeply personal mission, will be the motivation. This shift will raise issues that I didn't have to confront. To make money, a virtual immortality company could follow the lucrative but controversial business model that has worked so well for Google and Facebook. To wit, a company could provide the memorializing chatbot for free and then find ways to monetize the attention and data of whoever communicated with it. Given the copious amount of personal information flowing back and forth in conversations with replica bots, this would be a data gold mine for the company—and a massive privacy risk for users.
Virtual immortality as commercial product will doubtless become more sophisticated.
Alternately, a company could charge for memorializing avatars, perhaps with an annual subscription fee. This would put the business in a powerful position. Imagine the fee getting hiked each year. A customer like me would find himself facing a terrible decision—grit my teeth and keep paying, or be forced to pull the plug on the best, closest reminder of a loved one that I have. The same person would effectively wind up dying twice.
Another way that a beloved digital avatar could die is if the company that creates it ceases to exist. This is no mere academic concern for me: Earlier this year, PullString was swallowed up by Apple. I'm still able to access the Dadbot on my own computer, fortunately, but the acquisition means that other friends and family members can no longer chat with him remotely.
Startups like PullString, of course, are characterized by impermanence; they tend to get snapped up by bigger companies or run out of venture capital and fold. But even if big players like, say, Facebook or Google get into the virtual immortality game, we can't count on them existing even a few decades from now, which means that the avatars enabled by their technology would die, too.
The permanence problem is the biggest hurdle faced by the fledgling enterprise of virtual immortality. So some entrepreneurs are attempting to enable avatars whose existence isn't reliant upon any one company or set of computer servers. "By leveraging the power of blockchain and decentralized software to replicate information, we help users create avatars that live on forever," says Alex Roy, the founder and CEO of the startup Everlife.ai. But until this type of solution exists, give props to conventional technology for preserving memories: printed photos and words on paper can last for centuries.
The fidelity of avatars—just how lifelike they are—also raises serious concerns. Before I started creating the Dadbot, I worried that the tech might be just good enough to remind my family of the man it emulated, but so far off from my real father that it gave us all the creeps. But because the Dadbot was a simple chatbot and not some all-knowing AI, and because the interface was a messaging app, there was no danger of him encroaching on the reality of my actual dad.
But virtual immortality as commercial product will doubtless become more sophisticated. Avatars will have brains built by teams of computer scientists employing the latest techniques in conversational AI. The replicas will not just text but also speak, using synthetic voices that emulate the ones of the people being memorialized. They may even come to life as animated clones on computer screens or in 3D with the help of virtual reality headsets.
What fascinates me is how technology can help to preserve the past—genuine facts and memories from peoples' lives.
These are all lines that I don't personally want to cross; replicating my dad was never the goal. I also never aspired to have some synthetic version of him that continued to exist in the present, capable of acquiring knowledge about the world or my life and of reacting to it in real time.
Instead, what fascinates me is how technology can help to preserve the past—genuine facts and memories from people's lives—and their actual voices so that their stories can be shared interactively after they have gone. I'm working on ideas for doing this via voice computing platforms like Alexa and Assistant, and while I don't have all of the answers yet, I'm excited to figure out what might be possible.
[Adapted from Talk to Me: How Voice Computing Will Transform the Way We Live, Work, and Think (Houghton Mifflin Harcourt, March 26, 2019).]
A new type of cancer therapy is shrinking deadly brain tumors with just one treatment
Few cancers are deadlier than glioblastomas—aggressive and lethal tumors that originate in the brain or spinal cord. Five years after diagnosis, less than five percent of glioblastoma patients are still alive—and more often, glioblastoma patients live just 14 months on average after receiving a diagnosis.
But an ongoing clinical trial at Mass General Cancer Center is giving new hope to glioblastoma patients and their families. The trial, called INCIPIENT, is meant to evaluate the effects of a special type of immune cell, called CAR-T cells, on patients with recurrent glioblastoma.
How CAR-T cell therapy works
CAR-T cell therapy is a type of cancer treatment called immunotherapy, where doctors modify a patient’s own immune system specifically to find and destroy cancer cells. In CAR-T cell therapy, doctors extract the patient’s T-cells, which are immune system cells that help fight off disease—particularly cancer. These T-cells are harvested from the patient and then genetically modified in a lab to produce proteins on their surface called chimeric antigen receptors (thus becoming CAR-T cells), which makes them able to bind to a specific protein on the patient’s cancer cells. Once modified, these CAR-T cells are grown in the lab for several weeks so that they can multiply into an army of millions. When enough cells have been grown, these super-charged T-cells are infused back into the patient where they can then seek out cancer cells, bind to them, and destroy them. CAR-T cell therapies have been approved by the US Food and Drug Administration (FDA) to treat certain types of lymphomas and leukemias, as well as multiple myeloma, but haven’t been approved to treat glioblastomas—yet.
CAR-T cell therapies don’t always work against solid tumors, such as glioblastomas. Because solid tumors contain different kinds of cancer cells, some cells can evade the immune system’s detection even after CAR-T cell therapy, according to a press release from Massachusetts General Hospital. For the INCIPIENT trial, researchers modified the CAR-T cells even further in hopes of making them more effective against solid tumors. These second-generation CAR-T cells (called CARv3-TEAM-E T cells) contain special antibodies that attack EFGR, a protein expressed in the majority of glioblastoma tumors. Unlike other CAR-T cell therapies, these particular CAR-T cells were designed to be directly injected into the patient’s brain.
The INCIPIENT trial results
The INCIPIENT trial involved three patients who were enrolled in the study between March and July 2023. All three patients—a 72-year-old man, a 74-year-old man, and a 57-year-old woman—were treated with chemo and radiation and enrolled in the trial with CAR-T cells after their glioblastoma tumors came back.
The results, which were published earlier this year in the New England Journal of Medicine (NEJM), were called “rapid” and “dramatic” by doctors involved in the trial. After just a single infusion of the CAR-T cells, each patient experienced a significant reduction in their tumor sizes. Just two days after receiving the infusion, the glioblastoma tumor of the 72-year-old man decreased by nearly twenty percent. Just two months later the tumor had shrunk by an astonishing 60 percent, and the change was maintained for more than six months. The most dramatic result was in the 57-year-old female patient, whose tumor shrank nearly completely after just one infusion of the CAR-T cells.
The results of the INCIPIENT trial were unexpected and astonishing—but unfortunately, they were also temporary. For all three patients, the tumors eventually began to grow back regardless of the CAR-T cell infusions. According to the press release from MGH, the medical team is now considering treating each patient with multiple infusions or prefacing each treatment with chemotherapy to prolong the response.
While there is still “more to do,” says co-author of the study neuro-oncologist Dr. Elizabeth Gerstner, the results are still promising. If nothing else, these second-generation CAR-T cell infusions may someday be able to give patients more time than traditional treatments would allow.
“These results are exciting but they are also just the beginning,” says Dr. Marcela Maus, a doctor and professor of medicine at Mass General who was involved in the clinical trial. “They tell us that we are on the right track in pursuing a therapy that has the potential to change the outlook for this intractable disease.”
Since the early 2000s, AI systems have eliminated more than 1.7 million jobs, and that number will only increase as AI improves. Some research estimates that by 2025, AI will eliminate more than 85 million jobs.
But for all the talk about job security, AI is also proving to be a powerful tool in healthcare—specifically, cancer detection. One recently published study has shown that, remarkably, artificial intelligence was able to detect 20 percent more cancers in imaging scans than radiologists alone.
Published in The Lancet Oncology, the study analyzed the scans of 80,000 Swedish women with a moderate hereditary risk of breast cancer who had undergone a mammogram between April 2021 and July 2022. Half of these scans were read by AI and then a radiologist to double-check the findings. The second group of scans was read by two researchers without the help of AI. (Currently, the standard of care across Europe is to have two radiologists analyze a scan before diagnosing a patient with breast cancer.)
The study showed that the AI group detected cancer in 6 out of every 1,000 scans, while the radiologists detected cancer in 5 per 1,000 scans. In other words, AI found 20 percent more cancers than the highly-trained radiologists.
Scientists have been using MRI images (like the ones pictured here) to train artificial intelligence to detect cancers earlier and with more accuracy. Here, MIT's AI system, MIRAI, looks for patterns in a patient's mammograms to detect breast cancer earlier than ever before. news.mit.edu
But even though the AI was better able to pinpoint cancer on an image, it doesn’t mean radiologists will soon be out of a job. Dr. Laura Heacock, a breast radiologist at NYU, said in an interview with CNN that radiologists do much more than simply screening mammograms, and that even well-trained technology can make errors. “These tools work best when paired with highly-trained radiologists who make the final call on your mammogram. Think of it as a tool like a stethoscope for a cardiologist.”
AI is still an emerging technology, but more and more doctors are using them to detect different cancers. For example, researchers at MIT have developed a program called MIRAI, which looks at patterns in patient mammograms across a series of scans and uses an algorithm to model a patient's risk of developing breast cancer over time. The program was "trained" with more than 200,000 breast imaging scans from Massachusetts General Hospital and has been tested on over 100,000 women in different hospitals across the world. According to MIT, MIRAI "has been shown to be more accurate in predicting the risk for developing breast cancer in the short term (over a 3-year period) compared to traditional tools." It has also been able to detect breast cancer up to five years before a patient receives a diagnosis.
The challenges for cancer-detecting AI tools now is not just accuracy. AI tools are also being challenged to perform consistently well across different ages, races, and breast density profiles, particularly given the increased risks that different women face. For example, Black women are 42 percent more likely than white women to die from breast cancer, despite having nearly the same rates of breast cancer as white women. Recently, an FDA-approved AI device for screening breast cancer has come under fire for wrongly detecting cancer in Black patients significantly more often than white patients.
As AI technology improves, radiologists will be able to accurately scan a more diverse set of patients at a larger volume than ever before, potentially saving more lives than ever.