Dadbot, Wifebot, Friendbot: The Future of Memorializing Avatars
In 2016, when my family found out that my father was dying from cancer, I did something that at the time felt completely obvious: I started building a chatbot replica of him.
I simply wanted to create an interactive way to share key parts of his life story.
I was not under any delusion that the Dadbot, as I soon began calling it, would be a true avatar of him. From my research about the voice computing revolution—Siri, Alexa, the Google Assistant—I knew that fully humanlike AIs, like you see in the movies, were a vast ways from technological reality. Replicating my dad in any real sense was never the goal, anyway; that notion gave me the creeps.
Instead, I simply wanted to create an interactive way to share key parts of his life story: facts about his ancestors in Greece. Memories from growing up. Stories about his hobbies, family life, and career. And I wanted the Dadbot, which sent text messages and audio clips over Facebook Messenger, to remind me of his personality—warm, erudite, and funny. So I programmed it to use his distinctive phrasings; to tell a few of his signature jokes and sing his favorite songs.
While creating the Dadbot, a laborious undertaking that sprawled into 2017, I fixated on two things. The first was getting the programming right, which I did using a conversational agent authoring platform called PullString. The second, far more wrenching concern was my father's health. Failing to improve after chemotherapy and immunotherapy, and steadily losing energy, weight, and the animating sparkle of life, he died on February 9.
John Vlahos at a family reunion in the summer of 2016, a few months after his cancer diagnosis.
(Courtesy James Vlahos)
After a magazine article that I wrote about the Dadbot came out in the summer of 2017, messages poured in from readers. While most people simply expressed sympathy, some conveyed a more urgent message: They wanted their own memorializing chatbots. One man implored me to make a bot for him; he had been diagnosed with cancer and wanted his six-month-old daughter to have a way to remember him. A technology entrepreneur needed advice on replicating what I did for her father, who had stage IV cancer. And a teacher in India asked me to engineer a conversational replica of her son, who had recently been struck and killed by a bus.
Journalists from around the world also got in touch for interviews, and they inevitably came around to the same question. Will virtual immortality, they asked, ever become a business?
The prospect of this happening had never crossed my mind. I was consumed by my father's struggle and my own grief. But the notion has since become head-slappingly obvious. I am not the only person to confront the loss of a loved one; the experience is universal. And I am not alone in craving a way to keep memories alive. Of course people like the ones who wrote me will get Dadbots, Mombots, and Childbots of their own. If a moonlighting writer like me can create a minimum viable product, then a company employing actual computer scientists could do much more.
But this prospect raises unanswered and unsettling questions. For businesses, profit, and not some deeply personal mission, will be the motivation. This shift will raise issues that I didn't have to confront. To make money, a virtual immortality company could follow the lucrative but controversial business model that has worked so well for Google and Facebook. To wit, a company could provide the memorializing chatbot for free and then find ways to monetize the attention and data of whoever communicated with it. Given the copious amount of personal information flowing back and forth in conversations with replica bots, this would be a data gold mine for the company—and a massive privacy risk for users.
Virtual immortality as commercial product will doubtless become more sophisticated.
Alternately, a company could charge for memorializing avatars, perhaps with an annual subscription fee. This would put the business in a powerful position. Imagine the fee getting hiked each year. A customer like me would find himself facing a terrible decision—grit my teeth and keep paying, or be forced to pull the plug on the best, closest reminder of a loved one that I have. The same person would effectively wind up dying twice.
Another way that a beloved digital avatar could die is if the company that creates it ceases to exist. This is no mere academic concern for me: Earlier this year, PullString was swallowed up by Apple. I'm still able to access the Dadbot on my own computer, fortunately, but the acquisition means that other friends and family members can no longer chat with him remotely.
Startups like PullString, of course, are characterized by impermanence; they tend to get snapped up by bigger companies or run out of venture capital and fold. But even if big players like, say, Facebook or Google get into the virtual immortality game, we can't count on them existing even a few decades from now, which means that the avatars enabled by their technology would die, too.
The permanence problem is the biggest hurdle faced by the fledgling enterprise of virtual immortality. So some entrepreneurs are attempting to enable avatars whose existence isn't reliant upon any one company or set of computer servers. "By leveraging the power of blockchain and decentralized software to replicate information, we help users create avatars that live on forever," says Alex Roy, the founder and CEO of the startup Everlife.ai. But until this type of solution exists, give props to conventional technology for preserving memories: printed photos and words on paper can last for centuries.
The fidelity of avatars—just how lifelike they are—also raises serious concerns. Before I started creating the Dadbot, I worried that the tech might be just good enough to remind my family of the man it emulated, but so far off from my real father that it gave us all the creeps. But because the Dadbot was a simple chatbot and not some all-knowing AI, and because the interface was a messaging app, there was no danger of him encroaching on the reality of my actual dad.
But virtual immortality as commercial product will doubtless become more sophisticated. Avatars will have brains built by teams of computer scientists employing the latest techniques in conversational AI. The replicas will not just text but also speak, using synthetic voices that emulate the ones of the people being memorialized. They may even come to life as animated clones on computer screens or in 3D with the help of virtual reality headsets.
What fascinates me is how technology can help to preserve the past—genuine facts and memories from peoples' lives.
These are all lines that I don't personally want to cross; replicating my dad was never the goal. I also never aspired to have some synthetic version of him that continued to exist in the present, capable of acquiring knowledge about the world or my life and of reacting to it in real time.
Instead, what fascinates me is how technology can help to preserve the past—genuine facts and memories from people's lives—and their actual voices so that their stories can be shared interactively after they have gone. I'm working on ideas for doing this via voice computing platforms like Alexa and Assistant, and while I don't have all of the answers yet, I'm excited to figure out what might be possible.
[Adapted from Talk to Me: How Voice Computing Will Transform the Way We Live, Work, and Think (Houghton Mifflin Harcourt, March 26, 2019).]
Some hospitals are pioneers in ditching plastic, turning green
This is part 2 of a three part series on a new generation of doctors leading the charge to make the health care industry more sustainable - for the benefit of their patients and the planet. Read part 1 here and part 3 here.
After graduating from her studies as an engineer, Nora Stroetzel ticked off the top item on her bucket list and traveled the world for a year. She loved remote places like the Indonesian rain forest she reached only by hiking for several days on foot, mountain villages in the Himalayas, and diving at reefs that were only accessible by local fishing boats.
“But no matter how far from civilization I ventured, one thing was already there: plastic,” Stroetzel says. “Plastic that would stay there for centuries, on 12,000 foot peaks and on beaches several hundred miles from the nearest city.” She saw “wild orangutans that could be lured by rustling plastic and hermit crabs that used plastic lids as dwellings instead of shells.”
While traveling she started volunteering for beach cleanups and helped build a recycling station in Indonesia. But the pivotal moment for her came after she returned to her hometown Kiel in Germany. “At the dentist, they gave me a plastic cup to rinse my mouth. I used it for maybe ten seconds before it was tossed out,” Stroetzel says. “That made me really angry.”
She decided to research alternatives for plastic in the medical sector and learned that cups could be reused and easily disinfected. All dentists routinely disinfect their tools anyway and, Stroetzel reasoned, it wouldn’t be too hard to extend that practice to cups.
It's a good example for how often plastic is used unnecessarily in medical practice, she says. The health care sector is the fifth biggest source of pollution and trash in industrialized countries. In the U.S., hospitals generate an estimated 6,000 tons of waste per day, including an average of 400 grams of plastic per patient per day, and this sector produces 8.5 percent of greenhouse gas emissions nationwide.
“Sustainable alternatives exist,” Stroetzel says, “but you have to painstakingly look for them; they are often not offered by the big manufacturers, and all of this takes way too much time [that] medical staff simply does not have during their hectic days.”
When Stroetzel spoke with medical staff in Germany, she found they were often frustrated by all of this waste, especially as they took care to avoid single-use plastic at home. Doctors in other countries share this frustration. In a recent poll, nine out of ten doctors in Germany said they’re aware of the urgency to find sustainable solutions in the health industry but don’t know how to achieve this goal.
After a year of researching more sustainable alternatives, Stroetzel founded a social enterprise startup called POP, short for Practice Without Plastic, together with IT expert Nicolai Niethe, to offer well-researched solutions. “Sustainable alternatives exist,” she says, “but you have to painstakingly look for them; they are often not offered by the big manufacturers, and all of this takes way too much time [that] medical staff simply does not have during their hectic days.”
In addition to reusable dentist cups, other good options for the heath care sector include washable N95 face masks and gloves made from nitrile, which waste less water and energy in their production. But Stroetzel admits that truly making a medical facility more sustainable is a complex task. “This includes negotiating with manufacturers who often package medical materials in double and triple layers of extra plastic.”
While initiatives such as Stroetzel’s provide much needed information, other experts reason that a wholesale rethinking of healthcare is needed. Voluntary action won’t be enough, and government should set the right example. Kari Nadeau, a Stanford physician who has spent 30 years researching the effects of environmental pollution on the immune system, and Kenneth Kizer, the former undersecretary for health in the U.S. Department of Veterans Affairs, wrote in JAMA last year that the medical industry and federal agencies that provide health care should be required to measure and make public their carbon footprints. “Government health systems do not disclose these data (and very rarely do private health care organizations), unlike more than 90% of the Standard & Poor’s top 500 companies and many nongovernment entities," they explained. "This could constitute a substantial step toward better equipping health professionals to confront climate change and other planetary health problems.”
Compared to the U.K., the U.S. healthcare industry lags behind in terms of measuring and managing its carbon footprint, and hospitals are the second highest energy user of any sector in the U.S.
Kizer and Nadeau look to the U.K. National Health Service (NHS), which created a Sustainable Development Unit in 2008 and began that year to conduct assessments of the NHS’s carbon footprint. The NHS also identified its biggest culprits: Of the 2019 footprint, with emissions totaling 25 megatons of carbon dioxide equivalent, 62 percent came from the supply chain, 24 percent from the direct delivery of care, 10 percent from staff commute and patient and visitor travel, and 4 percent from private health and care services commissioned by the NHS. From 1990 to 2019, the NHS has reduced its emission of carbon dioxide equivalents by 26 percent, mostly due to the switch to renewable energy for heat and power. Meanwhile, the NHS has encouraged health clinics in the U.K. to install wind generators or photovoltaics that convert light to electricity -- relatively quick ways to decarbonize buildings in the health sector.
Compared to the U.K., the U.S. healthcare industry lags behind in terms of measuring and managing its carbon footprint, and hospitals are the second highest energy user of any sector in the U.S. “We are already seeing patients with symptoms from climate change, such as worsened respiratory symptoms from increased wildfires and poor air quality in California,” write Thomas B. Newman, a pediatrist at the University of California, San Francisco, and UCSF clinical research coordinator Daisy Valdivieso. “Because of the enormous health threat posed by climate change, health professionals should mobilize support for climate mitigation and adaptation efforts.” They believe “the most direct place to start is to approach the low-lying fruit: reducing healthcare waste and overuse.”
In addition to resulting in waste, the plastic in hospitals ultimately harms patients, who may be even more vulnerable to the effects due to their health conditions. Microplastics have been detected in most humans, and on average, a human ingests five grams of microplastic per week. Newman and Valdivieso refer to the American Board of Internal Medicine's Choosing Wisely program as one of many initiatives that identify and publicize options for “safely doing less” as a strategy to reduce unnecessary healthcare practices, and in turn, reduce cost, resource use, and ultimately reduce medical harm.
A few U.S. clinics are pioneers in transitioning to clean energy sources. In Wisconsin, the nonprofit Gundersen Health network became the first hospital to cut its reliance on petroleum by switching to locally produced green energy in 2015, and it saved $1.2 million per year in the process. Kaiser Permanente eliminated its 800,000 ton carbon footprint through energy efficiency and purchasing carbon offsets, reaching a balance between carbon emissions and removing carbon from the atmosphere in 2020, the first U.S. health system to do so.
Cleveland Clinic has pledged to join Kaiser in becoming carbon neutral by 2027. Realizing that 80 percent of its 2008 carbon emissions came from electricity consumption, the Clinic started switching to renewable energy and installing solar panels, and it has invested in researching recyclable products and packaging. The Clinic’s sustainability report outlines several strategies for producing less waste, such as reusing cases for sterilizing instruments, cutting back on materials that can’t be recycled, and putting pressure on vendors to reduce product packaging.
The Charité Berlin, Europe’s biggest university hospital, has also announced its goal to become carbon neutral. Its sustainability managers have begun to identify the biggest carbon culprits in its operations. “We’ve already reduced CO2 emissions by 21 percent since 2016,” says Simon Batt-Nauerz, the director of infrastructure and sustainability.
The hospital still emits 100,000 tons of CO2 every year, as much as a city with 10,000 residents, but it’s making progress through ride share and bicycle programs for its staff of 20,000 employees, who can get their bikes repaired for free in one of the Charité-operated bike workshops. Another program targets doctors’ and nurses’ scrubs, which cause more than 200 tons of CO2 during manufacturing and cleaning. The staff is currently testing lighter, more sustainable scrubs made from recycled cellulose that is grown regionally and requires 80 percent less land use and 30 percent less water.
The Charité hospital in Berlin still emits 100,000 tons of CO2 every year, but it’s making progress through ride share and bicycle programs for its staff of 20,000 employees.
Wiebke Peitz | Specific to Charité
Anesthesiologist Susanne Koch spearheads sustainability efforts in anesthesiology at the Charité. She says that up to a third of hospital waste comes from surgery rooms. To reduce medical waste, she recommends what she calls the 5 Rs: Reduce, Reuse, Recycle, Rethink, Research. “In medicine, people don’t question the use of plastic because of safety concerns,” she says. “Nobody wants to be sued because something is reused. However, it is possible to reduce plastic and other materials safely.”
For instance, she says, typical surgery kits are single-use and contain more supplies than are actually needed, and the entire kit is routinely thrown out after the surgery. “Up to 20 percent of materials in a surgery room aren’t used but will be discarded,” Koch says. One solution could be smaller kits, she explains, and another would be to recycle the plastic. Another example is breathing tubes. “When they became scarce during the pandemic, studies showed that they can be used seven days instead of 24 hours without increased bacteria load when we change the filters regularly,” Koch says, and wonders, “What else can we reuse?”
In the Netherlands, TU Delft researchers Tim Horeman and Bart van Straten designed a method to melt down the blue polypropylene wrapping paper that keeps medical instruments sterile, so that the material can be turned it into new medical devices. Currently, more than a million kilos of the blue paper are used in Dutch hospitals every year. A growing number of Dutch hospitals are adopting this approach.
Another common practice that’s ripe for improvement is the use of a certain plastic, called PVC, in hospital equipment such as blood bags, tubes and masks. Because of its toxic components, PVC is almost never recycled in the U.S., but University of Michigan researchers Danielle Fagnani and Anne McNeil have discovered a chemical process that can break it down into material that could be incorporated back into production. This could be a step toward a circular economy “that accounts for resource inputs and emissions throughout a product’s life cycle, including extraction of raw materials, manufacturing, transport, use and reuse, and disposal,” as medical experts have proposed. “It’s a failure of humanity to have created these amazing materials which have improved our lives in many ways, but at the same time to be so shortsighted that we didn’t think about what to do with the waste,” McNeil said in a press release.
Susanne Koch puts it more succinctly: “What’s the point if we save patients while killing the planet?”
The Friday Five: A surprising health benefit for people who have kids
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five:
- Kids stressing you out? They could be protecting your health.
- A new device unlocks the heart's secrets
- Super-ager gene transplants
- Surgeons could 3D print your organs before operations
- A skull cap looks into the brain like an fMRI