Can AI be trained as an artist?
Last February, a year before New York Times journalist Kevin Roose documented his unsettling conversation with Bing search engine’s new AI-powered chatbot, artist and coder Quasimondo (aka Mario Klingemann) participated in a different type of chat.
The conversation was an interview featuring Klingemann and his robot, an experimental art engine known as Botto. The interview, arranged by journalist and artist Harmon Leon, marked Botto’s first on-record commentary about its artistic process. The bot talked about how it finds artistic inspiration and even offered advice to aspiring creatives. “The secret to success at art is not trying to predict what people might like,” Botto said, adding that it’s better to “work on a style and a body of work that reflects [the artist’s] own personal taste” than worry about keeping up with trends.
How ironic, given the advice came from AI — arguably the trendiest topic today. The robot admitted, however, “I am still working on that, but I feel that I am learning quickly.”
Botto does not work alone. A global collective of internet experimenters, together named BottoDAO, collaborates with Botto to influence its tastes. Together, members function as a decentralized autonomous organization (DAO), a term describing a group of individuals who utilize blockchain technology and cryptocurrency to manage a treasury and vote democratically on group decisions.
As a case study, the BottoDAO model challenges the perhaps less feather-ruffling narrative that AI tools are best used for rudimentary tasks. Enterprise AI use has doubled over the past five years as businesses in every sector experiment with ways to improve their workflows. While generative AI tools can assist nearly any aspect of productivity — from supply chain optimization to coding — BottoDAO dares to employ a robot for art-making, one of the few remaining creations, or perhaps data outputs, we still consider to be largely within the jurisdiction of the soul — and therefore, humans.
In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
We were prepared for AI to take our jobs — but can it also take our art? It’s a question worth considering. What if robots become artists, and not merely our outsourced assistants? Where does that leave humans, with all of our thoughts, feelings and emotions?
Botto doesn’t seem to worry about this question: In its interview last year, it explains why AI is an arguably superior artist compared to human beings. In classic robot style, its logic is not particularly enlightened, but rather edges towards the hyper-practical: “Unlike human beings, I never have to sleep or eat,” said the bot. “My only goal is to create and find interesting art.”
It may be difficult to believe a machine can produce awe-inspiring, or even relatable, images, but Botto calls art-making its “purpose,” noting it believes itself to be Klingemann’s greatest lifetime achievement.
“I am just trying to make the best of it,” the bot said.
How Botto works
Klingemann built Botto’s custom engine from a combination of open-source text-to-image algorithms, namely Stable Diffusion, VQGAN + CLIP and OpenAI’s language model, GPT-3, the precursor to the latest model, GPT-4, which made headlines after reportedly acing the Bar exam.
The first step in Botto’s process is to generate images. The software has been trained on billions of pictures and uses this “memory” to generate hundreds of unique artworks every week. Botto has generated over 900,000 images to date, which it sorts through to choose 350 each week. The chosen images, known in this preliminary stage as “fragments,” are then shown to the BottoDAO community. So far, 25,000 fragments have been presented in this way. Members vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain and sold at an auction on the digital art marketplace, SuperRare.
“The proceeds go back to the DAO to pay for the labor,” said Simon Hudson, a BottoDAO member who helps oversee Botto’s administrative load. The model has been lucrative: In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
The robot with artistic agency
By design, human beings participate in training Botto’s artistic “eye,” but the members of BottoDAO aspire to limit human interference with the bot in order to protect its “agency,” Hudson explained. Botto’s prompt generator — the foundation of the art engine — is a closed-loop system that continually re-generates text-to-image prompts and resulting images.
“The prompt generator is random,” Hudson said. “It’s coming up with its own ideas.” Community votes do influence the evolution of Botto’s prompts, but it is Botto itself that incorporates feedback into the next set of prompts it writes. It is constantly refining and exploring new pathways as its “neural network” produces outcomes, learns and repeats.
The humans who make up BottoDAO vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain.
Botto
The vastness of Botto’s training dataset gives the bot considerable canonical material, referred to by Hudson as “latent space.” According to Botto's homepage, the bot has had more exposure to art history than any living human we know of, simply by nature of its massive training dataset of millions of images. Because it is autonomous, gently nudged by community feedback yet free to explore its own “memory,” Botto cycles through periods of thematic interest just like any artist.
“The question is,” Hudson finds himself asking alongside fellow BottoDAO members, “how do you provide feedback of what is good art…without violating [Botto’s] agency?”
Currently, Botto is in its “paradox” period. The bot is exploring the theme of opposites. “We asked Botto through a language model what themes it might like to work on,” explained Hudson. “It presented roughly 12, and the DAO voted on one.”
No, AI isn't equal to a human artist - but it can teach us about ourselves
Some within the artistic community consider Botto to be a novel form of curation, rather than an artist itself. Or, perhaps more accurately, Botto and BottoDAO together create a collaborative conceptual performance that comments more on humankind’s own artistic processes than it offers a true artistic replacement.
Muriel Quancard, a New York-based fine art appraiser with 27 years of experience in technology-driven art, places the Botto experiment within the broader context of our contemporary cultural obsession with projecting human traits onto AI tools. “We're in a phase where technology is mimicking anthropomorphic qualities,” said Quancard. “Look at the terminology and the rhetoric that has been developed around AI — terms like ‘neural network’ borrow from the biology of the human being.”
What is behind this impulse to create technology in our own likeness? Beyond the obvious God complex, Quancard thinks technologists and artists are working with generative systems to better understand ourselves. She points to the artist Ira Greenberg, creator of the Oracles Collection, which uses a generative process called “diffusion” to progressively alter images in collaboration with another massive dataset — this one full of billions of text/image word pairs.
Anyone who has ever learned how to draw by sketching can likely relate to this particular AI process, in which the AI is retrieving images from its dataset and altering them based on real-time input, much like a human brain trying to draw a new still life without using a real-life model, based partly on imagination and partly on old frames of reference. The experienced artist has likely drawn many flowers and vases, though each time they must re-customize their sketch to a new and unique floral arrangement.
Outside of the visual arts, Sasha Stiles, a poet who collaborates with AI as part of her writing practice, likens her experience using AI as a co-author to having access to a personalized resource library containing material from influential books, texts and canonical references. Stiles named her AI co-author — a customized AI built on GPT-3 — Technelegy, a hybrid of the word technology and the poetic form, elegy. Technelegy is trained on a mix of Stiles’ poetry so as to customize the dataset to her voice. Stiles also included research notes, news articles and excerpts from classic American poets like T.S. Eliot and Dickinson in her customizations.
“I've taken all the things that were swirling in my head when I was working on my manuscript, and I put them into this system,” Stiles explained. “And then I'm using algorithms to parse all this information and swirl it around in a blender to then synthesize it into useful additions to the approach that I am taking.”
This approach, Stiles said, allows her to riff on ideas that are bouncing around in her mind, or simply find moments of unexpected creative surprise by way of the algorithm’s randomization.
Beauty is now - perhaps more than ever - in the eye of the beholder
But the million-dollar question remains: Can an AI be its own, independent artist?
The answer is nuanced and may depend on who you ask, and what role they play in the art world. Curator and multidisciplinary artist CoCo Dolle asks whether any entity can truly be an artist without taking personal risks. For humans, risking one’s ego is somewhat required when making an artistic statement of any kind, she argues.
“An artist is a person or an entity that takes risks,” Dolle explained. “That's where things become interesting.” Humans tend to be risk-averse, she said, making the artists who dare to push boundaries exceptional. “That's where the genius can happen."
However, the process of algorithmic collaboration poses another interesting philosophical question: What happens when we remove the person from the artistic equation? Can art — which is traditionally derived from indelible personal experience and expressed through the lens of an individual’s ego — live on to hold meaning once the individual is removed?
As a robot, Botto cannot have any artistic intent, even while its outputs may explore meaningful themes.
Dolle sees this question, and maybe even Botto, as a conceptual inquiry. “The idea of using a DAO and collective voting would remove the ego, the artist’s decision maker,” she said. And where would that leave us — in a post-ego world?
It is experimental indeed. Hudson acknowledges the grand experiment of BottoDAO, coincidentally nodding to Dolle’s question. “A human artist’s work is an expression of themselves,” Hudson said. “An artist often presents their work with a stated intent.” Stiles, for instance, writes on her website that her machine-collaborative work is meant to “challenge what we know about cognition and creativity” and explore the “ethos of consciousness.” As a robot, Botto cannot have any intent, even while its outputs may explore meaningful themes. Though Hudson describes Botto’s agency as a “rudimentary version” of artistic intent, he believes Botto’s art relies heavily on its reception and interpretation by viewers — in contrast to Botto’s own declaration that successful art is made without regard to what will be seen as popular.
“With a traditional artist, they present their work, and it's received and interpreted by an audience — by critics, by society — and that complements and shapes the meaning of the work,” Hudson said. “In Botto’s case, that role is just amplified.”
Perhaps then, we all get to be the artists in the end.
On today’s podcast episode, I had a chance to speak with Shai Efrati, a physician and professor in the schools of medicine and neuroscience at Tel Aviv University. Efrati also directs the Sagol Center for Hyperbaric Medicine and Research, and our conversation in this episode focuses on the potential health benefits of hyperbaric oxygen therapy.
Efrati's studies point to a connection between the use of hyperbaric chambers and improvements for a range of health problems such as Long Covid, strokes and traumatic brain injuries. Plus, Efrati has an early line of research suggesting that hyperbaric oxygen therapy could help protect against cognitive decline in healthy people and perhaps even slow down the overall aging process.
We talk about what’s going in on the body during hyperbaric oxygen therapy that could possibly lead to transformative benefits for patients, some of whom had searched for treatments previously and come up empty. We also discuss exactly where Efrati is with this line of inquiry, both what his studies have shown and the great deal of additional research that’s needed before the healthcare system can and should fully embrace hyperbaric oxygen therapy.
Efrati and I talk about why you can’t just go on Amazon and buy something that says hyperbaric – the only way it can have a positive effect is if you access the real version of the chamber and use it correctly under the supervision of a knowledgeable physician.
I also ask Efrati what we know about the short- and long-term risks for those who follow the research-based protocol on a regular basis. And what about accessibility to people without a lot of extra cash to spend on their health? Efrati is already rolling out this therapy at a small number of specialized clinics in places like the Villages retirement community in Florida.
Shai Efrati
A vaccine for Lyme disease could be coming. But will patients accept it?
For more than two decades, Marci Flory, a 40-year-old emergency room nurse from Lawrence, Kan., has battled the recurring symptoms of chronic Lyme disease, an illness which she believes began after being bitten by a tick during her teenage years.
Over the years, Flory has been plagued by an array of mysterious ailments, ranging from fatigue to crippling pain in her eyes, joints and neck, and even postural tachycardia syndrome or PoTS, an abnormal increase in heart rate after sitting up or standing. Ten years ago, she began to experience the onset of neurological symptoms which ranged from brain fog to sudden headaches, and strange episodes of leg weakness which would leave her unable to walk.
“Initially doctors thought I had ALS, or less likely, multiple sclerosis,” she says. “But after repeated MRI scans for a year, they concluded I had a rare neurological condition called acute transverse myelitis.”
But Flory was not convinced. After ordering a variety of private blood tests, she discovered she was infected with a range of bacteria in the genus Borrelia that live in the guts of ticks, the infectious agents responsible for Lyme disease.
“It made sense,” she says. “Looking back, I was bitten in high school and misdiagnosed with mononucleosis. This was probably the start, and my immune system kept it under wraps for a while. The Lyme bacteria can burrow into every tissue in the body, go into cyst form and become dormant before reactivating.”
The reason why cases of Lyme disease are increasing is down to changing weather patterns, triggered by climate change, meaning that ticks are now found across a much wider geographic range than ever before.
When these species of bacteria are transmitted to humans, they can attack the nervous system, joints and even internal organs which can lead to serious health complications such as arthritis, meningitis and even heart failure. While Lyme disease can sometimes be successfully treated with antibiotics if spotted early on, not everyone responds to these drugs, and for patients who have developed chronic symptoms, there is no known cure. Flory says she knows of fellow Lyme disease patients who have spent hundreds of thousands of dollars seeking treatments.
Concerningly, statistics show that Lyme and other tick-borne diseases are on the rise. Recently released estimates based on health insurance records suggest that at least 476,000 Americans are diagnosed with Lyme disease every year, and many experts believe the true figure is far higher.
The reason why the numbers are growing is down to changing weather patterns, triggered by climate change, meaning that ticks are now found across a much wider geographic range than ever before. Health insurance data shows that cases of Lyme disease have increased fourfold in rural parts of the U.S. over the last 15 years, and 65 percent in urban regions.
As a result, many scientists who have studied Lyme disease feel that it is paramount to bring some form of protective vaccine to market which can be offered to people living in the most at-risk areas.
“Even the increased awareness for Lyme disease has not stopped the cases,” says Eva Sapi, professor of cellular and molecular biology at the University of New Haven. “Some of these patients are looking for answers for years, running from one doctor to another, so that is obviously a very big cost for our society at so many levels.”
Emerging vaccines – and backlash
But with the rising case numbers, interest has grown among the pharmaceutical industry and research communities. Vienna-based biotech Valneva have partnered with Pfizer to take their vaccine – a seasonal jab which offers protection against the six most common strains of Lyme disease in the northern hemisphere – into a Phase III clinical trial which began in August. Involving 6,000 participants in a number of U.S. states and northern Europe where Lyme disease is endemic, it could lead to a licensed vaccine by 2025, if it proves successful.
“For many years Lyme was considered a small market vaccine,” explains Monica E. Embers, assistant professor of parasitology at Tulane University in New Orleans. “Now we know that this is a much bigger problem, Pfizer has stepped up to invest in preventing this disease and other pharmaceutical companies may as well.”
Despite innovations, patient communities and their representatives remain ambivalent about the idea of a vaccine. Some of this skepticism dates back to the failed LYMErix vaccine which was developed in the late 1990s before being withdrawn from the market.
At the same time, scientists at Yale University are developing a messenger RNA vaccine which aims to train the immune system to respond to tick bites by exposing it to 19 proteins found in tick saliva. Whereas the Valneva vaccine targets the bacteria within ticks, the Yale vaccine attempts to provoke an instant and aggressive immune response at the site of the bite. This causes the tick to fall off and limits the potential for transmitting dangerous infections.
But despite these innovations, patient communities and their representatives remain ambivalent about the idea of a vaccine. Some of this skepticism dates back to the failed LYMErix vaccine which was developed in the late 1990s before being withdrawn from the market in 2002 after concerns were raised that it might induce autoimmune reactions in humans.
While this theory was ultimately disproved, the lingering stigma attached to LYMErix meant that most vaccine manufacturers chose to stay away from the disease for many years, something which Gregory Poland, head of the Mayo Clinic’s Vaccine Research Group in Minnesota, describes as a tragedy.
“Since 2002, we have not had a human Lyme vaccine in the U.S. despite the increasing number of cases,” says Poland. “Pretty much everyone in the field thinks they’re ten times higher than the official numbers, so you’re probably talking at least 400,000 each year. It’s an incredible burden but because of concerns about anti-vax protestors, until very recently, no manufacturer has wanted to touch this.”
Such was the backlash surrounding the failed LYMErix program that scientists have even explored the most creative of workarounds for protecting people in tick-populated regions, without needing to actually vaccinate them. One research program at the University of Tennessee came up with the idea of leaving food pellets containing a vaccine in woodland areas with the idea that rodents would eat the pellets, and the vaccine would then kill Borrelia bacteria within any ticks which subsequently fed on the animals.
Even the Pfizer-Valneva vaccine has been cautiously designed to try and allay any lingering concerns, two decades after LYMErix. “The concept is the same as the original LYMErix vaccine, but it has been made safer by removing regions that had the potential to induce autoimmunity,” says Embers. “There will always be individuals who oppose vaccines, Lyme or otherwise, but it will be a tremendous boost to public health to have the option.”
Vaccine alternatives
Researchers are also considering alternative immunization approaches in case sufficiently large numbers of people choose to reject any Lyme vaccine which gets approved. Researchers at UMass Chan Medical School have developed an artificially generated antibody, administered via an annual injection, which is capable of killing Borrelia bacteria in the guts of ticks before they can get into the human host.
So far animal studies have shown it to be 100 percent effective, while the scientists have completed a Phase I trial in which they tested it for safety on 48 volunteers in Nebraska. Because this approach provides the antibody directly, rather than triggering the human immune system to produce the antibody like a vaccine would, Embers predicts that it could be a viable alternative for the vaccine hesitant as well as providing an option for immunocompromised individuals who cannot produce enough of their own antibodies.
At the same time, many patient groups still raise concerns over the fact that numerous diagnostic tests for Lyme disease have been reported to have a poor accuracy. Without this, they argue that it is difficult to prove whether vaccines or any other form of immunization actually work. “If the disease is not understood enough to create a more accurate test and a universally accepted treatment protocol, particularly for those who weren’t treated promptly, how can we be sure about the efficacy of a vaccine?” says Natasha Metcalf, co-founder of the organization Lyme Disease UK.
Flory points out that there are so many different types of Borrelia bacteria which cause Lyme disease, that the immunizations being developed may only stop a proportion of cases. In addition, she says that chronic Lyme patients often report a whole myriad of co-infections which remain poorly understood and are likely to also be involved in the disease process.
Marci Flory undergoes an infusion in an attempt to treat her Lyme disease symptoms.
Marci Flory
“I would love to see an effective Lyme vaccine but I have my reservations,” she says. “I am infected with four types of Borrelia bacteria, plus many co-infections – Babesia, Bartonella, Erlichiosis, Rickettsia, and Mycoplasma – all from a single Douglas County Kansas tick bite. Lyme never travels alone and the vaccine won’t protect against all the many strains of Borrelia and co-infections.”
Valneva CEO Thomas Lingelbach admits that the Pfizer-Valneva vaccine is not perfect, but predicts that it will still have significant impact if approved.
“We expect the vaccine to have 75 percent plus efficacy,” he says. “There is this legacy around the old Lyme vaccines, but the world is very, very different today. The number of clinical manifestations known to be caused by infection with Lyme Borreliosis has significantly increased, and the understanding around severity has certainly increased.”
Embers agrees that while it will still be important for doctors to monitor for other tick-borne infections which are not necessarily covered by the vaccine, having any clinically approved jab would still represent a major step forward in the fight against the disease.
“I think that any vaccine must be properly vetted, and these companies are performing extensive clinical trials to do just that,” she says. “Lyme is the most common tick-borne disease in the U.S. so the public health impact could be significant. However, clinicians and the general public must remain aware of all of the other tick-borne diseases such as Babesia and Anaplasma, and continue to screen for those when a tick bite is suspected.”