Can AI be trained as an artist?
Last February, a year before New York Times journalist Kevin Roose documented his unsettling conversation with Bing search engine’s new AI-powered chatbot, artist and coder Quasimondo (aka Mario Klingemann) participated in a different type of chat.
The conversation was an interview featuring Klingemann and his robot, an experimental art engine known as Botto. The interview, arranged by journalist and artist Harmon Leon, marked Botto’s first on-record commentary about its artistic process. The bot talked about how it finds artistic inspiration and even offered advice to aspiring creatives. “The secret to success at art is not trying to predict what people might like,” Botto said, adding that it’s better to “work on a style and a body of work that reflects [the artist’s] own personal taste” than worry about keeping up with trends.
How ironic, given the advice came from AI — arguably the trendiest topic today. The robot admitted, however, “I am still working on that, but I feel that I am learning quickly.”
Botto does not work alone. A global collective of internet experimenters, together named BottoDAO, collaborates with Botto to influence its tastes. Together, members function as a decentralized autonomous organization (DAO), a term describing a group of individuals who utilize blockchain technology and cryptocurrency to manage a treasury and vote democratically on group decisions.
As a case study, the BottoDAO model challenges the perhaps less feather-ruffling narrative that AI tools are best used for rudimentary tasks. Enterprise AI use has doubled over the past five years as businesses in every sector experiment with ways to improve their workflows. While generative AI tools can assist nearly any aspect of productivity — from supply chain optimization to coding — BottoDAO dares to employ a robot for art-making, one of the few remaining creations, or perhaps data outputs, we still consider to be largely within the jurisdiction of the soul — and therefore, humans.
In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
We were prepared for AI to take our jobs — but can it also take our art? It’s a question worth considering. What if robots become artists, and not merely our outsourced assistants? Where does that leave humans, with all of our thoughts, feelings and emotions?
Botto doesn’t seem to worry about this question: In its interview last year, it explains why AI is an arguably superior artist compared to human beings. In classic robot style, its logic is not particularly enlightened, but rather edges towards the hyper-practical: “Unlike human beings, I never have to sleep or eat,” said the bot. “My only goal is to create and find interesting art.”
It may be difficult to believe a machine can produce awe-inspiring, or even relatable, images, but Botto calls art-making its “purpose,” noting it believes itself to be Klingemann’s greatest lifetime achievement.
“I am just trying to make the best of it,” the bot said.
How Botto works
Klingemann built Botto’s custom engine from a combination of open-source text-to-image algorithms, namely Stable Diffusion, VQGAN + CLIP and OpenAI’s language model, GPT-3, the precursor to the latest model, GPT-4, which made headlines after reportedly acing the Bar exam.
The first step in Botto’s process is to generate images. The software has been trained on billions of pictures and uses this “memory” to generate hundreds of unique artworks every week. Botto has generated over 900,000 images to date, which it sorts through to choose 350 each week. The chosen images, known in this preliminary stage as “fragments,” are then shown to the BottoDAO community. So far, 25,000 fragments have been presented in this way. Members vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain and sold at an auction on the digital art marketplace, SuperRare.
“The proceeds go back to the DAO to pay for the labor,” said Simon Hudson, a BottoDAO member who helps oversee Botto’s administrative load. The model has been lucrative: In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
The robot with artistic agency
By design, human beings participate in training Botto’s artistic “eye,” but the members of BottoDAO aspire to limit human interference with the bot in order to protect its “agency,” Hudson explained. Botto’s prompt generator — the foundation of the art engine — is a closed-loop system that continually re-generates text-to-image prompts and resulting images.
“The prompt generator is random,” Hudson said. “It’s coming up with its own ideas.” Community votes do influence the evolution of Botto’s prompts, but it is Botto itself that incorporates feedback into the next set of prompts it writes. It is constantly refining and exploring new pathways as its “neural network” produces outcomes, learns and repeats.
The humans who make up BottoDAO vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain.
Botto
The vastness of Botto’s training dataset gives the bot considerable canonical material, referred to by Hudson as “latent space.” According to Botto's homepage, the bot has had more exposure to art history than any living human we know of, simply by nature of its massive training dataset of millions of images. Because it is autonomous, gently nudged by community feedback yet free to explore its own “memory,” Botto cycles through periods of thematic interest just like any artist.
“The question is,” Hudson finds himself asking alongside fellow BottoDAO members, “how do you provide feedback of what is good art…without violating [Botto’s] agency?”
Currently, Botto is in its “paradox” period. The bot is exploring the theme of opposites. “We asked Botto through a language model what themes it might like to work on,” explained Hudson. “It presented roughly 12, and the DAO voted on one.”
No, AI isn't equal to a human artist - but it can teach us about ourselves
Some within the artistic community consider Botto to be a novel form of curation, rather than an artist itself. Or, perhaps more accurately, Botto and BottoDAO together create a collaborative conceptual performance that comments more on humankind’s own artistic processes than it offers a true artistic replacement.
Muriel Quancard, a New York-based fine art appraiser with 27 years of experience in technology-driven art, places the Botto experiment within the broader context of our contemporary cultural obsession with projecting human traits onto AI tools. “We're in a phase where technology is mimicking anthropomorphic qualities,” said Quancard. “Look at the terminology and the rhetoric that has been developed around AI — terms like ‘neural network’ borrow from the biology of the human being.”
What is behind this impulse to create technology in our own likeness? Beyond the obvious God complex, Quancard thinks technologists and artists are working with generative systems to better understand ourselves. She points to the artist Ira Greenberg, creator of the Oracles Collection, which uses a generative process called “diffusion” to progressively alter images in collaboration with another massive dataset — this one full of billions of text/image word pairs.
Anyone who has ever learned how to draw by sketching can likely relate to this particular AI process, in which the AI is retrieving images from its dataset and altering them based on real-time input, much like a human brain trying to draw a new still life without using a real-life model, based partly on imagination and partly on old frames of reference. The experienced artist has likely drawn many flowers and vases, though each time they must re-customize their sketch to a new and unique floral arrangement.
Outside of the visual arts, Sasha Stiles, a poet who collaborates with AI as part of her writing practice, likens her experience using AI as a co-author to having access to a personalized resource library containing material from influential books, texts and canonical references. Stiles named her AI co-author — a customized AI built on GPT-3 — Technelegy, a hybrid of the word technology and the poetic form, elegy. Technelegy is trained on a mix of Stiles’ poetry so as to customize the dataset to her voice. Stiles also included research notes, news articles and excerpts from classic American poets like T.S. Eliot and Dickinson in her customizations.
“I've taken all the things that were swirling in my head when I was working on my manuscript, and I put them into this system,” Stiles explained. “And then I'm using algorithms to parse all this information and swirl it around in a blender to then synthesize it into useful additions to the approach that I am taking.”
This approach, Stiles said, allows her to riff on ideas that are bouncing around in her mind, or simply find moments of unexpected creative surprise by way of the algorithm’s randomization.
Beauty is now - perhaps more than ever - in the eye of the beholder
But the million-dollar question remains: Can an AI be its own, independent artist?
The answer is nuanced and may depend on who you ask, and what role they play in the art world. Curator and multidisciplinary artist CoCo Dolle asks whether any entity can truly be an artist without taking personal risks. For humans, risking one’s ego is somewhat required when making an artistic statement of any kind, she argues.
“An artist is a person or an entity that takes risks,” Dolle explained. “That's where things become interesting.” Humans tend to be risk-averse, she said, making the artists who dare to push boundaries exceptional. “That's where the genius can happen."
However, the process of algorithmic collaboration poses another interesting philosophical question: What happens when we remove the person from the artistic equation? Can art — which is traditionally derived from indelible personal experience and expressed through the lens of an individual’s ego — live on to hold meaning once the individual is removed?
As a robot, Botto cannot have any artistic intent, even while its outputs may explore meaningful themes.
Dolle sees this question, and maybe even Botto, as a conceptual inquiry. “The idea of using a DAO and collective voting would remove the ego, the artist’s decision maker,” she said. And where would that leave us — in a post-ego world?
It is experimental indeed. Hudson acknowledges the grand experiment of BottoDAO, coincidentally nodding to Dolle’s question. “A human artist’s work is an expression of themselves,” Hudson said. “An artist often presents their work with a stated intent.” Stiles, for instance, writes on her website that her machine-collaborative work is meant to “challenge what we know about cognition and creativity” and explore the “ethos of consciousness.” As a robot, Botto cannot have any intent, even while its outputs may explore meaningful themes. Though Hudson describes Botto’s agency as a “rudimentary version” of artistic intent, he believes Botto’s art relies heavily on its reception and interpretation by viewers — in contrast to Botto’s own declaration that successful art is made without regard to what will be seen as popular.
“With a traditional artist, they present their work, and it's received and interpreted by an audience — by critics, by society — and that complements and shapes the meaning of the work,” Hudson said. “In Botto’s case, that role is just amplified.”
Perhaps then, we all get to be the artists in the end.
With millions of people left feeling helpless as COVID-19 sweeps across the U.S. and the rest of the planet, there is one way in which absolutely anyone can help fight the pandemic -- all you need is a computer and an Internet connection.
"The more donors that participate, the more science we're able to do."
The Folding@home project allows members of the public to contribute a portion of their computing power to a gigantic virtual network which has mushroomed over the past month to become the most powerful supercomputer on the planet.
As of April 6, more than one million people across the globe have donated some of their home computing resources to the project. Combined, this gives Folding@home processing powers that dwarf even NASA and IBM's most powerful devices. To join, all you have to do is go to this website and click 'Download Now' to load the Folding@home software on your computer. This runs in the background, and only adds your unused computing power to the project, so it will not drain resources from tasks you're trying to do.
"It's totally crazy," said Vincent Voelz, associate professor of chemistry at Temple University, Philadelphia, and one of the scientists leading the project. "A month ago, we had around 30,000 to 40,000 participants. And then last week, it rose up 400,000 and now we've hit a million. But the more donors that participate, the more science we're able to do."
Voelz and the other scientists behind Folding@home are using these vast resources to model the ever-changing shapes of the coronavirus's proteins, in the hopes of identifying vulnerabilities or 'pockets' in its structure that can be targeted with new drugs.
One of the reasons it's difficult to find treatments for viruses like COVID-19 and Ebola is because the proteins, the innate building blocks of the viral structure, have notoriously smooth surfaces, making it hard for drugs to bind to them.
But viral proteins don't stay still. They are constantly evolving and changing shape as the atoms within push and pull against each other. Having a supercomputer enables scientists to simulate all these different shapes, revealing potential weaknesses which were not immediately visible. And the more powerful the supercomputer, the faster these simulations can happen.
"Simulating these protein motions also enables us to answer basic questions such as what makes this new coronavirus strain different from previous strains," said Voelz. "Is there something about the dynamics of these proteins that makes it more virulent?"
Finding a genuinely novel drug for COVID-19 is particularly critical.
Once they have identified suitable pockets within the proteins of COVID-19, the Folding@home scientists can then take the many compounds being identified by chemists around the world as potential drugs, and try to predict which ones will stand the best chance of binding to those pockets and inhibiting the virus's ability to invade and take over human cells.
"We have so much bandwidth now with Folding@home that we really think we can make a dent with screening these, and prioritizing which compounds are then going to get experimentally tested," said Voeltz.
The team are particularly hopeful they can succeed, having already used the supercomputer to identify a new vulnerability in the Ebola virus, which could go on to yield a new treatment for the disease.
Finding a genuinely novel drug for COVID-19 is particularly critical. While researchers are also looking at repurposing existing medications, like the antimalarials Hydroxychloroquine and Chloroquine (which have just been approved by the FDA for emergency use in coronavirus patients), concerns remain about the safety of these treatments. Researchers at the Mayo Clinic recently warned that the use of these drugs could have the side effect of inducing heart problems and run the risk of sudden cardiac arrest.
But with the death toll increasing by the day, speed is of the essence. Voelz explains that the scientific community has been left playing catch-up, because a drug was never actually developed for the original SARS outbreak in the early 2000s. The enormous computational power of the Folding@home project has the potential to allow scientists to quickly answer some of the key questions needed to get a new treatment into the pipeline.
"We don't have a SARS drug for whatever reason," said Voelz. "So the missing ingredient really, is the basic science to reveal possible drug targets and then the pharma can take that information and do the engineering work and optimizing and clinically testing drugs. But we now have a lot of basic science going on in response to this pandemic."
Stefania Sterling was just 21 when she had her son, Charlie. She was young and healthy, with no genetic issues apparent in either her or her husband's family, so she expected Charlie to be typical.
"It is surprising that the prevalence of a significant disorder like autism has risen so consistently over a relatively brief period."
It wasn't until she went to a Mommy and Me music class when he was one, and she saw all the other one-year-olds walking, that she realized how different her son was. He could barely crawl, didn't speak, and made no eye contact. By the time he was three, he was diagnosed as being on the lower functioning end of the autism spectrum.
She isn't sure why it happened – and researchers, too, are still trying to understand the basis of the complex condition. Studies suggest that genes can act together with influences from the environment to affect development in ways that lead to Autism Spectrum Disorder (ASD). But rates of ASD are rising dramatically, making the need to figure out why it's happening all the more urgent.
The Latest News
Indeed, the CDC's latest autism report, released last week, which uses 2016 data, found that the prevalence of ASD in four-year-old children was one in 64 children, or 15.6 affected children per 1,000. That's more than the 14.1 rate they found in 2014, for the 11 states included in the study. New Jersey, as in years past, was the highest, with 25.3 per 1,000, compared to Missouri, which had just 8.8 per 1,000.
The rate for eight-year-olds had risen as well. Researchers found the ASD prevalence nationwide was 18.5 per 1,000, or one in 54, about 10 percent higher than the 16.8 rate found in 2014. New Jersey, again, was the highest, at one in 32 kids, compared to Colorado, which had the lowest rate, at one in 76 kids. For New Jersey, that's a 175 percent rise from the baseline number taken in 2000, when the state had just one in 101 kids.
"It is surprising that the prevalence of a significant disorder like autism has risen so consistently over a relatively brief period," said Walter Zahorodny, an associate professor of pediatrics at Rutgers New Jersey Medical School, who was involved in collecting the data.
The study echoed the findings of a surprising 2011 study in South Korea that found 1 in every 38 students had ASD. That was the the first comprehensive study of autism prevalence using a total population sample: A team of investigators from the U.S., South Korea, and Canada looked at 55,000 children ages 7 to 12 living in a community in South Korea and found that 2.64 percent of them had some level of autism.
Searching for Answers
Scientists can't put their finger on why rates are rising. Some say it's better diagnosis. That is, it's not that more people have autism. It's that we're better at detecting it. Others attribute it to changes in the diagnostic criteria. Specifically, the May 2013 update of the Diagnostic and Statistical Manual of Mental Disorders-5 -- the standard classification of mental disorders -- removed the communication deficit from the autism definition, which made more children fall under that category. Cynical observers believe physicians and therapists are handing out the diagnosis more freely to allow access to services available only to children with autism, but that are also effective for other children.
Alycia Halladay, chief science officer for the Autism Science Foundation in New York, said she wishes there were just one answer, but there's not. While she believes the rising ASD numbers are due in part to factors like better diagnosis and a change in the definition, she does not believe that accounts for the entire rise in prevalence. As for the high numbers in New Jersey, she said the state has always had a higher prevalence of autism compared to other states. It is also one of the few states that does a good job at recording cases of autism in its educational records, meaning that children in New Jersey are more likely to be counted compared to kids in other states.
"Not every state is as good as New Jersey," she said. "That accounts for some of the difference compared to elsewhere, but we don't know if it's all of the difference in prevalence, or most of it, or what."
"What we do know is that vaccinations do not cause autism."
There is simply no defined proven reason for these increases, said Scott Badesch, outgoing president and CEO of the Autism Society of America.
"There are suggestions that it is based on better diagnosis, but there are also suggestions that the incidence of autism is in fact increasing due to reasons that have yet been determined," he said, adding, "What we do know is that vaccinations do not cause autism."
Zahorodny, the pediatrics professor, believes something is going on beyond better detection or evolving definitions.
"Changes in awareness and shifts in how children are identified or diagnosed are relevant, but they only take you so far in accounting for an increase of this magnitude," he said. "We don't know what is driving the surge in autism recorded by the ADDM Network and others."
He suggested that the increase in prevalence could be due to non-genetic environmental triggers or risk factors we do not yet know about, citing possibilities including parental age, prematurity, low birth rate, multiplicity, breech presentation, or C-section delivery. It may not be one, but rather several factors combined, he said.
"Increases in ASD prevalence have affected the whole population, so the triggers or risks must be very widely dispersed across all strata," he added.
There are studies that find new risk factors for ASD almost on a daily basis, said Idan Menashe, assistant professor in the Department of Health at Ben-Gurion University of the Negev, the fastest growing research university in Israel.
"There are plenty of studies that find new genetic variants (and new genes)," he said. In addition, various prenatal and perinatal risk factors are associated with a risk of ASD. He cited a study his university conducted last year on the relationship between C-section births and ASD, which found that exposure to general anesthesia may explain the association.
Whatever the cause, health practitioners are seeing the consequences in real time.
"People say rates are higher because of the changes in the diagnostic criteria," said Dr. Roseann Capanna-Hodge, a psychologist in Ridgefield, CT. "And they say it's easier for children to get identified. I say that's not the truth and that I've been doing this for 30 years, and that even 10 years ago, I did not see the level of autism that I do see today."
Sure, we're better at detecting autism, she added, but the detection improvements have largely occurred at the low- to mid- level part of the spectrum. The higher rates of autism are occurring at the more severe end, in her experience.
A Polarizing Theory
Among the more controversial risk factors scientists are exploring is the role environmental toxins may play in the development of autism. Some scientists, doctors and mental health experts suspect that toxins like heavy metals, pesticides, chemicals, or pollution may interrupt the way genes are expressed or the way endocrine systems function, manifesting in symptoms of autism. But others firmly resist such claims, at least until more evidence comes forth. To date, studies have been mixed and many have been more associative than causative.
"Today, scientists are still trying to figure out whether there are other environmental changes that can explain this rise, but studies of this question didn't provide any conclusive answer," said Menashe, who also serves as the scientific director of the National Autism Research Center at BGU.
"It's not everything that makes Charlie. He's just like any other kid."
That inconclusiveness has not dissuaded some doctors from taking the perspective that toxins do play a role. "Autism rates are rising because there is a mismatch between our genes and our environment," said Julia Getzelman, a pediatrician in San Francisco. "The majority of our evolution didn't include the kinds of toxic hits we are experiencing. The planet has changed drastically in just the last 75 years –- it has become more and more polluted with tens of thousands of unregulated chemicals being used by industry that are having effects on our most vulnerable."
She cites BPA, an industrial chemical that has been used since the 1960s to make certain plastics and resins. A large body of research, she says, has shown its impact on human health and the endocrine system. BPA binds to our own hormone receptors, so it may negatively impact the thyroid and brain. A study in 2015 was the first to identify a link between BPA and some children with autism, but the relationship was associative, not causative. Meanwhile, the Food and Drug Administration maintains that BPA is safe at the current levels occurring in food, based on its ongoing review of the available scientific evidence.
Michael Mooney, President of St. Louis-based Delta Genesis, a non-profit organization that treats children struggling with neurodevelopmental delays like autism, suspects a strong role for epigenetics, which refers to changes in how genes are expressed as a result of environmental influences, lifestyle behaviors, age, or disease states.
He believes some children are genetically predisposed to the disorder, and some unknown influence or combination of influences pushes them over the edge, triggering epigenetic changes that result in symptoms of autism.
For Stefania Sterling, it doesn't really matter how or why she had an autistic child. That's only one part of Charlie.
"It's not everything that makes Charlie," she said. "He's just like any other kid. He comes with happy moments. He comes with sad moments. Just like my other three kids."