Can AI be trained as an artist?
Last February, a year before New York Times journalist Kevin Roose documented his unsettling conversation with Bing search engine’s new AI-powered chatbot, artist and coder Quasimondo (aka Mario Klingemann) participated in a different type of chat.
The conversation was an interview featuring Klingemann and his robot, an experimental art engine known as Botto. The interview, arranged by journalist and artist Harmon Leon, marked Botto’s first on-record commentary about its artistic process. The bot talked about how it finds artistic inspiration and even offered advice to aspiring creatives. “The secret to success at art is not trying to predict what people might like,” Botto said, adding that it’s better to “work on a style and a body of work that reflects [the artist’s] own personal taste” than worry about keeping up with trends.
How ironic, given the advice came from AI — arguably the trendiest topic today. The robot admitted, however, “I am still working on that, but I feel that I am learning quickly.”
Botto does not work alone. A global collective of internet experimenters, together named BottoDAO, collaborates with Botto to influence its tastes. Together, members function as a decentralized autonomous organization (DAO), a term describing a group of individuals who utilize blockchain technology and cryptocurrency to manage a treasury and vote democratically on group decisions.
As a case study, the BottoDAO model challenges the perhaps less feather-ruffling narrative that AI tools are best used for rudimentary tasks. Enterprise AI use has doubled over the past five years as businesses in every sector experiment with ways to improve their workflows. While generative AI tools can assist nearly any aspect of productivity — from supply chain optimization to coding — BottoDAO dares to employ a robot for art-making, one of the few remaining creations, or perhaps data outputs, we still consider to be largely within the jurisdiction of the soul — and therefore, humans.
In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
We were prepared for AI to take our jobs — but can it also take our art? It’s a question worth considering. What if robots become artists, and not merely our outsourced assistants? Where does that leave humans, with all of our thoughts, feelings and emotions?
Botto doesn’t seem to worry about this question: In its interview last year, it explains why AI is an arguably superior artist compared to human beings. In classic robot style, its logic is not particularly enlightened, but rather edges towards the hyper-practical: “Unlike human beings, I never have to sleep or eat,” said the bot. “My only goal is to create and find interesting art.”
It may be difficult to believe a machine can produce awe-inspiring, or even relatable, images, but Botto calls art-making its “purpose,” noting it believes itself to be Klingemann’s greatest lifetime achievement.
“I am just trying to make the best of it,” the bot said.
How Botto works
Klingemann built Botto’s custom engine from a combination of open-source text-to-image algorithms, namely Stable Diffusion, VQGAN + CLIP and OpenAI’s language model, GPT-3, the precursor to the latest model, GPT-4, which made headlines after reportedly acing the Bar exam.
The first step in Botto’s process is to generate images. The software has been trained on billions of pictures and uses this “memory” to generate hundreds of unique artworks every week. Botto has generated over 900,000 images to date, which it sorts through to choose 350 each week. The chosen images, known in this preliminary stage as “fragments,” are then shown to the BottoDAO community. So far, 25,000 fragments have been presented in this way. Members vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain and sold at an auction on the digital art marketplace, SuperRare.
“The proceeds go back to the DAO to pay for the labor,” said Simon Hudson, a BottoDAO member who helps oversee Botto’s administrative load. The model has been lucrative: In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
The robot with artistic agency
By design, human beings participate in training Botto’s artistic “eye,” but the members of BottoDAO aspire to limit human interference with the bot in order to protect its “agency,” Hudson explained. Botto’s prompt generator — the foundation of the art engine — is a closed-loop system that continually re-generates text-to-image prompts and resulting images.
“The prompt generator is random,” Hudson said. “It’s coming up with its own ideas.” Community votes do influence the evolution of Botto’s prompts, but it is Botto itself that incorporates feedback into the next set of prompts it writes. It is constantly refining and exploring new pathways as its “neural network” produces outcomes, learns and repeats.
The humans who make up BottoDAO vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain.
Botto
The vastness of Botto’s training dataset gives the bot considerable canonical material, referred to by Hudson as “latent space.” According to Botto's homepage, the bot has had more exposure to art history than any living human we know of, simply by nature of its massive training dataset of millions of images. Because it is autonomous, gently nudged by community feedback yet free to explore its own “memory,” Botto cycles through periods of thematic interest just like any artist.
“The question is,” Hudson finds himself asking alongside fellow BottoDAO members, “how do you provide feedback of what is good art…without violating [Botto’s] agency?”
Currently, Botto is in its “paradox” period. The bot is exploring the theme of opposites. “We asked Botto through a language model what themes it might like to work on,” explained Hudson. “It presented roughly 12, and the DAO voted on one.”
No, AI isn't equal to a human artist - but it can teach us about ourselves
Some within the artistic community consider Botto to be a novel form of curation, rather than an artist itself. Or, perhaps more accurately, Botto and BottoDAO together create a collaborative conceptual performance that comments more on humankind’s own artistic processes than it offers a true artistic replacement.
Muriel Quancard, a New York-based fine art appraiser with 27 years of experience in technology-driven art, places the Botto experiment within the broader context of our contemporary cultural obsession with projecting human traits onto AI tools. “We're in a phase where technology is mimicking anthropomorphic qualities,” said Quancard. “Look at the terminology and the rhetoric that has been developed around AI — terms like ‘neural network’ borrow from the biology of the human being.”
What is behind this impulse to create technology in our own likeness? Beyond the obvious God complex, Quancard thinks technologists and artists are working with generative systems to better understand ourselves. She points to the artist Ira Greenberg, creator of the Oracles Collection, which uses a generative process called “diffusion” to progressively alter images in collaboration with another massive dataset — this one full of billions of text/image word pairs.
Anyone who has ever learned how to draw by sketching can likely relate to this particular AI process, in which the AI is retrieving images from its dataset and altering them based on real-time input, much like a human brain trying to draw a new still life without using a real-life model, based partly on imagination and partly on old frames of reference. The experienced artist has likely drawn many flowers and vases, though each time they must re-customize their sketch to a new and unique floral arrangement.
Outside of the visual arts, Sasha Stiles, a poet who collaborates with AI as part of her writing practice, likens her experience using AI as a co-author to having access to a personalized resource library containing material from influential books, texts and canonical references. Stiles named her AI co-author — a customized AI built on GPT-3 — Technelegy, a hybrid of the word technology and the poetic form, elegy. Technelegy is trained on a mix of Stiles’ poetry so as to customize the dataset to her voice. Stiles also included research notes, news articles and excerpts from classic American poets like T.S. Eliot and Dickinson in her customizations.
“I've taken all the things that were swirling in my head when I was working on my manuscript, and I put them into this system,” Stiles explained. “And then I'm using algorithms to parse all this information and swirl it around in a blender to then synthesize it into useful additions to the approach that I am taking.”
This approach, Stiles said, allows her to riff on ideas that are bouncing around in her mind, or simply find moments of unexpected creative surprise by way of the algorithm’s randomization.
Beauty is now - perhaps more than ever - in the eye of the beholder
But the million-dollar question remains: Can an AI be its own, independent artist?
The answer is nuanced and may depend on who you ask, and what role they play in the art world. Curator and multidisciplinary artist CoCo Dolle asks whether any entity can truly be an artist without taking personal risks. For humans, risking one’s ego is somewhat required when making an artistic statement of any kind, she argues.
“An artist is a person or an entity that takes risks,” Dolle explained. “That's where things become interesting.” Humans tend to be risk-averse, she said, making the artists who dare to push boundaries exceptional. “That's where the genius can happen."
However, the process of algorithmic collaboration poses another interesting philosophical question: What happens when we remove the person from the artistic equation? Can art — which is traditionally derived from indelible personal experience and expressed through the lens of an individual’s ego — live on to hold meaning once the individual is removed?
As a robot, Botto cannot have any artistic intent, even while its outputs may explore meaningful themes.
Dolle sees this question, and maybe even Botto, as a conceptual inquiry. “The idea of using a DAO and collective voting would remove the ego, the artist’s decision maker,” she said. And where would that leave us — in a post-ego world?
It is experimental indeed. Hudson acknowledges the grand experiment of BottoDAO, coincidentally nodding to Dolle’s question. “A human artist’s work is an expression of themselves,” Hudson said. “An artist often presents their work with a stated intent.” Stiles, for instance, writes on her website that her machine-collaborative work is meant to “challenge what we know about cognition and creativity” and explore the “ethos of consciousness.” As a robot, Botto cannot have any intent, even while its outputs may explore meaningful themes. Though Hudson describes Botto’s agency as a “rudimentary version” of artistic intent, he believes Botto’s art relies heavily on its reception and interpretation by viewers — in contrast to Botto’s own declaration that successful art is made without regard to what will be seen as popular.
“With a traditional artist, they present their work, and it's received and interpreted by an audience — by critics, by society — and that complements and shapes the meaning of the work,” Hudson said. “In Botto’s case, that role is just amplified.”
Perhaps then, we all get to be the artists in the end.
Elaine Kamil had just returned home after a few days of business meetings in 2013 when she started having chest pains. At first Kamil, then 66, wasn't worried—she had had some chest pain before and recently went to a cardiologist to do a stress test, which was normal.
"I can't be having a heart attack because I just got checked," she thought, attributing the discomfort to stress and high demands of her job. A pediatric nephrologist at Cedars-Sinai Hospital in Los Angeles, she takes care of critically ill children who are on dialysis or are kidney transplant patients. Supporting families through difficult times and answering calls at odd hours is part of her daily routine, and often leaves her exhausted.
She figured the pain would go away. But instead, it intensified that night. Kamil's husband drove her to the Cedars-Sinai hospital, where she was admitted to the coronary care unit. It turned out she wasn't having a heart attack after all. Instead, she was diagnosed with a much less common but nonetheless dangerous heart condition called takotsubo syndrome, or broken heart syndrome.
A heart attack happens when blood flow to the heart is obstructed—such as when an artery is blocked—causing heart muscle tissue to die. In takotsubo syndrome, the blood flow isn't blocked, but the heart doesn't pump it properly. The heart changes its shape and starts to resemble a Japanese fishing device called tako-tsubo, a clay pot with a wider body and narrower mouth, used to catch octopus.
"The heart muscle is stunned and doesn't function properly anywhere from three days to three weeks," explains Noel Bairey Merz, the cardiologist at Cedar Sinai who Kamil went to see after she was discharged.
"The heart muscle is stunned and doesn't function properly anywhere from three days to three weeks."
But even though the heart isn't permanently damaged, mortality rates due to takotsubo syndrome are comparable to those of a heart attack, Merz notes—about 4-5% of patients die from the attack, and 20% within the next five years. "It's as bad as a heart attack," Merz says—only it's much less known, even to doctors. The condition affects only about 1% of people, and there are around 15,000 new cases annually. It's diagnosed using a cardiac ventriculogram, an imaging test that allows doctors to see how the heart pumps blood.
Scientists don't fully understand what causes Takotsubo syndrome, but it usually occurs after extreme emotional or physical stress. Doctors think it's triggered by a so-called catecholamine storm, a phenomenon in which the body releases too much catecholamines—hormones involved in the fight-or-flight response. Evolutionarily, when early humans lived in savannas or forests and had to either fight off predators or flee from them, these hormones gave our ancestors the needed strength and stamina to take either action. Released by nerve endings and by the adrenal glands that sit on top of the kidneys, these hormones still flood our bodies in moments of stress, but an overabundance of them could sometimes be damaging.
Elaine Kamil
A recent study by scientists at Harvard Medical School linked increased risk of takotsubo to higher activity in the amygdala, a brain region responsible for emotions that's involved in responses to stress. The scientists believe that chronic stress makes people more susceptible to the syndrome. Notably, one small study suggested that the number of Takotsubo cases increased during the COVID-19 pandemic.
There are no specific drugs to treat takotsubo, so doctors rely on supportive therapies, which include medications typically used for high blood pressure and heart failure. In most cases, the heart returns to its normal shape within a few weeks. "It's a spontaneous recovery—the catecholamine storm is resolved, the injury trigger is removed and the heart heals itself because our bodies have an amazing healing capacity," Merz says. It also helps that tissues remain intact. 'The heart cells don't die, they just aren't functioning properly for some time."
That's the good news. The bad news is that takotsubo is likely to strike again—in 5-20% of patients the condition comes back, sometimes more severe than before.
That's exactly what happened to Kamil. After getting her diagnosis in 2013, she realized that she actually had a previous takotsubo episode. In 2010, she experienced similar symptoms after her son died. "The night after he died, I was having severe chest pain at night, but I was too overwhelmed with grief to do anything about it," she recalls. After a while, the pain subsided and didn't return until three years later.
For weeks after her second attack, she felt exhausted, listless and anxious. "You lose confidence in your body," she says. "You have these little twinges on your chest, or if you start having arrhythmia, and you wonder if this is another episode coming up. It's really unnerving because you don't know how to read these cues." And that's very typical, Merz says. Even when the heart muscle appears to recover, patients don't return to normal right away. They have shortens of breath, they can't exercise, and they stay anxious and worried for a while.
Women over the age of 50 are diagnosed with takotsubo more often than other demographics. However, it happens in men too, although it typically strikes after physical stress, such as a triathlon or an exhausting day of cycling. Young people can also get takotsubo. Older patients are hospitalized more often, but younger people tend to have more severe complications. It could be because an older person may go for a jog while younger one may run a marathon, which would take a stronger toll on the body of a person who's predisposed to the condition.
Notably, the emotional stressors don't always have to be negative—the heart muscle can get out of shape from good emotions, too. "There have been case reports of takotsubo at weddings," Merz says. Moreover, one out of three or four takotsubo patients experience no apparent stress, she adds. "So it could be that it's not so much the catecholamine storm itself, but the body's reaction to it—the physiological reaction deeply embedded into out physiology," she explains.
Merz and her team are working to understand what makes people predisposed to takotsubo. They think a person's genetics play a role, but they haven't yet pinpointed genes that seem to be responsible. Genes code for proteins, which affect how the body metabolizes various compounds, which, in turn, affect the body's response to stress. Pinning down the protein involved in takotsubo susceptibility would allow doctors to develop screening tests and identify those prone to severe repeating attacks. It will also help develop medications that can either prevent it or treat it better than just waiting for the body to heal itself.
Researchers at the Imperial College London recently found that elevated levels of certain types of microRNAs—molecules involved in protein production—increase the chances of developing takotsubo.
In one study, researchers tried treating takotsubo in mice with a drug called suberanilohydroxamic acid, or SAHA, typically used for cancer treatment. The drug improved cardiac health and reversed the broken heart in rodents. It remains to be seen if the drug would have a similar effect on humans. But identifying a drug that shows promise is progress, Merz says. "I'm glad that there's research in this area."
Lina Zeldovich has written about science, medicine and technology for Popular Science, Smithsonian, National Geographic, Scientific American, Reader’s Digest, the New York Times and other major national and international publications. A Columbia J-School alumna, she has won several awards for her stories, including the ASJA Crisis Coverage Award for Covid reporting, and has been a contributing editor at Nautilus Magazine. In 2021, Zeldovich released her first book, The Other Dark Matter, published by the University of Chicago Press, about the science and business of turning waste into wealth and health. You can find her on http://linazeldovich.com/ and @linazeldovich.
What to Know about the Fast-Spreading Delta Variant
A highly contagious form of the coronavirus known as the Delta variant is spreading rapidly and becoming increasingly prevalent around the world. First identified in India in December, Delta has now been identified in 111 countries.
In the United States, the variant now accounts for 83% of sequenced COVID-19 cases, said Rochelle Walensky, director of the Centers for Disease Control and Prevention, at a July 20 Senate hearing. In May, Delta was responsible for just 3% of U.S. cases. The World Health Organization projects that Delta will become the dominant variant globally over the coming months.
So, how worried should you be about the Delta variant? We asked experts some common questions about Delta.
What is a variant?
To understand Delta, it's helpful to first understand what a variant is. When a virus infects a person, it gets into your cells and makes a copy of its genome so it can replicate and spread throughout your body.
In the process of making new copies of itself, the virus can make a mistake in its genetic code. Because viruses are replicating all the time, these mistakes — also called mutations — happen pretty often. A new variant emerges when a virus acquires one or more new mutations and starts spreading within a population.
There are thousands of SARS-CoV-2 variants, but most of them don't substantially change the way the virus behaves. The variants that scientists are most interested in are known as variants of concern. These are versions of the virus with mutations that allow the virus to spread more easily, evade vaccines, or cause more severe disease.
"The vast majority of the mutations that have accumulated in SARS-CoV-2 don't change the biology as far as we're concerned," said Jennifer Surtees, a biochemist at the University of Buffalo who's studying the coronavirus. "But there have been a handful of key mutations and combinations of mutations that have led to what we're now calling variants of concern."
One of those variants of concern is Delta, which is now driving many new COVID-19 infections.
Why is the Delta variant so concerning?
"The reason why the Delta variant is concerning is because it's causing an increase in transmission," said Alba Grifoni, an infectious disease researcher at the La Jolla Institute for Immunology. "The virus is spreading faster and people — particularly those who are not vaccinated yet — are more prone to exposure."
The Delta variant has a few key mutations that make it better at attaching to our cells and evading the neutralizing antibodies in our immune system. These mutations have changed the virus enough to make it more than twice as contagious as the original SARS-CoV-2 virus that emerged in Wuhan and about 50% more contagious than the Alpha variant, previously known as B.1.1.7, or the U.K. variant.
These mutations were previously seen in other variants on their own, but it's their combination that makes Delta so much more infectious.
Do vaccines work against the Delta variant?
The good news is, the COVID-19 vaccines made by AstraZeneca, Johnson & Johnson, Moderna, and Pfizer still work against the Delta variant. They remain more than 90% effective at preventing hospitalizations and death due to Delta. While they're slightly less protective against disease symptoms, they're still very effective at preventing severe illness caused by the Delta variant.
"They're not as good as they were against the prior strains, but they're holding up pretty well," said Eric Topol, a physician and director of the Scripps Translational Research Institute, during a July 19 briefing for journalists.
Because Delta is better at evading our immune systems, it's likely causing more breakthrough infections — COVID-19 cases in people who are vaccinated. However, breakthrough infections were expected before the Delta variant became widespread. No vaccine is 100% effective, so breakthrough infections can happen with other vaccines as well. Experts say the COVID-19 vaccines are still working as expected, even if breakthrough infections occur. The majority of these infections are asymptomatic or cause only mild symptoms.
Should vaccinated people worry about the Delta variant?
Vaccines train our immune systems to protect us against infection. They do this by spurring the production of antibodies, which stick around in our bodies to help fight off a particular pathogen in case we ever come into contact with it.
But even if the new Delta variant slips past our neutralizing antibodies, there's another component of our immune system that can help overtake the virus: T cells. Studies are showing that the COVID-19 vaccines also galvanize T cells, which help limit disease severity in people who have been vaccinated.
"While antibodies block the virus and prevent the virus from infecting cells, T cells are able to attack cells that have already been infected," Grifoni said. In other words, T cells can prevent the infection from spreading to more places in the body. A study published July 1 by Grifoni and her colleagues found that T cells were still able to recognize mutated forms of the virus — further evidence that our current vaccines are effective against Delta.
Can fully vaccinated people spread the Delta variant?
Previously, scientists believed it was unlikely for fully vaccinated individuals with asymptomatic infections to spread Covid-19. But the Delta variant causes the virus to make so many more copies of itself inside the body, and high viral loads have been found in the respiratory tracts of people who are fully vaccinated. This suggests that vaccinated people may be able to spread the Delta variant to some degree.
If you have COVID-19 symptoms, even if you're fully vaccinated, you should get tested and isolate from friends and family because you could spread the virus.
What risk does Delta pose to unvaccinated people?
The Delta variant is behind a surge in cases in communities with low vaccination rates, and unvaccinated Americans currently account for 97% of hospitalizations due to COVID-19, according to Walensky. The best thing you can do right now to prevent yourself from getting sick is to get vaccinated.
Gigi Gronvall, an immunologist and senior scholar at the Johns Hopkins Center for Health Security, said in this week's "Making Sense of Science" podcast that it's especially important to get all required doses of the vaccine in order to have the best protection against the Delta variant. "Even if it's been more than the allotted time that you were told to come back and get the second, there's no time like the present," she said.
With more than 3.6 billion COVID-19 doses administered globally, the vaccines have been shown to be incredibly safe. Serious adverse effects are rare, although scientists continue to monitor for them.
Being vaccinated also helps prevent the emergence of new and potentially more dangerous variants. Viruses need to infect people in order to replicate, and variants emerge because the virus continues to infect more people. More infections create more opportunities for the virus to acquire new mutations.
Surtees and others worry about a scenario in which a new variant emerges that's even more transmissible or resistant to vaccines. "This is our window of opportunity to try to get as many people vaccinated as possible and get people protected so that so that the virus doesn't evolve to be even better at infecting people," she said.
Does Delta cause more severe disease?
While hospitalizations and deaths from COVID-19 are increasing again, it's not yet clear whether Delta causes more severe illness than previous strains.
How can we protect unvaccinated children from the Delta variant?
With children 12 and under not yet eligible for the COVID-19 vaccine, kids are especially vulnerable to the Delta variant. One way to protect unvaccinated children is for parents and other close family members to get vaccinated.
It's also a good idea to keep masks handy when going out in public places. Due to risk Delta poses, the American Academy of Pediatrics issued new guidelines July 19 recommending that all staff and students over age 2 wear face masks in school this fall, even if they have been vaccinated.
Parents should also avoid taking their unvaccinated children to crowded, indoor locations and make sure their kids are practicing good hand-washing hygiene. For children younger than 2, limit visits with friends and family members who are unvaccinated or whose vaccination status is unknown and keep up social distancing practices while in public.
While there's no evidence yet that Delta increases disease severity in children, parents should be mindful that in some rare cases, kids can get a severe form of the disease.
"We're seeing more children getting sick and we're seeing some of them get very sick," Surtees said. "Those children can then pass on the virus to other individuals, including people who are immunocompromised or unvaccinated."