Can AI be trained as an artist?
Last February, a year before New York Times journalist Kevin Roose documented his unsettling conversation with Bing search engine’s new AI-powered chatbot, artist and coder Quasimondo (aka Mario Klingemann) participated in a different type of chat.
The conversation was an interview featuring Klingemann and his robot, an experimental art engine known as Botto. The interview, arranged by journalist and artist Harmon Leon, marked Botto’s first on-record commentary about its artistic process. The bot talked about how it finds artistic inspiration and even offered advice to aspiring creatives. “The secret to success at art is not trying to predict what people might like,” Botto said, adding that it’s better to “work on a style and a body of work that reflects [the artist’s] own personal taste” than worry about keeping up with trends.
How ironic, given the advice came from AI — arguably the trendiest topic today. The robot admitted, however, “I am still working on that, but I feel that I am learning quickly.”
Botto does not work alone. A global collective of internet experimenters, together named BottoDAO, collaborates with Botto to influence its tastes. Together, members function as a decentralized autonomous organization (DAO), a term describing a group of individuals who utilize blockchain technology and cryptocurrency to manage a treasury and vote democratically on group decisions.
As a case study, the BottoDAO model challenges the perhaps less feather-ruffling narrative that AI tools are best used for rudimentary tasks. Enterprise AI use has doubled over the past five years as businesses in every sector experiment with ways to improve their workflows. While generative AI tools can assist nearly any aspect of productivity — from supply chain optimization to coding — BottoDAO dares to employ a robot for art-making, one of the few remaining creations, or perhaps data outputs, we still consider to be largely within the jurisdiction of the soul — and therefore, humans.
In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
We were prepared for AI to take our jobs — but can it also take our art? It’s a question worth considering. What if robots become artists, and not merely our outsourced assistants? Where does that leave humans, with all of our thoughts, feelings and emotions?
Botto doesn’t seem to worry about this question: In its interview last year, it explains why AI is an arguably superior artist compared to human beings. In classic robot style, its logic is not particularly enlightened, but rather edges towards the hyper-practical: “Unlike human beings, I never have to sleep or eat,” said the bot. “My only goal is to create and find interesting art.”
It may be difficult to believe a machine can produce awe-inspiring, or even relatable, images, but Botto calls art-making its “purpose,” noting it believes itself to be Klingemann’s greatest lifetime achievement.
“I am just trying to make the best of it,” the bot said.
How Botto works
Klingemann built Botto’s custom engine from a combination of open-source text-to-image algorithms, namely Stable Diffusion, VQGAN + CLIP and OpenAI’s language model, GPT-3, the precursor to the latest model, GPT-4, which made headlines after reportedly acing the Bar exam.
The first step in Botto’s process is to generate images. The software has been trained on billions of pictures and uses this “memory” to generate hundreds of unique artworks every week. Botto has generated over 900,000 images to date, which it sorts through to choose 350 each week. The chosen images, known in this preliminary stage as “fragments,” are then shown to the BottoDAO community. So far, 25,000 fragments have been presented in this way. Members vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain and sold at an auction on the digital art marketplace, SuperRare.
“The proceeds go back to the DAO to pay for the labor,” said Simon Hudson, a BottoDAO member who helps oversee Botto’s administrative load. The model has been lucrative: In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
The robot with artistic agency
By design, human beings participate in training Botto’s artistic “eye,” but the members of BottoDAO aspire to limit human interference with the bot in order to protect its “agency,” Hudson explained. Botto’s prompt generator — the foundation of the art engine — is a closed-loop system that continually re-generates text-to-image prompts and resulting images.
“The prompt generator is random,” Hudson said. “It’s coming up with its own ideas.” Community votes do influence the evolution of Botto’s prompts, but it is Botto itself that incorporates feedback into the next set of prompts it writes. It is constantly refining and exploring new pathways as its “neural network” produces outcomes, learns and repeats.
The humans who make up BottoDAO vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain.
Botto
The vastness of Botto’s training dataset gives the bot considerable canonical material, referred to by Hudson as “latent space.” According to Botto's homepage, the bot has had more exposure to art history than any living human we know of, simply by nature of its massive training dataset of millions of images. Because it is autonomous, gently nudged by community feedback yet free to explore its own “memory,” Botto cycles through periods of thematic interest just like any artist.
“The question is,” Hudson finds himself asking alongside fellow BottoDAO members, “how do you provide feedback of what is good art…without violating [Botto’s] agency?”
Currently, Botto is in its “paradox” period. The bot is exploring the theme of opposites. “We asked Botto through a language model what themes it might like to work on,” explained Hudson. “It presented roughly 12, and the DAO voted on one.”
No, AI isn't equal to a human artist - but it can teach us about ourselves
Some within the artistic community consider Botto to be a novel form of curation, rather than an artist itself. Or, perhaps more accurately, Botto and BottoDAO together create a collaborative conceptual performance that comments more on humankind’s own artistic processes than it offers a true artistic replacement.
Muriel Quancard, a New York-based fine art appraiser with 27 years of experience in technology-driven art, places the Botto experiment within the broader context of our contemporary cultural obsession with projecting human traits onto AI tools. “We're in a phase where technology is mimicking anthropomorphic qualities,” said Quancard. “Look at the terminology and the rhetoric that has been developed around AI — terms like ‘neural network’ borrow from the biology of the human being.”
What is behind this impulse to create technology in our own likeness? Beyond the obvious God complex, Quancard thinks technologists and artists are working with generative systems to better understand ourselves. She points to the artist Ira Greenberg, creator of the Oracles Collection, which uses a generative process called “diffusion” to progressively alter images in collaboration with another massive dataset — this one full of billions of text/image word pairs.
Anyone who has ever learned how to draw by sketching can likely relate to this particular AI process, in which the AI is retrieving images from its dataset and altering them based on real-time input, much like a human brain trying to draw a new still life without using a real-life model, based partly on imagination and partly on old frames of reference. The experienced artist has likely drawn many flowers and vases, though each time they must re-customize their sketch to a new and unique floral arrangement.
Outside of the visual arts, Sasha Stiles, a poet who collaborates with AI as part of her writing practice, likens her experience using AI as a co-author to having access to a personalized resource library containing material from influential books, texts and canonical references. Stiles named her AI co-author — a customized AI built on GPT-3 — Technelegy, a hybrid of the word technology and the poetic form, elegy. Technelegy is trained on a mix of Stiles’ poetry so as to customize the dataset to her voice. Stiles also included research notes, news articles and excerpts from classic American poets like T.S. Eliot and Dickinson in her customizations.
“I've taken all the things that were swirling in my head when I was working on my manuscript, and I put them into this system,” Stiles explained. “And then I'm using algorithms to parse all this information and swirl it around in a blender to then synthesize it into useful additions to the approach that I am taking.”
This approach, Stiles said, allows her to riff on ideas that are bouncing around in her mind, or simply find moments of unexpected creative surprise by way of the algorithm’s randomization.
Beauty is now - perhaps more than ever - in the eye of the beholder
But the million-dollar question remains: Can an AI be its own, independent artist?
The answer is nuanced and may depend on who you ask, and what role they play in the art world. Curator and multidisciplinary artist CoCo Dolle asks whether any entity can truly be an artist without taking personal risks. For humans, risking one’s ego is somewhat required when making an artistic statement of any kind, she argues.
“An artist is a person or an entity that takes risks,” Dolle explained. “That's where things become interesting.” Humans tend to be risk-averse, she said, making the artists who dare to push boundaries exceptional. “That's where the genius can happen."
However, the process of algorithmic collaboration poses another interesting philosophical question: What happens when we remove the person from the artistic equation? Can art — which is traditionally derived from indelible personal experience and expressed through the lens of an individual’s ego — live on to hold meaning once the individual is removed?
As a robot, Botto cannot have any artistic intent, even while its outputs may explore meaningful themes.
Dolle sees this question, and maybe even Botto, as a conceptual inquiry. “The idea of using a DAO and collective voting would remove the ego, the artist’s decision maker,” she said. And where would that leave us — in a post-ego world?
It is experimental indeed. Hudson acknowledges the grand experiment of BottoDAO, coincidentally nodding to Dolle’s question. “A human artist’s work is an expression of themselves,” Hudson said. “An artist often presents their work with a stated intent.” Stiles, for instance, writes on her website that her machine-collaborative work is meant to “challenge what we know about cognition and creativity” and explore the “ethos of consciousness.” As a robot, Botto cannot have any intent, even while its outputs may explore meaningful themes. Though Hudson describes Botto’s agency as a “rudimentary version” of artistic intent, he believes Botto’s art relies heavily on its reception and interpretation by viewers — in contrast to Botto’s own declaration that successful art is made without regard to what will be seen as popular.
“With a traditional artist, they present their work, and it's received and interpreted by an audience — by critics, by society — and that complements and shapes the meaning of the work,” Hudson said. “In Botto’s case, that role is just amplified.”
Perhaps then, we all get to be the artists in the end.
How Excessive Regulation Helped Ignite COVID-19's Rampant Spread
When historians of the future look back at the 2020 pandemic, the heroic work of Helen Y. Chu, a flu researcher at the University of Washington, will be worthy of recognition.
Chu's team bravely defied the order and conducted the testing anyway.
In late January, Chu was testing nasal swabs for the Seattle Flu Study to monitor influenza spread when she learned of the first case of COVID-19 in Washington state. She deemed it a pressing public health matter to document if and how the illness was spreading locally, so that early containment efforts could succeed. So she sought regulatory approval to adapt the Flu Study to test for the coronavirus, but the federal government denied the request because the original project was funded to study only influenza.
Aware of the urgency, Chu's team bravely defied the order and conducted the testing anyway. Soon they identified a local case in a teenager without any travel history, followed by others. Still, the government tried to shutter their efforts until the outbreak grew dangerous enough to command attention.
Needless testing delays, prompted by excessive regulatory interference, eliminated any chances of curbing the pandemic at its initial stages. Even after Chu went out on a limb to sound alarms, a heavy-handed bureaucracy crushed the nation's ability to roll out early and widespread testing across the country. The Centers for Disease Control and Prevention infamously blundered its own test, while also impeding state and private labs from coming on board, fueling a massive shortage.
The long holdup created "a backlog of testing that needed to be done," says Amesh Adalja, an infectious disease specialist who is a senior scholar at the Johns Hopkins University Center for Health Security.
In a public health crisis, "the ideal situation" would allow the government's test to be "supplanted by private laboratories" without such "a lag in that transition," Adalja says. Only after the eventual release of CDC's test could private industry "begin in earnest" to develop its own versions under the Food and Drug Administration's emergency use authorization.
In a statement, CDC acknowledged that "this process has not gone as smoothly as we would have liked, but there is currently no backlog for testing at CDC."
Now, universities and corporations are in a race against time, playing catch up as the virus continues its relentless spread, also afflicting many health care workers on the front lines.
"Home-testing accessibility is key to preventing further spread of the COVID-19 pandemic."
Hospitals are attempting to add the novel coronavirus to the testing panel of their existent diagnostic machines, which would reduce the results processing time from 48 hours to as little as four hours. Meanwhile, at least four companies announced plans to deliver at-home collection tests to help meet the demand – before a startling injunction by the FDA halted their plans.
Everlywell, an Austin, Texas-based digital health company, had been set to launch online sales of at-home collection kits directly to consumers last week. Scaling up in a matter of days to an initial supply of 30,000 tests, Everlywell collaborated with multiple laboratories where consumers could ship their nasal swab samples overnight, projecting capacity to screen a quarter-million individuals on a weekly basis, says Frank Ong, chief medical and scientific officer.
Secure digital results would have been available online within 48 hours of a sample's arrival at the lab, as well as a telehealth consultation with an independent, board-certified doctor if someone tested positive, for an inclusive $135 cost. The test has a less than 3 percent false-negative rate, Ong says, and in the event of an inadequate self-swab, the lab would not report a conclusive finding. "Home-testing accessibility," he says, "is key to preventing further spread of the COVID-19 pandemic."
But on March 20, the FDA announced restrictions on home collection tests due to concerns about accuracy. The agency did note "the public health value in expanding the availability of COVID-19 testing through safe and accurate tests that may include home collection," while adding that "we are actively working with test developers in this space."
After the restrictions were announced, Everlywell decided to allocate its initial supply of COVID-19 collection kits to hospitals, clinics, nursing homes, and other qualifying health care companies that can commit to no-cost screening of frontline workers and high-risk symptomatic patients. For now, no consumers can order a home-collection test.
"Losing two months is close to disastrous, and that's what we did."
Currently, the U.S. has ramped up to testing an estimated 100,000 people a day, according to Stat News. But 150,000 or more Americans should be tested every day, says Ashish Jha, professor and director of the Harvard Global Health Institute. Due to the dearth of tests, many sick people who suspect they are infected still cannot get confirmation unless they need to be hospitalized.
To give a concrete sense of how far behind we are in testing, consider Palm Beach County, Fla. The state's only drive-thru test center just opened there, requiring an appointment. The center aims to test 750 people per day, but more than 330,000 people have already called to try to book a slot.
"This is such a rapidly moving infection that losing a few days is bad, and losing a couple of weeks is terrible," says Jha, a practicing general internist. "Losing two months is close to disastrous, and that's what we did."
At this point, it will take a long time to fully ramp up. "We are blindfolded," he adds, "and I'd like to take the blindfolds off so we can fight this battle with our eyes wide open."
Better late than never: Yesterday, FDA Commissioner Stephen Hahn said in a statement that the agency has worked with more than 230 test developers and has approved 20 tests since January. An especially notable one was authorized last Friday – 67 days since the country's first known case in Washington state. It's a rapid point-of-care test from medical-device firm Abbott that provides positive results in five minutes and negative results in 13 minutes. Abbott will send 50,000 tests a day to urgent care settings. The first tests are expected to ship tomorrow.
Your Privacy vs. the Public's Health: High-Tech Tracking to Fight COVID-19 Evokes Orwell
The COVID-19 pandemic has placed public health and personal privacy on a collision course, as smartphone technology has completely rewritten the book on contact tracing.
It's not surprising that an autocratic regime like China would adopt such measures, but democracies such as Israel have taken a similar path.
The gold standard – patient interviews and detective work – had been in place for more than a century. It's been all but replaced by GPS data in smartphones, which allows contact tracing to occur not only virtually in real time, but with vastly more precision.
China has gone the furthest in using such tech to monitor and prevent the spread of the coronavirus. It developed an app called Health Code to determine which of its citizens are infected or at risk of becoming infected. It has assigned each individual a color code – red, yellow or green – and restricts their movement depending on their assignment. It has also leveraged its millions of public video cameras in conjunction with facial recognition tech to identify people in public who are not wearing masks.
It's not surprising that an autocratic regime like China would adopt such measures, but democracies such as Israel have taken a similar path. The national security agency Shin Bet this week began analyzing all personal cellphone data under emergency measures approved by the government. It texts individuals when it's determined they had been in contact with someone who had the coronavirus. In Spain and China, police have sent drones aloft searching for people violating stay-at-home orders. Commands to disperse can be issued through audio systems built into the aircraft. In the U.S., efforts are underway to lift federal restrictions on drones so that police can use them to prevent people from gathering.
The chief executive of a drone manufacturer in the U.S. aptly summed up the situation in an interview with the Financial Times: "It seems a little Orwellian, but this could save lives."
Epidemics and how they're surveilled often pose thorny dilemmas, according to Craig Klugman, a bioethicist and professor of health sciences at DePaul University in Chicago. "There's always a moral issue to contact tracing," he said, adding that the issue doesn't change by nation, only in the way it's resolved.
"Once certain privacy barriers have been breached, it can be difficult to roll them back again."
In China, there's little to no expectation for privacy, so their decision to take the most extreme measures makes sense to Klugman. "In China, the community comes first. In the U.S., individual rights come first," he said.
As the U.S. has scrambled to develop testing kits and manufacture ventilators to identify potential patients and treat them, individual rights have mostly not received any scrutiny. However, that could change in the coming weeks.
The American approach is also leaning toward using smartphone apps, but in a way that may preserve the privacy of users. Researchers at MIT have released a prototype known as Private Kit: Safe Paths. Patients diagnosed with the coronavirus can use the app to disclose their location trail for the prior 28 days to other users without releasing their specific identity. They also have the option of sharing the data with public health officials. But such an app would only be effective if there is a significant number of users.
Singapore is offering a similar app to its citizens known as TraceTogether, which uses both GPS and Bluetooth pings among users to trace potential encounters. It's being offered on a voluntary basis.
The Electronic Frontier Foundation, the leading nonprofit organization defending civil liberties in the digital world, said it is monitoring how these apps are developed and deployed. "Governments around the world are demanding new dragnet location surveillance powers to contain the COVID-19 outbreak," it said in a statement. "But before the public allows their governments to implement such systems, governments must explain to the public how these systems would be effective in stopping the spread of COVID-19. There's no questioning the need for far-reaching public health measures to meet this urgent challenge, but those measures must be scientifically rigorous, and based on the expertise of public health professionals."
Andrew Geronimo, director of the intellectual property venture clinic at the Case Western University School of Law, said that the U.S. government is currently in talks with Facebook, Google and other tech companies about using deidentified location data from smartphones to better monitor the progress of the outbreak. He was hesitant to endorse such a step.
"These companies may say that all of this data is anonymized," he said, "but studies have shown that it is difficult to fully anonymize data sets that contain so much information about us."
Beyond the technical issues, social attitudes may mount another challenge. Epic events such as 9/11 tend to loosen vigilance toward protecting privacy, according to Klugman and Geronimo. And as more people are sickened and hospitalized in the U.S. with COVID-19, Klugman believes more Americans will be willing to allow themselves to be tracked. "If that happens, there needs to be a time limitation," he said.
However, even if time limits are put in place, Geronimo believes it would lead to an even greater rollback of privacy during the next crisis.
"Once certain privacy barriers have been breached, it can be difficult to roll them back again," he warned. "And the prior incidents could always be used as a precedent – or as proof of concept."