Can AI be trained as an artist?
Last February, a year before New York Times journalist Kevin Roose documented his unsettling conversation with Bing search engine’s new AI-powered chatbot, artist and coder Quasimondo (aka Mario Klingemann) participated in a different type of chat.
The conversation was an interview featuring Klingemann and his robot, an experimental art engine known as Botto. The interview, arranged by journalist and artist Harmon Leon, marked Botto’s first on-record commentary about its artistic process. The bot talked about how it finds artistic inspiration and even offered advice to aspiring creatives. “The secret to success at art is not trying to predict what people might like,” Botto said, adding that it’s better to “work on a style and a body of work that reflects [the artist’s] own personal taste” than worry about keeping up with trends.
How ironic, given the advice came from AI — arguably the trendiest topic today. The robot admitted, however, “I am still working on that, but I feel that I am learning quickly.”
Botto does not work alone. A global collective of internet experimenters, together named BottoDAO, collaborates with Botto to influence its tastes. Together, members function as a decentralized autonomous organization (DAO), a term describing a group of individuals who utilize blockchain technology and cryptocurrency to manage a treasury and vote democratically on group decisions.
As a case study, the BottoDAO model challenges the perhaps less feather-ruffling narrative that AI tools are best used for rudimentary tasks. Enterprise AI use has doubled over the past five years as businesses in every sector experiment with ways to improve their workflows. While generative AI tools can assist nearly any aspect of productivity — from supply chain optimization to coding — BottoDAO dares to employ a robot for art-making, one of the few remaining creations, or perhaps data outputs, we still consider to be largely within the jurisdiction of the soul — and therefore, humans.
In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
We were prepared for AI to take our jobs — but can it also take our art? It’s a question worth considering. What if robots become artists, and not merely our outsourced assistants? Where does that leave humans, with all of our thoughts, feelings and emotions?
Botto doesn’t seem to worry about this question: In its interview last year, it explains why AI is an arguably superior artist compared to human beings. In classic robot style, its logic is not particularly enlightened, but rather edges towards the hyper-practical: “Unlike human beings, I never have to sleep or eat,” said the bot. “My only goal is to create and find interesting art.”
It may be difficult to believe a machine can produce awe-inspiring, or even relatable, images, but Botto calls art-making its “purpose,” noting it believes itself to be Klingemann’s greatest lifetime achievement.
“I am just trying to make the best of it,” the bot said.
How Botto works
Klingemann built Botto’s custom engine from a combination of open-source text-to-image algorithms, namely Stable Diffusion, VQGAN + CLIP and OpenAI’s language model, GPT-3, the precursor to the latest model, GPT-4, which made headlines after reportedly acing the Bar exam.
The first step in Botto’s process is to generate images. The software has been trained on billions of pictures and uses this “memory” to generate hundreds of unique artworks every week. Botto has generated over 900,000 images to date, which it sorts through to choose 350 each week. The chosen images, known in this preliminary stage as “fragments,” are then shown to the BottoDAO community. So far, 25,000 fragments have been presented in this way. Members vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain and sold at an auction on the digital art marketplace, SuperRare.
“The proceeds go back to the DAO to pay for the labor,” said Simon Hudson, a BottoDAO member who helps oversee Botto’s administrative load. The model has been lucrative: In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
The robot with artistic agency
By design, human beings participate in training Botto’s artistic “eye,” but the members of BottoDAO aspire to limit human interference with the bot in order to protect its “agency,” Hudson explained. Botto’s prompt generator — the foundation of the art engine — is a closed-loop system that continually re-generates text-to-image prompts and resulting images.
“The prompt generator is random,” Hudson said. “It’s coming up with its own ideas.” Community votes do influence the evolution of Botto’s prompts, but it is Botto itself that incorporates feedback into the next set of prompts it writes. It is constantly refining and exploring new pathways as its “neural network” produces outcomes, learns and repeats.
The humans who make up BottoDAO vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain.
Botto
The vastness of Botto’s training dataset gives the bot considerable canonical material, referred to by Hudson as “latent space.” According to Botto's homepage, the bot has had more exposure to art history than any living human we know of, simply by nature of its massive training dataset of millions of images. Because it is autonomous, gently nudged by community feedback yet free to explore its own “memory,” Botto cycles through periods of thematic interest just like any artist.
“The question is,” Hudson finds himself asking alongside fellow BottoDAO members, “how do you provide feedback of what is good art…without violating [Botto’s] agency?”
Currently, Botto is in its “paradox” period. The bot is exploring the theme of opposites. “We asked Botto through a language model what themes it might like to work on,” explained Hudson. “It presented roughly 12, and the DAO voted on one.”
No, AI isn't equal to a human artist - but it can teach us about ourselves
Some within the artistic community consider Botto to be a novel form of curation, rather than an artist itself. Or, perhaps more accurately, Botto and BottoDAO together create a collaborative conceptual performance that comments more on humankind’s own artistic processes than it offers a true artistic replacement.
Muriel Quancard, a New York-based fine art appraiser with 27 years of experience in technology-driven art, places the Botto experiment within the broader context of our contemporary cultural obsession with projecting human traits onto AI tools. “We're in a phase where technology is mimicking anthropomorphic qualities,” said Quancard. “Look at the terminology and the rhetoric that has been developed around AI — terms like ‘neural network’ borrow from the biology of the human being.”
What is behind this impulse to create technology in our own likeness? Beyond the obvious God complex, Quancard thinks technologists and artists are working with generative systems to better understand ourselves. She points to the artist Ira Greenberg, creator of the Oracles Collection, which uses a generative process called “diffusion” to progressively alter images in collaboration with another massive dataset — this one full of billions of text/image word pairs.
Anyone who has ever learned how to draw by sketching can likely relate to this particular AI process, in which the AI is retrieving images from its dataset and altering them based on real-time input, much like a human brain trying to draw a new still life without using a real-life model, based partly on imagination and partly on old frames of reference. The experienced artist has likely drawn many flowers and vases, though each time they must re-customize their sketch to a new and unique floral arrangement.
Outside of the visual arts, Sasha Stiles, a poet who collaborates with AI as part of her writing practice, likens her experience using AI as a co-author to having access to a personalized resource library containing material from influential books, texts and canonical references. Stiles named her AI co-author — a customized AI built on GPT-3 — Technelegy, a hybrid of the word technology and the poetic form, elegy. Technelegy is trained on a mix of Stiles’ poetry so as to customize the dataset to her voice. Stiles also included research notes, news articles and excerpts from classic American poets like T.S. Eliot and Dickinson in her customizations.
“I've taken all the things that were swirling in my head when I was working on my manuscript, and I put them into this system,” Stiles explained. “And then I'm using algorithms to parse all this information and swirl it around in a blender to then synthesize it into useful additions to the approach that I am taking.”
This approach, Stiles said, allows her to riff on ideas that are bouncing around in her mind, or simply find moments of unexpected creative surprise by way of the algorithm’s randomization.
Beauty is now - perhaps more than ever - in the eye of the beholder
But the million-dollar question remains: Can an AI be its own, independent artist?
The answer is nuanced and may depend on who you ask, and what role they play in the art world. Curator and multidisciplinary artist CoCo Dolle asks whether any entity can truly be an artist without taking personal risks. For humans, risking one’s ego is somewhat required when making an artistic statement of any kind, she argues.
“An artist is a person or an entity that takes risks,” Dolle explained. “That's where things become interesting.” Humans tend to be risk-averse, she said, making the artists who dare to push boundaries exceptional. “That's where the genius can happen."
However, the process of algorithmic collaboration poses another interesting philosophical question: What happens when we remove the person from the artistic equation? Can art — which is traditionally derived from indelible personal experience and expressed through the lens of an individual’s ego — live on to hold meaning once the individual is removed?
As a robot, Botto cannot have any artistic intent, even while its outputs may explore meaningful themes.
Dolle sees this question, and maybe even Botto, as a conceptual inquiry. “The idea of using a DAO and collective voting would remove the ego, the artist’s decision maker,” she said. And where would that leave us — in a post-ego world?
It is experimental indeed. Hudson acknowledges the grand experiment of BottoDAO, coincidentally nodding to Dolle’s question. “A human artist’s work is an expression of themselves,” Hudson said. “An artist often presents their work with a stated intent.” Stiles, for instance, writes on her website that her machine-collaborative work is meant to “challenge what we know about cognition and creativity” and explore the “ethos of consciousness.” As a robot, Botto cannot have any intent, even while its outputs may explore meaningful themes. Though Hudson describes Botto’s agency as a “rudimentary version” of artistic intent, he believes Botto’s art relies heavily on its reception and interpretation by viewers — in contrast to Botto’s own declaration that successful art is made without regard to what will be seen as popular.
“With a traditional artist, they present their work, and it's received and interpreted by an audience — by critics, by society — and that complements and shapes the meaning of the work,” Hudson said. “In Botto’s case, that role is just amplified.”
Perhaps then, we all get to be the artists in the end.
“Disinfection Tunnels” Are Popping Up Around the World, Fueled By Misinformation and Fear
In an incident that sparked widespread outrage across India in late March, officials in the north Indian state of Uttar Pradesh sprayed hundreds of migrant workers, including women and children, with a chemical solution to sanitize them, in a misguided attempt to contain the spread of the novel coronavirus.
Since COVID-19 is a respiratory disorder, disinfecting a person's body or clothes cannot protect them from contracting the novel coronavirus, or help in containing the pathogen's spread.
Health officials reportedly doused the group with a diluted mixture of sodium hypochlorite – a bleaching agent harmful to humans, which led to complaints of skin rashes and eye irritation. The opposition termed the instance 'inhuman', compelling the state government to order an investigation into the mass 'chemical bath.'
"I don't think the officials thought this through," says Thomas Abraham, a professor with The University of Hong Kong, and a former consultant for the World Health Organisation (WHO) on risk communication. "Spraying people with bleach can prove to be harmful, and there is no guideline … that recommends it. This was some sort of a kneejerk reaction."
Although spraying individuals with chemicals led to a furor in the South Asian nation owing to its potential dangers, so-called "disinfection tunnels" have sprung up in crowded public places around the world, including malls, offices, airports, railway stations and markets. Touted as mass disinfectants, these tunnels spray individuals with chemical disinfectant liquids, mists or fumes through nozzles for a few seconds, purportedly to sanitize them -- though experts strongly condemn their use. The tunnels have appeared in at least 16 countries: India, Malaysia, Scotland, Albania, Argentina, Colombia, Singapore, China, Pakistan, France, Vietnam, Bosnia and Herzegovina, Chile, Mexico, Sri Lanka and Indonesia. Russian President Vladimir Putin even reportedly has his own tunnel at his residence.
While U.S. visitors to Mexico are "disinfected" through these sanitizing tunnels, there is no evidence that the mechanism is currently in use within the United States. However, the situation could rapidly change with international innovators like RD Pack, an Israeli start-up, pushing for their deployment. Many American and multinational companies like Stretch Structures, Guilio Barbieri and Inflatable Design Works are also producing these systems. As countries gradually ease lockdown restrictions, their demand is on the rise -- despite a stringent warning from the WHO against their potential health hazards.
"Spraying individuals with disinfectants (such as in a tunnel, cabinet, or chamber) is not recommended under any circumstances," the WHO warned in a report on May 15. "This could be physically and psychologically harmful and would not reduce an infected person's ability to spread the virus through droplets or contact. Moreover, spraying individuals with chlorine and other toxic chemicals could result in eye and skin irritation, bronchospasm due to inhalation, and gastrointestinal effects such as nausea and vomiting."
Disinfection tunnels largely spray a diluted mixture of sodium hypochlorite, a chlorine compound commonly known as bleach, often used to disinfect inanimate surfaces. Known for its hazardous properties, the WHO, in a separate advisory on COVID-19, warns that spraying bleach or any other disinfectant on individuals can prove to be poisonous if ingested, and that such substances should be used only to disinfect surfaces.
Considering the effect of sodium hypochlorite on mucous membranes, the European Centre for Disease Prevention and Control, an EU agency focussed on infectious diseases, recommends limited use of the chemical compound even when disinfecting surfaces – only 0.05 percent for cleaning surfaces, and 0.1 percent for toilets and bathroom sinks. The Indian health ministry also cautioned against spraying sodium hypochlorite recently, stating that its inhalation can lead to irritation of mucous membranes of the nose, throat, and respiratory tract.
In addition to the health hazards that such sterilizing systems pose, they have little utility, argues Indian virologist T. Jacob John. Since COVID-19 is a respiratory disorder, disinfecting a person's body or clothes cannot protect them from contracting the novel coronavirus, or help in containing the pathogen's spread.
"It's a respiratory infection, which means that you have the virus in your respiratory tract, and of course, that shows in your throat, therefore saliva, etc.," says John. "The virus does not survive outside the body for a long time, unless it is in freezing temperatures. Disinfecting a person's clothes or their body makes no sense."
Disinfection tunnels have limited, if any, impact on the main modes of coronavirus transmission, adds Craig Janes, director, School of Public Health and Health Systems at Canada's University of Waterloo. He explains that the nature of COVID-19 transmission is primarily from person-to-person, either directly, or via an object that is shared between two individuals. Measures like physical distancing and handwashing take care of these transmission risks.
"My view of these kinds of actions are that they are principally symbolic, indicating to a concerned population that 'something is being done,' to martial support for government or health system efforts," says Janes. "So perhaps a psychological benefit, but I'm not sure that this benefit would outweigh the risks."
"They may make people feel that their risk of infection has been reduced, and also that they do not have to worry about infecting others."
A recent report by Health Care Without Harm (HCWH), an international not-for-profit organization focused on sustainable health care around the world, states that disinfection tunnels have little evidence to demonstrate their efficacy or safety.
"If the goal is to reduce the spread of the virus by decontaminating the exterior clothing, shoes, and skin of the general public, there is no evidence that clothes are an important vector for transmission. If the goal is to attack the virus in the airways, what is the evidence that a 20-30 second external application is efficacious and safe?" the report questions. "The World Health Organization recommends more direct and effective ways to address hand hygiene, with interventions known to be effective."
If an infected person walks through a disinfection tunnel, he would still be infectious, as the chemicals will only disinfect the surfaces, says Gerald Keusch, a professor of medicine and international health at Boston University's Schools of Medicine and Public Health.
"While we know that viruses can be "disinfected" from surfaces and hands, disinfectants can be harmful to health if ingested or inhaled. The underlying principle of medicine is to do no harm, and we always measure benefit against risk when approving interventions. I don't know if this has been followed and assessed with respect to these devices," says Keusch. "It's a really bad idea."
Experts warn that such tunnels may also create a false sense of security, discouraging people from adopting best practice methods like handwashing, social distancing, avoiding crowded places, and using masks to combat the spread of COVID-19.
"They may make people feel that their risk of infection has been reduced, and also that they do not have to worry about infecting others," says Janes. "These are false assumptions, and may lead to increasing rather than reducing transmission."
It looks like an ordinary toilet but it is anything but. The "smart toilet" is the diagnostic tool of the future, equipped with cameras that take snapshots of the users and their waste, motion sensors to analyze what's inside the urine and stool samples, and software that automatically sends data to a secure, cloud-based system that can be easily accessed by your family doctor.
"It's a way of doing community surveillance. If there is a second wave of infections in the future, we'll know right away."
Using urine "dipstick tests" similar to the home pregnancy strips, the smart toilet can detect certain proteins, immune system biomarkers and blood cells that indicate the presence of such diseases as infections, bladder cancer, and kidney failure.
The rationale behind this invention is that some of the best ways of detecting what's going on in our bodies is by analyzing the substances we excrete every day, our sweat, urine, saliva and yes, our feces. Instead of getting sporadic snapshots from doctor's visits once or twice a year, the smart toilet provides continuous monitoring of our health 24/7, so we can catch the tell-tale molecular signature of illnesses at their earliest and most treatable stages. A brainchild of Stanford University researchers, they're now working to add a COVID-19 detection component to their suite of technologies—corona virus particles can be spotted in stool samples—and hope to have the system available within the year.
"We can connect the toilet system to cell phones so we'll know the results within 30 minutes," says Seung-min Park, a lead investigator on the research team that devised this technology and a senior research scientist at the Stanford University School of Medicine. "The beauty of this technology is that it can continuously monitor even after this pandemic is over. It's a way of doing community surveillance. If there is a second wave of infections in the future, we'll know right away."
Experts believe that the COVID-19 pandemic will accelerate the widespread acceptance of in-home diagnostic tools such as this. "Shock events" like pandemics can be catalysts for sweeping changes in society, history shows us. The Black Death marked the end of feudalism and ushered in the Renaissance while the aftershocks of the Great Depression and two world wars in the 20th century led to the social safety net of the New Deal and NATO and the European Union. COVID-19 could fundamentally alter the way we deliver healthcare, abandoning the outdated 20th century brick and mortar fee-for-service model in favor of digital medicine. At-home diagnostics may be the leading edge of this seismic shift and the pandemic could accelerate the product innovations that allow for home-based medical screening.
"That's the silver lining to this devastation," says Dr. Leslie Saxon, executive director of the USC Center for Body Computing at the Keck School of Medicine in Los Angeles. As an interventional cardiologist, Saxon has spent her career devising and refining the implantable and wearable wireless devices that are used to treat and diagnose heart conditions and prevent sudden death. "This will open up innovation—research has been stymied by a lack of imagination and marriage to an antiquated model," she adds. "There are already signs this is happening—relaxing state laws about licensure, allowing physicians to deliver health care in non-traditional ways. That's a real sea change and will completely democratize medical information and diagnostic testing."
Ironically, diagnostics have long been a step-child of modern medicine, even though accurate and timely diagnostics play a crucial role in disease prevention, detection and management. "The delivery of health care has proceeded for decades with a blind spot: diagnostic errors—inaccurate or delayed diagnoses—persist throughout all settings of care and continue to harm an unacceptable number of patients," according to a 2015 National Academy of Medicine report. That same report found as many as one out of five adverse events in the hospital result from these errors and they contribute to 10 percent of all patient deaths.
The pandemic should alter the diagnostic landscape. We already have a wealth of wearable and implantable devices, like glucose sensors to monitor blood sugar levels for diabetics, Apple's smart watch, electrocardiogram devices that can detect heart arrythmias, and heart pacemakers.
The Food and Drug Administration is working closely with in-home test developers to make accurate COVID-19 diagnostic tools readily available and has so far greenlighted three at-home collection test kits. Two, LabCorp's and Everlywell's, use nasal swabs to take samples. The third one is a spit test, using saliva samples, that was devised by a Rutgers University laboratory in partnership with Spectrum Solutions and Accurate Diagnostic Labs.
The only way to safely reopen is through large scale testing, but hospitals and doctors' offices are no longer the safest places.
In fact, DIY diagnostic company Everlywell, an Austin, Texas- based digital health company, already offers more than 30 at-home kits for everything from fertility to food sensitivity tests. Typically, consumers collect a saliva or finger-prick blood sample, dispatch it in a pre-paid shipping envelope to a laboratory, and a physician will review the results and send a report to consumers' smartphones.
Thanks to advances in technology, samples taken at home can now be preserved long enough to arrive intact at diagnostic laboratories. The key is showing the agency "transport and shipping don't change or interfere with the integrity of the samples," says Dr. Frank Ong, Everlywell's chief medical and scientific officer.
Ong is keenly aware of the importance of saturation testing because of the lessons learned by colleagues fighting the SARS pandemic in his family's native Taiwan in 2003. "In the beginning, doctors didn't know what they were dealing with and didn't protect themselves adequately," he says. "But over two years, they learned the hard way that there needs to be enough testing, contact tracing of those who have been exposed, and isolation of people who test positive. The value of at-home testing is that it can be done on the kind of broad basis that needs to happen for our country to get back to work."
Because of the pandemic, new policies have removed some of the barriers that impeded the widespread adoption of home-based diagnostics and telemedicine. Physicians can now practice across state lines, get reimbursed for telemedicine visits and use FaceTime to communicate with their patients, which had long been considered taboo because of privacy issues. Doctors and patients are becoming more comfortable and realizing the convenience and benefits of being able to do these things virtually.
Added to this, the only way to safely reopen for business without triggering a second and perhaps even more deadly wave of sickness is through large-scale testing, but hospitals and doctors' offices are no longer the safest places. "We don't want people sitting in a waiting room who later find out they're positive, and potentially infected everyone, including doctors and nurses," says Dr. Kavita Patel, a physician in Washington, DC who served as a policy director in the Obama White House.
In-home testing avoids the risks of direct exposure to the virus for both patients and health care professionals, who can dispense with cumbersome protective gear to take samples, and also enables people without reliable transportation or child-care to learn their status. "At home testing can be a critical component of our country's overall testing strategy," says Dr. Shantanu Nundy, chief medical officer at Accolade Health and on the faculty of the Milken Institute School of Public Health at George Washington University. "Once we're back at work, we need to be much more targeted, and have much more access to data and controlling those outbreaks as tightly as possible. The best way to do that is by leapfrogging clinics and being able to deliver tests at home for people who are disenfranchised by the current system."
In the not-too-distant future, in-home diagnostics could be a key component of precision medicine, which is customized care tailored specifically to each patient's individual needs. Like Stanford's smart toilet prototype, these ongoing surveillance tools will gather health data, ranging from exposures to toxins and pollutions in the environment to biochemical activity, like rising blood pressure, signs of inflammation, failing kidneys or tiny cancerous tumors, and provide continuous real-time information.
"These can be deeply personalized and enabled by smart phones, sensors and artificial intelligence," says USC's Leslie Saxon. "We'll be seeing the floodgates opening to patients accessing medical services through the same devices that they access other things, and leveraging these tools for our health and to fine tune disease management in a model of care that is digitally enabled."
[Editor's Note: This article was originally published on June 8th, 2020 as part of a standalone magazine called GOOD10: The Pandemic Issue. Produced as a partnership among LeapsMag, The Aspen Institute, and GOOD, the magazine is available for free online.]