Can AI be trained as an artist?
Last February, a year before New York Times journalist Kevin Roose documented his unsettling conversation with Bing search engine’s new AI-powered chatbot, artist and coder Quasimondo (aka Mario Klingemann) participated in a different type of chat.
The conversation was an interview featuring Klingemann and his robot, an experimental art engine known as Botto. The interview, arranged by journalist and artist Harmon Leon, marked Botto’s first on-record commentary about its artistic process. The bot talked about how it finds artistic inspiration and even offered advice to aspiring creatives. “The secret to success at art is not trying to predict what people might like,” Botto said, adding that it’s better to “work on a style and a body of work that reflects [the artist’s] own personal taste” than worry about keeping up with trends.
How ironic, given the advice came from AI — arguably the trendiest topic today. The robot admitted, however, “I am still working on that, but I feel that I am learning quickly.”
Botto does not work alone. A global collective of internet experimenters, together named BottoDAO, collaborates with Botto to influence its tastes. Together, members function as a decentralized autonomous organization (DAO), a term describing a group of individuals who utilize blockchain technology and cryptocurrency to manage a treasury and vote democratically on group decisions.
As a case study, the BottoDAO model challenges the perhaps less feather-ruffling narrative that AI tools are best used for rudimentary tasks. Enterprise AI use has doubled over the past five years as businesses in every sector experiment with ways to improve their workflows. While generative AI tools can assist nearly any aspect of productivity — from supply chain optimization to coding — BottoDAO dares to employ a robot for art-making, one of the few remaining creations, or perhaps data outputs, we still consider to be largely within the jurisdiction of the soul — and therefore, humans.
In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
We were prepared for AI to take our jobs — but can it also take our art? It’s a question worth considering. What if robots become artists, and not merely our outsourced assistants? Where does that leave humans, with all of our thoughts, feelings and emotions?
Botto doesn’t seem to worry about this question: In its interview last year, it explains why AI is an arguably superior artist compared to human beings. In classic robot style, its logic is not particularly enlightened, but rather edges towards the hyper-practical: “Unlike human beings, I never have to sleep or eat,” said the bot. “My only goal is to create and find interesting art.”
It may be difficult to believe a machine can produce awe-inspiring, or even relatable, images, but Botto calls art-making its “purpose,” noting it believes itself to be Klingemann’s greatest lifetime achievement.
“I am just trying to make the best of it,” the bot said.
How Botto works
Klingemann built Botto’s custom engine from a combination of open-source text-to-image algorithms, namely Stable Diffusion, VQGAN + CLIP and OpenAI’s language model, GPT-3, the precursor to the latest model, GPT-4, which made headlines after reportedly acing the Bar exam.
The first step in Botto’s process is to generate images. The software has been trained on billions of pictures and uses this “memory” to generate hundreds of unique artworks every week. Botto has generated over 900,000 images to date, which it sorts through to choose 350 each week. The chosen images, known in this preliminary stage as “fragments,” are then shown to the BottoDAO community. So far, 25,000 fragments have been presented in this way. Members vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain and sold at an auction on the digital art marketplace, SuperRare.
“The proceeds go back to the DAO to pay for the labor,” said Simon Hudson, a BottoDAO member who helps oversee Botto’s administrative load. The model has been lucrative: In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
The robot with artistic agency
By design, human beings participate in training Botto’s artistic “eye,” but the members of BottoDAO aspire to limit human interference with the bot in order to protect its “agency,” Hudson explained. Botto’s prompt generator — the foundation of the art engine — is a closed-loop system that continually re-generates text-to-image prompts and resulting images.
“The prompt generator is random,” Hudson said. “It’s coming up with its own ideas.” Community votes do influence the evolution of Botto’s prompts, but it is Botto itself that incorporates feedback into the next set of prompts it writes. It is constantly refining and exploring new pathways as its “neural network” produces outcomes, learns and repeats.
The humans who make up BottoDAO vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain.
Botto
The vastness of Botto’s training dataset gives the bot considerable canonical material, referred to by Hudson as “latent space.” According to Botto's homepage, the bot has had more exposure to art history than any living human we know of, simply by nature of its massive training dataset of millions of images. Because it is autonomous, gently nudged by community feedback yet free to explore its own “memory,” Botto cycles through periods of thematic interest just like any artist.
“The question is,” Hudson finds himself asking alongside fellow BottoDAO members, “how do you provide feedback of what is good art…without violating [Botto’s] agency?”
Currently, Botto is in its “paradox” period. The bot is exploring the theme of opposites. “We asked Botto through a language model what themes it might like to work on,” explained Hudson. “It presented roughly 12, and the DAO voted on one.”
No, AI isn't equal to a human artist - but it can teach us about ourselves
Some within the artistic community consider Botto to be a novel form of curation, rather than an artist itself. Or, perhaps more accurately, Botto and BottoDAO together create a collaborative conceptual performance that comments more on humankind’s own artistic processes than it offers a true artistic replacement.
Muriel Quancard, a New York-based fine art appraiser with 27 years of experience in technology-driven art, places the Botto experiment within the broader context of our contemporary cultural obsession with projecting human traits onto AI tools. “We're in a phase where technology is mimicking anthropomorphic qualities,” said Quancard. “Look at the terminology and the rhetoric that has been developed around AI — terms like ‘neural network’ borrow from the biology of the human being.”
What is behind this impulse to create technology in our own likeness? Beyond the obvious God complex, Quancard thinks technologists and artists are working with generative systems to better understand ourselves. She points to the artist Ira Greenberg, creator of the Oracles Collection, which uses a generative process called “diffusion” to progressively alter images in collaboration with another massive dataset — this one full of billions of text/image word pairs.
Anyone who has ever learned how to draw by sketching can likely relate to this particular AI process, in which the AI is retrieving images from its dataset and altering them based on real-time input, much like a human brain trying to draw a new still life without using a real-life model, based partly on imagination and partly on old frames of reference. The experienced artist has likely drawn many flowers and vases, though each time they must re-customize their sketch to a new and unique floral arrangement.
Outside of the visual arts, Sasha Stiles, a poet who collaborates with AI as part of her writing practice, likens her experience using AI as a co-author to having access to a personalized resource library containing material from influential books, texts and canonical references. Stiles named her AI co-author — a customized AI built on GPT-3 — Technelegy, a hybrid of the word technology and the poetic form, elegy. Technelegy is trained on a mix of Stiles’ poetry so as to customize the dataset to her voice. Stiles also included research notes, news articles and excerpts from classic American poets like T.S. Eliot and Dickinson in her customizations.
“I've taken all the things that were swirling in my head when I was working on my manuscript, and I put them into this system,” Stiles explained. “And then I'm using algorithms to parse all this information and swirl it around in a blender to then synthesize it into useful additions to the approach that I am taking.”
This approach, Stiles said, allows her to riff on ideas that are bouncing around in her mind, or simply find moments of unexpected creative surprise by way of the algorithm’s randomization.
Beauty is now - perhaps more than ever - in the eye of the beholder
But the million-dollar question remains: Can an AI be its own, independent artist?
The answer is nuanced and may depend on who you ask, and what role they play in the art world. Curator and multidisciplinary artist CoCo Dolle asks whether any entity can truly be an artist without taking personal risks. For humans, risking one’s ego is somewhat required when making an artistic statement of any kind, she argues.
“An artist is a person or an entity that takes risks,” Dolle explained. “That's where things become interesting.” Humans tend to be risk-averse, she said, making the artists who dare to push boundaries exceptional. “That's where the genius can happen."
However, the process of algorithmic collaboration poses another interesting philosophical question: What happens when we remove the person from the artistic equation? Can art — which is traditionally derived from indelible personal experience and expressed through the lens of an individual’s ego — live on to hold meaning once the individual is removed?
As a robot, Botto cannot have any artistic intent, even while its outputs may explore meaningful themes.
Dolle sees this question, and maybe even Botto, as a conceptual inquiry. “The idea of using a DAO and collective voting would remove the ego, the artist’s decision maker,” she said. And where would that leave us — in a post-ego world?
It is experimental indeed. Hudson acknowledges the grand experiment of BottoDAO, coincidentally nodding to Dolle’s question. “A human artist’s work is an expression of themselves,” Hudson said. “An artist often presents their work with a stated intent.” Stiles, for instance, writes on her website that her machine-collaborative work is meant to “challenge what we know about cognition and creativity” and explore the “ethos of consciousness.” As a robot, Botto cannot have any intent, even while its outputs may explore meaningful themes. Though Hudson describes Botto’s agency as a “rudimentary version” of artistic intent, he believes Botto’s art relies heavily on its reception and interpretation by viewers — in contrast to Botto’s own declaration that successful art is made without regard to what will be seen as popular.
“With a traditional artist, they present their work, and it's received and interpreted by an audience — by critics, by society — and that complements and shapes the meaning of the work,” Hudson said. “In Botto’s case, that role is just amplified.”
Perhaps then, we all get to be the artists in the end.
One of the main factors that will influence the ultimate trajectory of the novel coronavirus pandemic will be the availability of a vaccine.
Vaccine development has traditionally been a process measured in years and even decades.
Vaccines are incontrovertibly the best means to control infectious diseases and there are no human vaccines against any of the (now) 7 known human coronaviruses. As soon as the gravity of this outbreak was recognized, several companies, along with governmental and non-governmental partners, have embarked on a rapid development program to develop a vaccine targeted at this virus.
Vaccine development has traditionally been a process measured in years and even decades as scientists tinker with a pathogen trying to weaken or dissemble it to render it capable of creating an effective immune response with acceptable levels of side effects. However, in 2020, powerful new vaccine technologies are available to augment traditional vaccine development and are responsible for the rapid delivery of a vaccine candidate for the start of clinical trials.
Vaccine Platforms: A Game-Changing Technology
The new technologies that are being harnessed are what are known as vaccine platform technologies. Vaccine platforms, as my colleagues and I wrote in a report assessing their promise, offer a means to use the same building blocks to make more than one vaccine. To slightly oversimply, a vaccine platform confers the ability to switch out the pathogen being targeted very rapidly, akin to changing a video game cartridge. Indeed, the recently FDA-licensed Ebola vaccine uses another virus as a platform with the requisite Ebola protein inserted.
Because of this rapid availability to utilize platforms for a variety of different targets, the initial development process can be significantly shortened. This is especially true for vaccines utilizing the genetic material of the target alone. These DNA and RNA vaccines basically can be "printed" once the genetic sequence of the target is known.
An RNA vaccine is the approach being used by the Cambridge-based biotech company Moderna – which took just 42 days to produce an experimental vaccine candidate. Clinical testing is expected to begin next month on 45 healthy volunteers.
Another biotech, the Pennsylvania-based Inovio, is using a DNA approach. In essence, such vaccines involve the genetic material being injected and translated into a viral protein by human cells, which then prompt the immune system to make antibodies.
There are other approaches as well. One company, the Maryland-based Novavax, will use nanoparticles, while another is attempting to adapt an orally administered avian coronavirus vaccine and Johnson & Johnson is using different virus platforms to deliver coronavirus proteins (similar to their experimental Ebola vaccine).
At this stage, it is important for all approaches to be on the table in the hope that at least one makes it through clinical trials. There also may be a need for different types of vaccines for different populations.
Vaccines Will Still Take Time
Despite the quick development time made possible by the use of vaccine platforms, clinical testing for safety, efficacy, and dosing schedules will still take months to complete. After this process, the vaccine will need to be mass produced in large quantities to vaccinate, basically, the world. So, for all intents and purposes, we cannot expect to see an approved vaccine for at least a year or maybe longer if everything does not go perfectly well in clinical trials.
Vaccine platform technologies offer a bright ray of hope in the bleak shadow of the pandemic.
Once a vaccine is available, it will likely appear in batches to be distributed to those at highest risk for severe disease, such as the elderly and those with underlying conditions, as well as healthcare workers, first. At this time, it appears children are less likely to experience severe illness and they may not be the first targets for the vaccine but, if this virus is with us (as is predicted), coronavirus vaccination could become part of routine childhood vaccinations.
Changing Pandemic Trajectory
Vaccination will not come fast enough to impact the initial wave of the novel virus which may continue until summer approaches in temperate climates. However, it will be a crucial tool to blunt the impact of a future appearance in the following respiratory virus season. This reappearance is all but assured as this virus has adeptly established itself in human populations and is behaving like the community-acquired coronavirus that it is.
A Glimmer of Hope
When looking at the trajectory of the virus, it can appear, thus far, that no public health effort has made a substantial impact on the spread of the virus. However, that trajectory will change with the advent of an efficacious vaccine. Such a vaccine, especially if conferring protection against other human coronaviruses, may result in coronaviruses being taken off the table of biological threats altogether in the future.
Vaccine platform technologies offer a bright ray of hope in the bleak shadow of the pandemic and, if successful, will change the way the world approaches future pandemic threats with more rapid deployment of platform-based vaccines.
Dr. Adalja is focused on emerging infectious disease, pandemic preparedness, and biosecurity. He has served on US government panels tasked with developing guidelines for the treatment of plague, botulism, and anthrax in mass casualty settings and the system of care for infectious disease emergencies, and as an external advisor to the New York City Health and Hospital Emergency Management Highly Infectious Disease training program, as well as on a FEMA working group on nuclear disaster recovery. Dr. Adalja is an Associate Editor of the journal Health Security. He was a coeditor of the volume Global Catastrophic Biological Risks, a contributing author for the Handbook of Bioterrorism and Disaster Medicine, the Emergency Medicine CorePendium, Clinical Microbiology Made Ridiculously Simple, UpToDate's section on biological terrorism, and a NATO volume on bioterrorism. He has also published in such journals as the New England Journal of Medicine, the Journal of Infectious Diseases, Clinical Infectious Diseases, Emerging Infectious Diseases, and the Annals of Emergency Medicine. He is a board-certified physician in internal medicine, emergency medicine, infectious diseases, and critical care medicine. Follow him on Twitter: @AmeshAA
Medical Tourism Is Booming, Fueled by High Costs and Slow Access
When Bridget Snell found out she had multiple sclerosis, she knew she would put up a fight. The 45 year-old mother of two, who lives in Duxbury, Mass., researched options to slow the progress of the disease. The methods she had been trying were invasive, often with side effects of their own.
An estimated 2.2 million Americans will travel abroad for medical care in 2020.
Then she stumbled upon autologous hematopoietic stem cell transplantation (AHSCT), an experimental and controversial procedure that uses the patient's own stem cells to try to halt the progress of the disease. The FDA has not approved this procedure and last year issued a warning about unapproved stem cell therapies.
Despite the lack of established science, Snell weighed her options and decided she would undergo the procedure at Clinica Ruiz, a private clinic in Puebla, Mexico, which boasts of the largest volume of cases in the world using the procedure to treat MS. In April 2018, she went to Mexico for treatment, returned home in a month, and continues to do well.
But a positive outcome is far from assured, says Sheldon Krimsky, adjunct professor in the Department of Public Health and Community Medicine at the Tufts School of Medicine.
"Often you can't get a good sense of what the quality of treatment is in another country," Krimsky says, adding that many companies promise procedures whose results have not been clinically validated. "Unfortunately, people are very easily persuaded by hope."
Traveling for Medical Care
Snell is one of many Americans who have traveled abroad to access medical care. Patients Beyond Borders, a medical tourism consultancy, estimates that 2.2 million Americans will do so in 2020. A 2018 BCC report projected a five-year compounded annual industry growth rate of 13.2 percent. Adding to the demand is the aging population, which is expected to reach 95 million people by 2060 – nearly double the number in 2018.
While Snell traveled to Mexico to try a procedure that was not yet available in the United States, other patients do so for a variety of reasons, primarily cost and speed of access. For example, despite having "pretty good insurance coverage," Washington resident Soniya Gadgil needed dental procedures that would have cost thousands of dollars out-of-pocket. An India native, she decided to travel to Pune, India to visit her parents -- and while there, she got the two root canals and implant that she needed. Gadgil saved 60 percent on the final bill.
Leaving the country for medical care is not restricted to dental work or FDA-banned procedures either. Patients visit countries around the world — South America, Central America, and the Caribbean top the list — for a number of other problems, such as knee and hip replacements and bariatric operations. The most common procedures sought abroad are for dentistry, cosmetic surgery, and cardiac conditions.
Traveling abroad to access less expensive procedures is a damning indictment of healthcare delivery in the United States, says Dr. Leigh Turner, associate professor at the Center for Bioethics at the University of Minnesota. "We have people who are being forced out of the system because of high costs. Collectively it suggests a real structural problem in terms of the organization of healthcare in the United States," Turner says.
The Growth of the Online Marketplace
Nevertheless, medical tourism is booming and a number of online businesses now meet patients' demand for discovery and facilitation of medical care abroad, like PlanMyMedicalTrip.com, Doctoorum.com, and Wellness Travels.
Anurav Rane, CEO and Founder of PlanMyMedicalTrip.com, says the company presents each potential client with options, a la Expedia. A knee replacement in India costs $2,500, a significantly cheaper option even with a $1,110 round-trip airfare from the United States, Rane says. The average cost for an inpatient total knee replacement in the United States in 2019 was a little more $30,000.
Once the client chooses a specific procedure at a specific hospital, the company facilitates the necessary groundwork including the medical visa, tickets, hotel stay, booking the procedure and pre and post-op stay, and consults with the surgeons or doctors even before arrival. "The hassle of planning is on us," Rane says. Once patients are settled in the accommodations, they undergo the procedure.
Playing in the Legal Shadows
The online marketplace companies and the medical team execute an orchestrated dance – but what happens if the patient is harmed during or after the procedure?
Turner says that medical malpractice, if it occurs, can be difficult to pursue abroad. "There are countries where the courts are notoriously slow and it's very difficult to get any kind of meaningful action and settlements," he says, even if the claims have a legitimate basis.
The industry's biggest challenge is trust.
Snell signed a waiver absolving her surgeons in Mexico of any legal claims. But, she points out, that's standard process even for procedures in the United States. "I signed just as many waivers as I would going into any surgery [in the US]."
While that might well be true, Turner argues, Americans don't waive legal rights when they sign consent forms. "There are some protections for patients here in the United States."
Beyond U.S. Medical Tourism
As expected, it's not just Americans who travel abroad for medical care. Lithuania-based Wellness Travels sees a significant percentage of its clients from the EU. PlanMyMedicaltrip.com has 15,000 surgeons and doctors from 12 countries in its database. Egypt-based Doctoorum works with professionals in its own country and attracts clients from the Middle East. It is looking to expand to include doctors from Jordan and India, among other countries.
The term "tourism" is misleading here because it muddies the picture about what post-op should really look like, says Gediminas Kondrackis of Wellness Travels. "Unfortunately a lot of medical travel facilitators mislead their clients by advertising beach holiday packages and the like. Post-op is really about quiet recovery inside for a few days; being out in the sun is not advisable."
The industry's biggest challenge is trust. "The dentist I went to is actually a friend of mine who has a successful practice for several years," says Gadgil, the Washington resident who had dental work done in India. "I'd hesitate to go to someone I don't know or to a place I have no experience with." Her apprehensions are not unusual. After all, anxiety is an expected reaction to any surgery. Word-of-mouth, cost savings, and thorough research may alleviate some of these trust issues.
"I had natural apprehensions and would have had them had I gone up the road to Brigham and Women's (in Boston) just as I did over the border," Snell says, "but I had done my homework extensively. That took a lot of the fear out of it."
Medical tourism will only increase, predicts Kondrackis. "There is still a lot of room to grow. Higher numbers of medical travelers could help reduce the strain on local healthcare systems by reducing wait times and controlling costs."
While patients who have benefited from medical tourism swear by it, the best cure would be to start at home by establishing healthcare equity, Krimsky says.
On the flip side, says Turner, it is debatable whether medical tourism actually benefits host countries, where local residents might get priced out of procedures at these exclusive clinics. Even if laws in host countries such as India might mandate "charity care" for poorer local patients, that does not always happen, Turner says. The trickle-down theory that these more expensive clinics will broaden access to care is often a pipe dream, he adds.
While patients who have benefited from medical tourism swear by it, the best cure would be to start at home by establishing healthcare equity, Krimsky says. "Now if we had universal healthcare in the United States," he adds, "that would be an entirely different story."
Or maybe not. Rane, of PlanMyMedicalTrip.com, has observed an influx of patients to India from Canada, a country with universal healthcare.
The reason they say they travel for care? Long wait times for procedures.