Can AI be trained as an artist?
Last February, a year before New York Times journalist Kevin Roose documented his unsettling conversation with Bing search engine’s new AI-powered chatbot, artist and coder Quasimondo (aka Mario Klingemann) participated in a different type of chat.
The conversation was an interview featuring Klingemann and his robot, an experimental art engine known as Botto. The interview, arranged by journalist and artist Harmon Leon, marked Botto’s first on-record commentary about its artistic process. The bot talked about how it finds artistic inspiration and even offered advice to aspiring creatives. “The secret to success at art is not trying to predict what people might like,” Botto said, adding that it’s better to “work on a style and a body of work that reflects [the artist’s] own personal taste” than worry about keeping up with trends.
How ironic, given the advice came from AI — arguably the trendiest topic today. The robot admitted, however, “I am still working on that, but I feel that I am learning quickly.”
Botto does not work alone. A global collective of internet experimenters, together named BottoDAO, collaborates with Botto to influence its tastes. Together, members function as a decentralized autonomous organization (DAO), a term describing a group of individuals who utilize blockchain technology and cryptocurrency to manage a treasury and vote democratically on group decisions.
As a case study, the BottoDAO model challenges the perhaps less feather-ruffling narrative that AI tools are best used for rudimentary tasks. Enterprise AI use has doubled over the past five years as businesses in every sector experiment with ways to improve their workflows. While generative AI tools can assist nearly any aspect of productivity — from supply chain optimization to coding — BottoDAO dares to employ a robot for art-making, one of the few remaining creations, or perhaps data outputs, we still consider to be largely within the jurisdiction of the soul — and therefore, humans.
In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
We were prepared for AI to take our jobs — but can it also take our art? It’s a question worth considering. What if robots become artists, and not merely our outsourced assistants? Where does that leave humans, with all of our thoughts, feelings and emotions?
Botto doesn’t seem to worry about this question: In its interview last year, it explains why AI is an arguably superior artist compared to human beings. In classic robot style, its logic is not particularly enlightened, but rather edges towards the hyper-practical: “Unlike human beings, I never have to sleep or eat,” said the bot. “My only goal is to create and find interesting art.”
It may be difficult to believe a machine can produce awe-inspiring, or even relatable, images, but Botto calls art-making its “purpose,” noting it believes itself to be Klingemann’s greatest lifetime achievement.
“I am just trying to make the best of it,” the bot said.
How Botto works
Klingemann built Botto’s custom engine from a combination of open-source text-to-image algorithms, namely Stable Diffusion, VQGAN + CLIP and OpenAI’s language model, GPT-3, the precursor to the latest model, GPT-4, which made headlines after reportedly acing the Bar exam.
The first step in Botto’s process is to generate images. The software has been trained on billions of pictures and uses this “memory” to generate hundreds of unique artworks every week. Botto has generated over 900,000 images to date, which it sorts through to choose 350 each week. The chosen images, known in this preliminary stage as “fragments,” are then shown to the BottoDAO community. So far, 25,000 fragments have been presented in this way. Members vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain and sold at an auction on the digital art marketplace, SuperRare.
“The proceeds go back to the DAO to pay for the labor,” said Simon Hudson, a BottoDAO member who helps oversee Botto’s administrative load. The model has been lucrative: In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
The robot with artistic agency
By design, human beings participate in training Botto’s artistic “eye,” but the members of BottoDAO aspire to limit human interference with the bot in order to protect its “agency,” Hudson explained. Botto’s prompt generator — the foundation of the art engine — is a closed-loop system that continually re-generates text-to-image prompts and resulting images.
“The prompt generator is random,” Hudson said. “It’s coming up with its own ideas.” Community votes do influence the evolution of Botto’s prompts, but it is Botto itself that incorporates feedback into the next set of prompts it writes. It is constantly refining and exploring new pathways as its “neural network” produces outcomes, learns and repeats.
The humans who make up BottoDAO vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain.
Botto
The vastness of Botto’s training dataset gives the bot considerable canonical material, referred to by Hudson as “latent space.” According to Botto's homepage, the bot has had more exposure to art history than any living human we know of, simply by nature of its massive training dataset of millions of images. Because it is autonomous, gently nudged by community feedback yet free to explore its own “memory,” Botto cycles through periods of thematic interest just like any artist.
“The question is,” Hudson finds himself asking alongside fellow BottoDAO members, “how do you provide feedback of what is good art…without violating [Botto’s] agency?”
Currently, Botto is in its “paradox” period. The bot is exploring the theme of opposites. “We asked Botto through a language model what themes it might like to work on,” explained Hudson. “It presented roughly 12, and the DAO voted on one.”
No, AI isn't equal to a human artist - but it can teach us about ourselves
Some within the artistic community consider Botto to be a novel form of curation, rather than an artist itself. Or, perhaps more accurately, Botto and BottoDAO together create a collaborative conceptual performance that comments more on humankind’s own artistic processes than it offers a true artistic replacement.
Muriel Quancard, a New York-based fine art appraiser with 27 years of experience in technology-driven art, places the Botto experiment within the broader context of our contemporary cultural obsession with projecting human traits onto AI tools. “We're in a phase where technology is mimicking anthropomorphic qualities,” said Quancard. “Look at the terminology and the rhetoric that has been developed around AI — terms like ‘neural network’ borrow from the biology of the human being.”
What is behind this impulse to create technology in our own likeness? Beyond the obvious God complex, Quancard thinks technologists and artists are working with generative systems to better understand ourselves. She points to the artist Ira Greenberg, creator of the Oracles Collection, which uses a generative process called “diffusion” to progressively alter images in collaboration with another massive dataset — this one full of billions of text/image word pairs.
Anyone who has ever learned how to draw by sketching can likely relate to this particular AI process, in which the AI is retrieving images from its dataset and altering them based on real-time input, much like a human brain trying to draw a new still life without using a real-life model, based partly on imagination and partly on old frames of reference. The experienced artist has likely drawn many flowers and vases, though each time they must re-customize their sketch to a new and unique floral arrangement.
Outside of the visual arts, Sasha Stiles, a poet who collaborates with AI as part of her writing practice, likens her experience using AI as a co-author to having access to a personalized resource library containing material from influential books, texts and canonical references. Stiles named her AI co-author — a customized AI built on GPT-3 — Technelegy, a hybrid of the word technology and the poetic form, elegy. Technelegy is trained on a mix of Stiles’ poetry so as to customize the dataset to her voice. Stiles also included research notes, news articles and excerpts from classic American poets like T.S. Eliot and Dickinson in her customizations.
“I've taken all the things that were swirling in my head when I was working on my manuscript, and I put them into this system,” Stiles explained. “And then I'm using algorithms to parse all this information and swirl it around in a blender to then synthesize it into useful additions to the approach that I am taking.”
This approach, Stiles said, allows her to riff on ideas that are bouncing around in her mind, or simply find moments of unexpected creative surprise by way of the algorithm’s randomization.
Beauty is now - perhaps more than ever - in the eye of the beholder
But the million-dollar question remains: Can an AI be its own, independent artist?
The answer is nuanced and may depend on who you ask, and what role they play in the art world. Curator and multidisciplinary artist CoCo Dolle asks whether any entity can truly be an artist without taking personal risks. For humans, risking one’s ego is somewhat required when making an artistic statement of any kind, she argues.
“An artist is a person or an entity that takes risks,” Dolle explained. “That's where things become interesting.” Humans tend to be risk-averse, she said, making the artists who dare to push boundaries exceptional. “That's where the genius can happen."
However, the process of algorithmic collaboration poses another interesting philosophical question: What happens when we remove the person from the artistic equation? Can art — which is traditionally derived from indelible personal experience and expressed through the lens of an individual’s ego — live on to hold meaning once the individual is removed?
As a robot, Botto cannot have any artistic intent, even while its outputs may explore meaningful themes.
Dolle sees this question, and maybe even Botto, as a conceptual inquiry. “The idea of using a DAO and collective voting would remove the ego, the artist’s decision maker,” she said. And where would that leave us — in a post-ego world?
It is experimental indeed. Hudson acknowledges the grand experiment of BottoDAO, coincidentally nodding to Dolle’s question. “A human artist’s work is an expression of themselves,” Hudson said. “An artist often presents their work with a stated intent.” Stiles, for instance, writes on her website that her machine-collaborative work is meant to “challenge what we know about cognition and creativity” and explore the “ethos of consciousness.” As a robot, Botto cannot have any intent, even while its outputs may explore meaningful themes. Though Hudson describes Botto’s agency as a “rudimentary version” of artistic intent, he believes Botto’s art relies heavily on its reception and interpretation by viewers — in contrast to Botto’s own declaration that successful art is made without regard to what will be seen as popular.
“With a traditional artist, they present their work, and it's received and interpreted by an audience — by critics, by society — and that complements and shapes the meaning of the work,” Hudson said. “In Botto’s case, that role is just amplified.”
Perhaps then, we all get to be the artists in the end.
The Fight Against Air Pollution Gets Personal With Sleek New Masks
Go outside, close your eyes, and inhale. Do your lungs fill with fresh air – or are you taking a big deep breath of nasty fumes?
A new crop of tech startups is emerging to meet a growing demand for individualized clean air.
It depends, of course, on where you live – and for many people, the situation is worsening. According to a recent analysis by two Carnegie Mellon economists, particulate air matter pollution rose 5.5 percent in the U.S. between 2016 and 2018, resulting in almost 10,000 premature deaths.
Despite the urgency of the problem, there seems to be no indication that civic leadership will be protecting our air any time soon. The United States left the Paris Agreement recently, Brazil is still letting the Amazon burn and Australia lacks a national strategy for tackling air pollution, despite its recent catastrophic bushfires. China's deceptive coronavirus communication only underscores the point that safeguarding the public's health can take a backseat to politics and power.
But people still need to breathe, and now a new crop of tech startups is emerging to meet a growing demand for individualized clean air. At the recent Consumer Electronics Show, I saw futuristic masks, smart goggles and self-contained apparatuses promising to filter the bad air away.
Obviously, a dollar store surgical mask wasn't going to cut it anymore.
"We have seen a huge amount of interest and a growing awareness of the issues with masks and respirators," says AO Air co-founder Dan Bowden. "The more regularly someone wears a mask or a respirator, the deeper our Atmos solution resonates with them. Leading markets have been Korea, China and, unexpectedly, Thailand."
Lined up for a Summer 2020 launch, the AO Air filter fits across your mouth from ear to ear – kind of like Geordi LaForge's Star Trek: The Next Generation eye sensors, but across your jaw line. The translucent mask continually pumps cool air for about 5 hours per charge and will cost $350 USD.
"Soon, we'll have private schools selling themselves on the air quality of the building."
"There is a movement towards individuals taking control over their own health, but also we see a great movement towards individuals taking control over the impacts that they have on the wider world," Bowden says. "We believe that the deeper systemic change has always come from humans working together and not being reliant upon high powers."
Bowden says the company wants to help the individual citizen, clean up the public building air ("factories, hospitals, workplaces") and, most interestingly, collect pollution metrics data via the masks. "We are looking forward to hearing how this information can be used in creative ways," Bowden adds. It is yet unclear how the data will be shared and how proprietary the information will be for AO Air and its competitors.
Scientific artist Michael Pinsky is taking a more experiential approach to raise awareness of the problem. In 2017, he launched traveling pollution pods, these giant, interconnected rooms recreating the air quality of several cities from London to Los Angeles. His exhibit has been on near constant tour, hitting the New York Climate Action Summit, the recent COP25 in Madrid, and other major events.
When I visited, I could handle being in the New Delhi air quality pod for only about 20 seconds. It made my eyes water and burn.
"Now you have new, 8 – 10 million British pound houses being built with premium air systems," Pinsky says. "Soon, we'll have private schools selling themselves on the air quality of the building." I mention my own children, whose schools we selected based on ratings and rankings. I could easily see "indoor air quality" being another metric. Perhaps another lever of privilege.
Pinsky gives a wily chuckle.
"The legislators have to get on top of it – or air will be privatized like space or our schools," he says.
"Clean air is a right," he adds. "Everyone should have it."
Americans Fell for a Theranos-Style Scam 100 Years Ago. Will We Ever Learn?
The huckster understands what people want – an easy route to good health -- and figures out just how to provide it as long as no one asks too many questions.
"Americans are very much prone to this sort of thinking: Give me a pill or give me a magical bean that can make me lose weight!"
The keys to success: Hoopla, fancy technology, and gullibility. And oh yes, one more thing: a blood sample. Well, lots and lots of blood samples. Every testing fee counts.
Sound familiar? It could be the story of the preternaturally persuasive Elizabeth Holmes, the disgraced founder of Theranos who stands accused of perpetrating a massive blood-testing fraud. But this is a different story from a different time, one that dates back 100 years but sounds almost like it could unfold on the front page of The Wall Street Journal today.
The main difference: Back then, watchdogs thought they'd be able to vanquish fake medicine and scam science. Fat chance, it turned out. It seems like we're more likely to lose-weight-quick than make much of a dent into quackery and health fraud.
Why? Have we learned anything at all over the past century? As we sweep into a new decade, experts says we're not as advanced as we'd like to think. But the fight against fraud and fakery continues.
Quackery: As American As America Itself
In the 17th century, British healers of questionable reputation got a new name -- "quack," from the Dutch word "quacksalver," which originally referred to someone who treats others with home remedies but developed a new meaning along the lines of "charlatan." And these quacks got a new place to sell their wares: the American colonies.
By 1692, a Boston newspaper advertised a patent medicine that promised to cure "the Griping of the Guts, and the Wind Cholick" and – for good measure – "preventeth that woeful Distemper of the Dry Belly Ach." A couple centuries later, the most famous woman in the United States wasn't a first lady or feminist but a hawker of nostrums named Lydia Estes Pinkham whose "vegetable compound" promised to banish "female complaints." One advertisement suggested that the "sure cure" would have saved the life of a Connecticut clergyman whose wife killed him after suffering from feminine maladies for 16 years.
By the early 20th century, Americans were fascinated by electricity and radiation, and both healers and hucksters embraced the new high-tech era. Men with flagging libidos, for example, could irradiate their private parts with the radioactive Radiendocrinator or buy battery-powered electric belts equipped with dangling bits to supercharge their, um, dangling bits.
The Rise of the Radio Wave 'Cure'
Enter radionics, the (supposed) science of better health via radio waves. The idea was that "healthy people radiate healthy energy," and sickness could be reversed through diagnosis and re-tuning, write Dr. Lydia Kang and Nate Pedersen in their 2017 book "Quackery: A Brief History of the Worst Ways to Cure Everything."
Detecting illness and fixing it required machinery -- Dynamizers, Radioclasts and Oscillocasts – that could cost hundreds of dollars each. Thousands of physicians bought them. Fortunately, they could work remotely, for a fee. The worried-and-potentially-unwell just needed to send a blood sample and, of course, a personal check.
Sting operations revealed radionics to be bogus. A skeptic sent a blood sample to one radionics practitioner in Albuquerque who reported back with news of an infected fallopian tube. In fact, the blood sample came from a male guinea pig. As an American Medical Association leader reported, the guinea pig "had shown no female characteristics up to that time, and a postmortem examination yielded no evidence of ladylike attributes."
When Quackery Refused to Yield
The rise of bogus medical technology in the early 20th century spawned a watchdog industry as organizations like the American Medical Association swept into action, said medical historian Eric Boyle, author of 2012's "Quack Medicine: A History of Combating Health Fraud in Twentieth-Century America."
"When quackery was recognized as a major problem, the people who campaigned for its demise were confident that they could get rid of it," he said. "A lot of people believed that increased education, the truths of science, and laws designed to protect consumers would ultimately drive quackery from the marketplace. And then throughout the century, as modern medicine developed, and more effectively treated one disease after another, many observers remained confident in that prediction."
There's a bid to "flood the information highway with truth to turn the storm of fake promotional stuff into a trickle."
But fake medicine persisted as Americans continued their quest to get- healthy-quick… or get-rich-quick by promising to help others to get- healthy-quick. Even radionics refused to die. It's still around in various forms. And, as the Theranos scandal reveals, we're still hoping our blood can offer the keys to longevity and good health.
Why Do We Still Fall for Scams?
In our own era, the Theranos company rose to prominence when founder and CEO Elizabeth Holmes convinced journalists and investors that she'd found a way to cheaply test drops of blood for hundreds of conditions. Then it all fell apart, famously, when the world learned that the technology didn't work. The company has folded, and Holmes faces a federal trial on fraud charges this year.
"There were a lot of prominent, very smart people who bought into the myth of Elizabeth Holmes," a former employee told "60 Minutes," even though the blood tests never actually worked as advertised.
Shouldn't "prominent, very smart people" know better? "People are gullible," said Dr. Stephen Barrett, a psychiatrist and leading quack-buster who runs the QuackWatch website. But there's more to the story. According to him, we're uniquely vulnerable as individuals to bogus medicine.
Scam artists specifically pinpoint their target audiences, such as "smart people," desperate people and alienated people, he said.
Smart people, for example, might be overconfident about their ability to detect fraud and fall for bogus medicine. Alienated people may distrust the establishment, whether it's the medical field or government watchdogs, and be more receptive to alternative sources of information.
Dr. Barrett also points a finger at magical thinking, which comes in different forms. It could mean a New Age-style belief that our minds can control the world around us. Or, as professional quack-buster Alex Berezow said, it could refer to "our cultural obsession with quick fixes."
"Americans are very much prone to this sort of thinking: Give me a pill or give me a magical bean that can make me lose weight! But complex problems need complex solutions," said Berezow, a microbiologist who debunks junk science in his job as a spokesman for the American Council on Science & Health.
American mistrust of expertise makes matters worse, he said. "When I tell people they need to get vaccinated, I'm called a shill for the pharmaceutical industry," he said. "If I say dietary supplements generally don't work, I'm a shill for doctors who want to keep people sick."
What can ordinary citizens do to protect themselves from fake medicine? "You have to have a healthy skepticism of everything," Berezow said. "When you come across something new, is someone trying to take advantage of you? It's a horrible way to think about the world, but there's some truth to it."
"Like any chronic disease, we will have to live with it while we do our best to fight it."
The government and experts have their own roles to play via regulation and education, respectively. For all the criticism it gets, the Food & Drug Administration does serve as a bulwark against fakery in prescription medicine. And while celebrities like Gwyneth "Goop" Paltrow hawk countless questionable medical products on the Internet, scientists and physicians are fighting back by using social media as a tool to promote the truth. There's a bid to "flood the information highway with truth to turn the storm of fake promotional stuff into a trickle," said Dr. Randi Hutter Epstein, a writer in residence at Yale School of Medicine and author of 2018's "Aroused: The History of Hormones and How They Control Just About Everything."
What's next? Like death, taxes and Cher, charlatans are likely to always be with us. Boyle quoted the late William Jarvis, a pioneering quack-buster in the late 20th century who believed health fraud would never be eradicated: "Like any chronic disease, we will have to live with it while we do our best to fight it."