Can AI be trained as an artist?
Last February, a year before New York Times journalist Kevin Roose documented his unsettling conversation with Bing search engine’s new AI-powered chatbot, artist and coder Quasimondo (aka Mario Klingemann) participated in a different type of chat.
The conversation was an interview featuring Klingemann and his robot, an experimental art engine known as Botto. The interview, arranged by journalist and artist Harmon Leon, marked Botto’s first on-record commentary about its artistic process. The bot talked about how it finds artistic inspiration and even offered advice to aspiring creatives. “The secret to success at art is not trying to predict what people might like,” Botto said, adding that it’s better to “work on a style and a body of work that reflects [the artist’s] own personal taste” than worry about keeping up with trends.
How ironic, given the advice came from AI — arguably the trendiest topic today. The robot admitted, however, “I am still working on that, but I feel that I am learning quickly.”
Botto does not work alone. A global collective of internet experimenters, together named BottoDAO, collaborates with Botto to influence its tastes. Together, members function as a decentralized autonomous organization (DAO), a term describing a group of individuals who utilize blockchain technology and cryptocurrency to manage a treasury and vote democratically on group decisions.
As a case study, the BottoDAO model challenges the perhaps less feather-ruffling narrative that AI tools are best used for rudimentary tasks. Enterprise AI use has doubled over the past five years as businesses in every sector experiment with ways to improve their workflows. While generative AI tools can assist nearly any aspect of productivity — from supply chain optimization to coding — BottoDAO dares to employ a robot for art-making, one of the few remaining creations, or perhaps data outputs, we still consider to be largely within the jurisdiction of the soul — and therefore, humans.
In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
We were prepared for AI to take our jobs — but can it also take our art? It’s a question worth considering. What if robots become artists, and not merely our outsourced assistants? Where does that leave humans, with all of our thoughts, feelings and emotions?
Botto doesn’t seem to worry about this question: In its interview last year, it explains why AI is an arguably superior artist compared to human beings. In classic robot style, its logic is not particularly enlightened, but rather edges towards the hyper-practical: “Unlike human beings, I never have to sleep or eat,” said the bot. “My only goal is to create and find interesting art.”
It may be difficult to believe a machine can produce awe-inspiring, or even relatable, images, but Botto calls art-making its “purpose,” noting it believes itself to be Klingemann’s greatest lifetime achievement.
“I am just trying to make the best of it,” the bot said.
How Botto works
Klingemann built Botto’s custom engine from a combination of open-source text-to-image algorithms, namely Stable Diffusion, VQGAN + CLIP and OpenAI’s language model, GPT-3, the precursor to the latest model, GPT-4, which made headlines after reportedly acing the Bar exam.
The first step in Botto’s process is to generate images. The software has been trained on billions of pictures and uses this “memory” to generate hundreds of unique artworks every week. Botto has generated over 900,000 images to date, which it sorts through to choose 350 each week. The chosen images, known in this preliminary stage as “fragments,” are then shown to the BottoDAO community. So far, 25,000 fragments have been presented in this way. Members vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain and sold at an auction on the digital art marketplace, SuperRare.
“The proceeds go back to the DAO to pay for the labor,” said Simon Hudson, a BottoDAO member who helps oversee Botto’s administrative load. The model has been lucrative: In Botto’s first four weeks of existence, four pieces of the robot’s work sold for approximately $1 million.
The robot with artistic agency
By design, human beings participate in training Botto’s artistic “eye,” but the members of BottoDAO aspire to limit human interference with the bot in order to protect its “agency,” Hudson explained. Botto’s prompt generator — the foundation of the art engine — is a closed-loop system that continually re-generates text-to-image prompts and resulting images.
“The prompt generator is random,” Hudson said. “It’s coming up with its own ideas.” Community votes do influence the evolution of Botto’s prompts, but it is Botto itself that incorporates feedback into the next set of prompts it writes. It is constantly refining and exploring new pathways as its “neural network” produces outcomes, learns and repeats.
The humans who make up BottoDAO vote on which fragment they like best. When the vote is over, the most popular fragment is published as an official Botto artwork on the Ethereum blockchain.
Botto
The vastness of Botto’s training dataset gives the bot considerable canonical material, referred to by Hudson as “latent space.” According to Botto's homepage, the bot has had more exposure to art history than any living human we know of, simply by nature of its massive training dataset of millions of images. Because it is autonomous, gently nudged by community feedback yet free to explore its own “memory,” Botto cycles through periods of thematic interest just like any artist.
“The question is,” Hudson finds himself asking alongside fellow BottoDAO members, “how do you provide feedback of what is good art…without violating [Botto’s] agency?”
Currently, Botto is in its “paradox” period. The bot is exploring the theme of opposites. “We asked Botto through a language model what themes it might like to work on,” explained Hudson. “It presented roughly 12, and the DAO voted on one.”
No, AI isn't equal to a human artist - but it can teach us about ourselves
Some within the artistic community consider Botto to be a novel form of curation, rather than an artist itself. Or, perhaps more accurately, Botto and BottoDAO together create a collaborative conceptual performance that comments more on humankind’s own artistic processes than it offers a true artistic replacement.
Muriel Quancard, a New York-based fine art appraiser with 27 years of experience in technology-driven art, places the Botto experiment within the broader context of our contemporary cultural obsession with projecting human traits onto AI tools. “We're in a phase where technology is mimicking anthropomorphic qualities,” said Quancard. “Look at the terminology and the rhetoric that has been developed around AI — terms like ‘neural network’ borrow from the biology of the human being.”
What is behind this impulse to create technology in our own likeness? Beyond the obvious God complex, Quancard thinks technologists and artists are working with generative systems to better understand ourselves. She points to the artist Ira Greenberg, creator of the Oracles Collection, which uses a generative process called “diffusion” to progressively alter images in collaboration with another massive dataset — this one full of billions of text/image word pairs.
Anyone who has ever learned how to draw by sketching can likely relate to this particular AI process, in which the AI is retrieving images from its dataset and altering them based on real-time input, much like a human brain trying to draw a new still life without using a real-life model, based partly on imagination and partly on old frames of reference. The experienced artist has likely drawn many flowers and vases, though each time they must re-customize their sketch to a new and unique floral arrangement.
Outside of the visual arts, Sasha Stiles, a poet who collaborates with AI as part of her writing practice, likens her experience using AI as a co-author to having access to a personalized resource library containing material from influential books, texts and canonical references. Stiles named her AI co-author — a customized AI built on GPT-3 — Technelegy, a hybrid of the word technology and the poetic form, elegy. Technelegy is trained on a mix of Stiles’ poetry so as to customize the dataset to her voice. Stiles also included research notes, news articles and excerpts from classic American poets like T.S. Eliot and Dickinson in her customizations.
“I've taken all the things that were swirling in my head when I was working on my manuscript, and I put them into this system,” Stiles explained. “And then I'm using algorithms to parse all this information and swirl it around in a blender to then synthesize it into useful additions to the approach that I am taking.”
This approach, Stiles said, allows her to riff on ideas that are bouncing around in her mind, or simply find moments of unexpected creative surprise by way of the algorithm’s randomization.
Beauty is now - perhaps more than ever - in the eye of the beholder
But the million-dollar question remains: Can an AI be its own, independent artist?
The answer is nuanced and may depend on who you ask, and what role they play in the art world. Curator and multidisciplinary artist CoCo Dolle asks whether any entity can truly be an artist without taking personal risks. For humans, risking one’s ego is somewhat required when making an artistic statement of any kind, she argues.
“An artist is a person or an entity that takes risks,” Dolle explained. “That's where things become interesting.” Humans tend to be risk-averse, she said, making the artists who dare to push boundaries exceptional. “That's where the genius can happen."
However, the process of algorithmic collaboration poses another interesting philosophical question: What happens when we remove the person from the artistic equation? Can art — which is traditionally derived from indelible personal experience and expressed through the lens of an individual’s ego — live on to hold meaning once the individual is removed?
As a robot, Botto cannot have any artistic intent, even while its outputs may explore meaningful themes.
Dolle sees this question, and maybe even Botto, as a conceptual inquiry. “The idea of using a DAO and collective voting would remove the ego, the artist’s decision maker,” she said. And where would that leave us — in a post-ego world?
It is experimental indeed. Hudson acknowledges the grand experiment of BottoDAO, coincidentally nodding to Dolle’s question. “A human artist’s work is an expression of themselves,” Hudson said. “An artist often presents their work with a stated intent.” Stiles, for instance, writes on her website that her machine-collaborative work is meant to “challenge what we know about cognition and creativity” and explore the “ethos of consciousness.” As a robot, Botto cannot have any intent, even while its outputs may explore meaningful themes. Though Hudson describes Botto’s agency as a “rudimentary version” of artistic intent, he believes Botto’s art relies heavily on its reception and interpretation by viewers — in contrast to Botto’s own declaration that successful art is made without regard to what will be seen as popular.
“With a traditional artist, they present their work, and it's received and interpreted by an audience — by critics, by society — and that complements and shapes the meaning of the work,” Hudson said. “In Botto’s case, that role is just amplified.”
Perhaps then, we all get to be the artists in the end.
After spaceflight record, NASA looks to protect astronauts on even longer trips
At T-minus six seconds, the main engines of the Atlantis Space Shuttle ignited, rattling its capsule “like a skyscraper in an earthquake,” according to astronaut Tom Jones, describing the 1988 launch. As the rocket lifted off and accelerated to three times the force of Earth's gravity, “It felt as if two of my friends were standing on my chest and wouldn’t get off.” But when Atlantis reached orbit, the main engines cut off, and the astronauts were suddenly weightless.
Since 1961, NASA has sent hundreds of astronauts into space while working to making their voyages safer and smoother. Yet, challenges remain. Weightlessness may look amusing when watched from Earth, but it has myriad effects on cognition, movement and other functions. When missions to space stretch to six months or longer, microgravity can impact astronauts’ health and performance, making it more difficult to operate their spacecraft.
Yesterday, NASA astronaut Frank Rubio returned to Earth after over one year, the longest single spaceflight for a U.S. astronaut. But this is just the start; longer and more complex missions into deep space loom ahead, from returning to the moon in 2025 to eventually sending humans to Mars. To ensure that these missions succeed, NASA is increasing efforts to study the biological effects and prevent harm.
The dangers of microgravity are real
A NASA report published in 2016 details a long list of incidents and near-misses caused – at least partly – by space-induced changes in astronauts’ vision and coordination. These issues make it harder to move with precision and to judge distance and velocity.
According to the report, in 1997, a resupply ship collided with the Mir space station, possibly because a crew member bumped into the commander during the final docking maneuver. This mishap caused significant damage to the space station.
Returns to Earth suffered from problems, too. The same report notes that touchdown speeds during the first 100 space shuttle landings were “outside acceptable limits. The fastest landing on record – 224 knots (258 miles) per hour – was linked to the commander’s momentary spatial disorientation.” Earlier, each of the six Apollo crews that landed on the moon had difficulty recognizing moon landmarks and estimating distances. For example, Apollo 15 landed in an unplanned area, ultimately straddling the rim of a five-foot deep crater on the moon, harming one of its engines.
Spaceflight causes unique stresses on astronauts’ brains and central nervous systems. NASA is working to reduce these harmful effects.
NASA
Space messes up your brain
In space, astronauts face the challenges of microgravity, ionizing radiation, social isolation, high workloads, altered circadian rhythms, monotony, confined living quarters and a high-risk environment. Among these issues, microgravity is one of the most consequential in terms of physiological changes. It changes the brain’s structure and its functioning, which can hurt astronauts’ performance.
The brain shifts upwards within the skull, displacing the cerebrospinal fluid, which reduces the brain’s cushioning. Essentially, the brain becomes crowded inside the skull like a pair of too-tight shoes.
That’s partly because of how being in space alters blood flow. On Earth, gravity pulls our blood and other internal fluids toward our feet, but our circulatory valves ensure that the fluids are evenly distributed throughout the body. In space, there’s not enough gravity to pull the fluids down, and they shift up, says Rachael D. Seidler, a physiologist specializing in spaceflight at the University of Florida and principal investigator on many space-related studies. The head swells and legs appear thinner, causing what astronauts call “puffy face chicken legs.”
“The brain changes at the structural and functional level,” says Steven Jillings, equilibrium and aerospace researcher at the University of Antwerp in Belgium. “The brain shifts upwards within the skull,” displacing the cerebrospinal fluid, which reduces the brain’s cushioning. Essentially, the brain becomes crowded inside the skull like a pair of too-tight shoes. Some of the displaced cerebrospinal fluid goes into cavities within the brain, called ventricles, enlarging them. “The remaining fluids pool near the chest and heart,” explains Jillings. After 12 consecutive months in space, one astronaut had a ventricle that was 25 percent larger than before the mission.
Some changes reverse themselves while others persist for a while. An example of a longer-lasting problem is spaceflight-induced neuro-ocular syndrome, which results in near-sightedness and pressure inside the skull. A study of approximately 300 astronauts shows near-sightedness affects about 60 percent of astronauts after long missions on the International Space Station (ISS) and more than 25 percent after spaceflights of only a few weeks.
Another long-term change could be the decreased ability of cerebrospinal fluid to clear waste products from the brain, Seidler says. That’s because compressing the brain also compresses its waste-removing glymphatic pathways, resulting in inflammation, vulnerability to injuries and worsening its overall health.
The effects of long space missions were best demonstrated on astronaut twins Scott and Mark Kelly. This NASA Twins Study showed multiple, perhaps permanent, changes in Scott after his 340-day mission aboard the ISS, compared to Mark, who remained on Earth. The differences included declines in Scott’s speed, accuracy and cognitive abilities that persisted longer than six months after returning to Earth in March 2016.
By the end of 2020, Scott’s cognitive abilities improved, but structural and physiological changes to his eyes still remained, he said in a BBC interview.
“It seems clear that the upward shift of the brain and compression of the surrounding tissues with ventricular expansion might not be a good thing,” Seidler says. “But, at this point, the long-term consequences to brain health and human performance are not really known.”
NASA astronaut Kate Rubins conducts a session for the Neuromapping investigation.
NASA
Staying sharp in space
To investigate how prolonged space travel affects the brain, NASA launched a new initiative called the Complement of Integrated Protocols for Human Exploration Research (CIPHER). “CIPHER investigates how long-duration spaceflight affects both brain structure and function,” says neurobehavioral scientist Mathias Basner at the University of Pennsylvania, a principal investigator for several NASA studies. “Through it, we can find out how the brain adapts to the spaceflight environment and how certain brain regions (behave) differently after – relative to before – the mission.”
To do this, he says, “Astronauts will perform NASA’s cognition test battery before, during and after six- to 12-month missions, and will also perform the same test battery in an MRI scanner before and after the mission. We have to make sure we better understand the functional consequences of spaceflight on the human brain before we can send humans safely to the moon and, especially, to Mars.”
As we go deeper into space, astronauts cognitive and physical functions will be even more important. “A trip to Mars will take about one year…and will introduce long communication delays,” Seidler says. “If you are on that mission and have a problem, it may take eight to 10 minutes for your message to reach mission control, and another eight to 10 minutes for the response to get back to you.” In an emergency situation, that may be too late for the response to matter.
“On a mission to Mars, astronauts will be exposed to stressors for unprecedented amounts of time,” Basner says. To counter them, NASA is considering the continuous use of artificial gravity during the journey, and Seidler is studying whether artificial gravity can reduce the harmful effects of microgravity. Some scientists are looking at precision brain stimulation as a way to improve memory and reduce anxiety due to prolonged exposure to radiation in space.
Other scientists are exploring how to protect neural stem cells (which create brain cells) from radiation damage, developing drugs to repair damaged brain cells and protect cells from radiation.
To boldly go where no astronauts have gone before, they must have optimal reflexes, vision and decision-making. In the era of deep space exploration, the brain—without a doubt—is the final frontier.
Additionally, NASA is scrutinizing each aspect of the mission, including astronaut exercise, nutrition and intellectual engagement. “We need to give astronauts meaningful work. We need to stimulate their sensory, cognitive and other systems appropriately,” Basner says, especially given their extreme confinement and isolation. The scientific experiments performed on the ISS – like studying how microgravity affects the ability of tissue to regenerate is a good example.
“We need to keep them engaged socially, too,” he continues. The ISS crew, for example, regularly broadcasts from space and answers prerecorded questions from students on Earth, and can engage with social media in real time. And, despite tight quarters, NASA is ensuring the crew capsule and living quarters on the moon or Mars include private space, which is critical for good mental health.
Exploring deep space builds on a foundation that began when astronauts first left the planet. With each mission, scientists learn more about spaceflight effects on astronauts’ bodies. NASA will be using these lessons to succeed with its plans to build science stations on the moon and, eventually, Mars.
“Through internally and externally led research, investigations implemented in space and in spaceflight simulations on Earth, we are striving to reduce the likelihood and potential impacts of neurostructural changes in future, extended spaceflight,” summarizes NASA scientist Alexandra Whitmire. To boldly go where no astronauts have gone before, they must have optimal reflexes, vision and decision-making. In the era of deep space exploration, the brain—without a doubt—is the final frontier.
A newly discovered brain cell may lead to better treatments for cognitive disorders
Swiss researchers have discovered a third type of brain cell that appears to be a hybrid of the two other primary types — and it could lead to new treatments for many brain disorders.
The challenge: Most of the cells in the brain are either neurons or glial cells. While neurons use electrical and chemical signals to send messages to one another across small gaps called synapses, glial cells exist to support and protect neurons.
Astrocytes are a type of glial cell found near synapses. This close proximity to the place where brain signals are sent and received has led researchers to suspect that astrocytes might play an active role in the transmission of information inside the brain — a.k.a. “neurotransmission” — but no one has been able to prove the theory.
A new brain cell: Researchers at the Wyss Center for Bio and Neuroengineering and the University of Lausanne believe they’ve definitively proven that some astrocytes do actively participate in neurotransmission, making them a sort of hybrid of neurons and glial cells.
According to the researchers, this third type of brain cell, which they call a “glutamatergic astrocyte,” could offer a way to treat Alzheimer’s, Parkinson’s, and other disorders of the nervous system.
“Its discovery opens up immense research prospects,” said study co-director Andrea Volterra.
The study: Neurotransmission starts with a neuron releasing a chemical called a neurotransmitter, so the first thing the researchers did in their study was look at whether astrocytes can release the main neurotransmitter used by neurons: glutamate.
By analyzing astrocytes taken from the brains of mice, they discovered that certain astrocytes in the brain’s hippocampus did include the “molecular machinery” needed to excrete glutamate. They found evidence of the same machinery when they looked at datasets of human glial cells.
Finally, to demonstrate that these hybrid cells are actually playing a role in brain signaling, the researchers suppressed their ability to secrete glutamate in the brains of mice. This caused the rodents to experience memory problems.
“Our next studies will explore the potential protective role of this type of cell against memory impairment in Alzheimer’s disease, as well as its role in other regions and pathologies than those explored here,” said Andrea Volterra, University of Lausanne.
But why? The researchers aren’t sure why the brain needs glutamatergic astrocytes when it already has neurons, but Volterra suspects the hybrid brain cells may help with the distribution of signals — a single astrocyte can be in contact with thousands of synapses.
“Often, we have neuronal information that needs to spread to larger ensembles, and neurons are not very good for the coordination of this,” researcher Ludovic Telley told New Scientist.
Looking ahead: More research is needed to see how the new brain cell functions in people, but the discovery that it plays a role in memory in mice suggests it might be a worthwhile target for Alzheimer’s disease treatments.
The researchers also found evidence during their study that the cell might play a role in brain circuits linked to seizures and voluntary movements, meaning it’s also a new lead in the hunt for better epilepsy and Parkinson’s treatments.
“Our next studies will explore the potential protective role of this type of cell against memory impairment in Alzheimer’s disease, as well as its role in other regions and pathologies than those explored here,” said Volterra.