Rodney Gorham, an Australian living with ALS, has reconnected with the world, thanks to a brain-machine interface called the Stentrode.
The brain-computer interface enabling this feat is called the Stentrode. It's the brainchild of Synchron, a company backed by Amazon’s Jeff Bezos and Microsoft cofounder Bill Gates. After Gorham’s neurologist recommended that he try it, he became one of the first volunteers to have an 8mm stent, laced with small electrodes, implanted into his jugular vein and guided by a surgeon into a blood vessel near the part of his brain that controls movement.
After arriving at their destination, these tiny sensors can detect neural activity. They relay these messages through a small receiver implanted under the skin to a computer, which then translates the information into words. This minimally invasive surgery takes a day and is painless, according to Gorham. Recovery time is typically short, about two days.
When a paralyzed patient thinks about trying to move their arms or legs, the motor cortex will fire patterns that are specific to the patient’s thoughts.
When a paralyzed patient such as Gorham thinks about trying to move their arms or legs, the motor cortex will fire patterns that are specific to the patient’s thoughts. This pattern is detected by the Stentrode and relayed to a computer that learns to associate this pattern with the patient’s physical movements. The computer recognizes thoughts about kicking, making a fist and other movements as signals for clicking a mouse or pushing certain letters on a keyboard. An additional eye-tracking device controls the movement of the computer cursor.
The process works on a letter by letter basis. That’s why longer and more nuanced responses often involve some trial and error. “I have been using this for about two years, and I enjoy the sessions,” Gorham typed during our chat session. Zafar Faraz, field clinical engineer at Synchron, sat next to Gorham, providing help when required. Gorham had suffered without internet access, but now he looks forward to surfing the web and playing video games.
Gorham, age 63, has been enjoying Stentrode sessions for about two years.
Rodeny Dekker
The BCI revolution
In the summer of 2021, Synchron became the first company to receive the FDA’s Investigational Device Exemption, which allows research trials on the Stentrode in human patients. This past summer, the company, together with scientists from Icahn School of Medicine at Mount Sinai and the Neurology and Neurosurgery Department at Utrecht University, published a paper offering a framework for how to develop BCIs for patients with severe paralysis – those who can't use their upper limbs to type or use digital devices.
Three months ago, Synchron announced the enrollment of six patients in a study called COMMAND based in the U.S. The company will seek approval next year from the FDA to make the Stentrode available for sale commercially. Meanwhile, other companies are making progress in the field of BCIs. In August, Neuralink announced a $280 million financing round, the biggest fundraiser yet in the field. Last December, Synchron announced a $75 million financing round. “One thing I can promise you, in five years from now, we’re not going to be where we are today. We're going to be in a very different place,” says Elad I. Levy, professor of neurosurgery and radiology at State University of New York in Buffalo.
The risk of hacking exists, always. Cybercriminals, for example, might steal sensitive personal data for financial reasons, blackmailing, or to spread malware to other connected devices while extremist groups could potentially hack BCIs to manipulate individuals into supporting their causes or carrying out actions on their behalf.
“The prospect of bestowing individuals with paralysis a renewed avenue for communication and motor functionality is a step forward in neurotech,” says Hayley Nelson, a neuroscientist and founder of The Academy of Cognitive and Behavioral Neuroscience. “It is an exciting breakthrough in a world of devastating, scary diseases,” says Neil McArthur, a professor of philosophy and director of the Centre for Professional and Applied Ethics at the University of Manitoba. “To connect with the world when you are trapped inside your body is incredible.”
While the benefits for the paraplegic community are promising, the Stentrode’s long-term effectiveness and overall impact needs more research on safety. “Potential risks like inflammation, damage to neural tissue, or unexpected shifts in synaptic transmission due to the implant warrant thorough exploration,” Nelson says.
There are also concens about data privacy concerns and the policies of companies to safeguard information processed through BCIs. “Often, Big Tech is ahead of the regulators because the latter didn’t envisage such a turn of events...and companies take advantage of the lack of legal framework to push forward,” McArthur says. Hacking is another risk. Cybercriminals could steal sensitive personal data for financial reasons, blackmailing, or to spread malware to other connected devices. Extremist groups could potentially hack BCIs to manipulate individuals into supporting their causes or carrying out actions on their behalf.
“We have to protect patient identity, patient safety and patient integrity,” Levy says. “In the same way that we protect our phones or computers from hackers, we have to stay ahead with anti-hacking software.” Even so, Levy thinks the anticipated benefits for the quadriplegic community outweigh the potential risks. “We are on the precipice of an amazing technology. In the future, we would be able to connect patients to peripheral devices that enhance their quality of life.”
In the near future, the Stentrode could enable patients to use the Stentrode to activate their wheelchairs, iPods or voice modulators. Synchron's focus is on using its BCI to help patients with significant mobility restrictions—not to enhance the lives of healthy people without any illnesses. Levy says we are not prepared for the implications of endowing people with superpowers.
I wondered what Gorham thought about that. “Pardon my question, but do you feel like you have sort of transcended human nature, being the first in a big line of cybernetic people doing marvelous things with their mind only?” was my last question to Gorham.
A slight smile formed on his lips. In less than a minute, he typed: “I do a little.”
Crickets are low on fat, high on protein, and can be farmed sustainably. They are also crunchy.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Further reading:
More info on Bicky Nguyen
https://yseali.fulbright.edu.vn/en/faculty/bicky-n...
The environmental footprint of beef production
https://www.earthsave.org/environment.htm
https://www.watercalculator.org/news/articles/beef-king-big-water-footprints/
https://www.frontiersin.org/articles/10.3389/fsufs.2019.00005/full
https://ourworldindata.org/carbon-footprint-food-methane
Insect farming as a source of sustainable protein
https://www.insectgourmet.com/insect-farming-growing-bugs-for-protein/
https://www.sciencedirect.com/topics/agricultural-and-biological-sciences/insect-farming
Cricket flour is taking the world by storm
https://www.cricketflours.com/
https://talk-commerce.com/blog/what-brands-use-cricket-flour-and-why/
Artificial Intelligence is already helping to grow some of the food we eat.
The chef-farmers choose from among 45 types of herb and leafy-greens seeds, plop them into grow trays, and a few weeks later they pick and serve. While success is predicated on at least a small amount of these humans’ care, the systems are autonomously surveilled round-the-clock from Babylon’s base of operations. And artificial intelligence is helping to run the show.
Babylon piloted the use of specialized cameras that take pictures in different spectrums to gather some less-obvious visual data about plants’ wellbeing and alert people if something seems off.
Imagine consistently perfect greens and tomatoes and strawberries, grown hyper-locally, using less water, without chemicals or environmental contaminants. This is the hefty promise of controlled environment agriculture (CEA) — basically, indoor farms that can be hydroponic, aeroponic (plant roots are suspended and fed through misting), or aquaponic (where fish play a role in fertilizing vegetables). But whether they grow 4,160 leafy-green servings per year, like one Babylon farm, or millions of servings, like some of the large, centralized facilities starting to supply supermarkets across the U.S., they seek to minimize failure as much as possible.
Babylon’s soilless hydroponic growing system
Courtesy Babylon Micro-Farms
Here, AI is starting to play a pivotal role. CEA growers use it to help “make sense of what’s happening” to the plants in their care, says Scott Lowman, vice president of applied research at the Institute for Advanced Learning and Research (IALR) in Virginia, a state that’s investing heavily in CEA companies. And although these companies say they’re not aiming for a future with zero human employees, AI is certainly poised to take a lot of human farming intervention out of the equation — for better and worse.
Most of these companies are compiling their own data sets to identify anything that might block the success of their systems. Babylon had already integrated sensor data into its farms to measure heat and humidity, the nutrient content of water, and the amount of light plants receive. Last year, they got a National Science Foundation grant that allowed them to pilot the use of specialized cameras that take pictures in different spectrums to gather some less-obvious visual data about plants’ wellbeing and alert people if something seems off. “Will this plant be healthy tomorrow? Are there things…that the human eye can't see that the plant starts expressing?” says Amandeep Ratte, the company’s head of data science. “If our system can say, Hey, this plant is unhealthy, we can reach out to [users] preemptively about what they’re doing wrong, or is there a disease at the farm?” Ratte says. The earlier the better, to avoid crop failures.
Natural light accounts for 70 percent of Greenswell Growers’ energy use on a sunny day.
Courtesy Greenswell Growers
IALR’s Lowman says that other CEA companies are developing their AI systems to account for the different crops they grow — lettuces come in all shapes and sizes, after all, and each has different growing needs than, for example, tomatoes. The ways they run their operations differs also. Babylon is unusual in its decentralized structure. But centralized growing systems with one main location have variabilities, too. AeroFarms, which recently declared bankruptcy but will continue to run its 140,000-square foot vertical operation in Danville, Virginia, is entirely enclosed and reliant on the intense violet glow of grow lights to produce microgreens.
Different companies have different data needs. What data is essential to AeroFarms isn’t quite the same as for Greenswell Growers located in Goochland County, Virginia. Raising four kinds of lettuce in a 77,000-square-foot automated hydroponic greenhouse, the vagaries of naturally available light, which accounts for 70 percent of Greenswell’s energy use on a sunny day, affect operations. Their tech needs to account for “outside weather impacts,” says president Carl Gupton. “What adjustments do we have to make inside of the greenhouse to offset what's going on outside environmentally, to give that plant optimal conditions? When it's 85 percent humidity outside, the system needs to do X, Y and Z to get the conditions that we want inside.”
AI will help identify diseases, as well as when a plant is thirsty or overly hydrated, when it needs more or less calcium, phosphorous, nitrogen.
Nevertheless, every CEA system has the same core needs — consistent yield of high quality crops to keep up year-round supply to customers. Additionally, “Everybody’s got the same set of problems,” Gupton says. Pests may come into a facility with seeds. A disease called pythium, one of the most common in CEA, can damage plant roots. “Then you have root disease pressures that can also come internally — a change in [growing] substrate can change the way the plant performs,” Gupton says.
AI will help identify diseases, as well as when a plant is thirsty or overly hydrated, when it needs more or less calcium, phosphorous, nitrogen. So, while companies amass their own hyper-specific data sets, Lowman foresees a time within the next decade “when there will be some type of [open-source] database that has the most common types of plant stress identified” that growers will be able to tap into. Such databases will “create a community and move the science forward,” says Lowman.
In fact, IALR is working on assembling images for just such a database now. On so-called “smart tables” inside an Institute lab, a team is growing greens and subjects them to various stressors. Then, they’re administering treatments while taking images of every plant every 15 minutes, says Lowman. Some experiments generate 80,000 images; the challenge lies in analyzing and annotating the vast trove of them, marking each one to reflect outcome—for example increasing the phosphate delivery and the plant’s response to it. Eventually, they’ll be fed into AI systems to help them learn.
For all the enthusiasm surrounding this technology, it’s not without downsides. Training just one AI system can emit over 250,000 pounds of carbon dioxide, according to MIT Technology Review. AI could also be used “to enhance environmental benefit for CEA and optimize [its] energy consumption,” says Rozita Dara, a computer science professor at the University of Guelph in Canada, specializing in AI and data governance, “but we first need to collect data to measure [it].”
The chef-farmers can choose from 45 types of herb and leafy-greens seeds.
Courtesy Babylon Micro-Farms
Any system connected to the Internet of Things is also vulnerable to hacking; if CEA grows to the point where “there are many of these similar farms, and you're depending on feeding a population based on those, it would be quite scary,” Dara says. And there are privacy concerns, too, in systems where imaging is happening constantly. It’s partly for this reason, says Babylon’s Ratte, that the company’s in-farm cameras all “face down into the trays, so the only thing [visible] is pictures of plants.”
Tweaks to improve AI for CEA are happening all the time. Greenswell made its first harvest in 2022 and now has annual data points they can use to start making more intelligent choices about how to feed, water, and supply light to plants, says Gupton. Ratte says he’s confident Babylon’s system can already “get our customers reliable harvests. But in terms of how far we have to go, it's a different problem,” he says. For example, if AI could detect whether the farm is mostly empty—meaning the farm’s user hasn’t planted a new crop of greens—it can alert Babylon to check “what's going on with engagement with this user?” Ratte says. “Do they need more training? Did the main person responsible for the farm quit?”
Lowman says more automation is coming, offering greater ability for systems to identify problems and mitigate them on the spot. “We still have to develop datasets that are specific, so you can have a very clear control plan, [because] artificial intelligence is only as smart as what we tell it, and in plant science, there's so much variation,” he says. He believes AI’s next level will be “looking at those first early days of plant growth: when the seed germinates, how fast it germinates, what it looks like when it germinates.” Imaging all that and pairing it with AI, “can be a really powerful tool, for sure.”