A company called Second Sight made an implant that partially restored vision to people who'd been blind for decades. But when Second Sight pivoted, it stopped servicing its product, leaving many in the dark.
The Argus II uses the implant and a video camera embedded in a special pair of glasses to provide limited vision to those with retinitis pigmentosa, a genetic disease that causes cells in the retina to deteriorate. The camera feeds information to the implant, which sends electrical impulses into the retina to recapitulate what the camera sees. The impulses appear in the Argus II as a 60-pixel grid of blacks, grays and whites in the user’s eye that can render rough outlines of objects and their motion.
Smartphone and computer manufacturers typically stop issuing software upgrades to their devices after two or three years, eventually rendering them bricks. But is the smartphone approach acceptable for a device that helps restore the most crucial sense a human being possesses?
Ross Doerr, a retired disability rights attorney in Maine who received an Argus II in 2019, describes the field of vision as the equivalent of an index card held at arm’s length. Perk often brings objects close to his face to decipher them. Moreover, users must swivel their heads to take in visual data; moving their eyeballs does not work.
Despite its limitations, the Argus II beats the alternative. Perk no longer relies on his guide dog. Doerr was uplifted when he was able to see the outlines of Christmas trees at a holiday show.
“The fairy godmother department sort of reaches out and taps you on the shoulder once in a while,” Doerr says of his implant, which came about purely by chance. A surgeon treating his cataracts was partnered with the son of another surgeon who was implanting the devices, and he was referred.
Doerr had no reason to believe the shower of fairy dust wouldn’t continue. Second Sight held out promises that the Argus II recipients’ vision would gradually improve through upgrades to much higher pixel densities. The ability to recognize individual faces was even touted as a possibility. In the winter of 2020, Doerr was preparing to travel across the U.S. to Second Sight’s headquarters to receive an upgrade. But then COVID-19 descended, and the trip was canceled.
The pandemic also hit Second Sight’s bottom line. Doerr found out about its tribulations only from one of the company’s vision therapists, who told him the entire department was being laid off. Second Sight cut nearly 80% of its workforce in March 2020 and announced it would wind down operations.
Ross Doerr has mostly stopped using his Argus II, the result of combination of fear of losing its assistance from wear and tear and disdain for the company that brought it to market.
Jan Doerr
Second Sight’s implosion left some 350 Argus recipients in the metaphorical dark about what to do if their implants failed. Skeleton staff seem to have rarely responded to queries from their customers, at least based on the experiences of Perk and Doerr. And some recipients have unfortunately returned to the actual dark as well, as reports have surfaced of Argus II failures due to aging or worn-down parts.
Product support for complex products is remarkably uneven. Although the iconic Ford Mustang ceased production in the late 1960s, its parts market is so robust that it’s theoretically possible to assemble a new vehicle from recently crafted components. Conversely, smartphone and computer manufacturers typically stop issuing software upgrades to their devices after two or three years, eventually rendering them bricks. Consumers have accepted both extremes.
But is the smartphone approach acceptable for a device that helps restore the most crucial sense a human being possesses?
Margaret McLean, a senior fellow at the Markkula Center for Applied Ethics at Santa Clara University in California, notes companies like Second Sight have a greater obligation for product support than other consumer product ventures.
“In this particular case, you have a great deal of risk that is involved in using this device, the implant, and the after care of this device,” she says. “You cannot, like with your car, decide that ‘I don’t like my Mustang anymore,’ and go out and buy a Corvette.”
And, whether the Argus II implant works or not, its physical presence can impact critical medical decisions. Doerr’s doctor wanted him to undergo an MRI to assist in diagnosing attacks of vertigo. But the physician was concerned his implant might interfere. With the latest available manufacturer advisories on his implant nearly a decade old, the procedure was held up. Doerr spent months importuning Second Sight through phone calls, emails and Facebook postings to learn if his implant was contraindicated with MRIs, which he never received. Although the cause of his vertigo was found without an MRI, Doerr was hardly assured.
“Put that into context for a minute. I get into a serious car accident. I end up in the emergency room, and I have a tag saying I have an implanted medical device,” he says. “You can’t do an MRI until you get the proper information from the company. Who’s going to answer the phone?”
Second Sight’s management did answer the call to revamp its business. It netted nearly $78 million through a private stock placement and an initial public offering last year. At the end of 2021, Second Sight had nearly $70 million in cash on hand, according to a recent filing with the Securities and Exchange Commission.
And while the Argus II is still touted at length on Second Sight’s home page, it appears little of its corporate coffers are earmarked toward its support. These days, the company is focused on obtaining federal approvals for Orion, a new implant that would go directly into the recipient’s brain and could be used to remedy blindness from a variety of causes. It obtained a $6.4 million grant from the National Institutes of Health in May 2021 to help develop Orion.
Presented with a list of written questions by email, Second Sight’s spokesperson, Dave Gentry of the investor relations firm Red Chip Companies, copied a subordinate with an abrupt message to “please handle.” That was the only response from a company representative. A call to Second Sight acting chief executive officer Scott Dunbar went unreturned.
Whether or not the Orion succeeds remains to be seen. The company’s SEC filings suggest a viable and FDA-approved device is years away, and that operational losses are expected for the “foreseeable future.” Second Sight reported zero revenue in 2020 or 2021.
Moreover, the experiences of the Argus II recipients could color the reception of future Second Sight products. Doerr notes that his insurer paid nearly $500,000 to implant his device and for training on how to use it.
“What’s the insurance industry going to say the next time this crops up?” Doerr asks, noting that the company’s reputation is “completely shot” with the recipients of its implants.
Perk, who made speeches to praise the Argus II and is still featured in a video on the Second Sight website, says he also no longer supports the company.
Jeroen Perk, an investigator for the Dutch customs service, cried for joy after partially regaining his sight, but he no longer trusts Second Sight, the company that provided his implant.
Nanda Perk
Nevertheless, Perk remains highly reliant on the technology. When he dropped an external component of his device in late 2020 and it broke, Perk briefly debated whether to remain blind or find a way to get his Argus II working again. Three months later, he was able to revive it by crowdsourcing parts, primarily from surgeons with spare components or other Argus II recipients who no longer use their devices. Perk now has several spare parts in reserve in case of future breakdowns.
Despite the frantic efforts to retain what little sight he has, Perk has no regrets about having the device implanted. And while he no longer trusts Second Sight, he is looking forward to possibly obtaining more advanced implants from companies in the Netherlands and Australia working on their own products.
Doerr suggests that biotech firms whose implants are distributed globally be bound to some sort of international treaty requiring them to service their products in perpetuity. Such treaties are still applied to the salvage rights for ships that sunk centuries ago, he notes.
“I think that in a global tech economy, that would be a good thing,” says McLean, the fellow at Santa Clara, “but I am not optimistic about it in the near term. Business incentives push toward return on share to stockholders, not to patients and other stakeholders. We likely need to rely on some combination of corporately responsibility…and [international] government regulation. It’s tough—the Paris Climate Accord implementation at a slow walk comes to mind.”
Unlike Perk, Doerr has mostly stopped using his Argus II, the result of combination of fear of losing its assistance from wear and tear and disdain for the company that brought it to market. At 70, Doerr says he does not have the time or energy to hold the company more accountable. And with Second Sight having gone through a considerable corporate reorganization, Doerr believes a lawsuit to compel it to better serve its Argus recipients would be nothing but an extremely costly longshot.
“It’s corporate America at its best,” he observes.
Artificial Intelligence is already helping to grow some of the food we eat.
The chef-farmers choose from among 45 types of herb and leafy-greens seeds, plop them into grow trays, and a few weeks later they pick and serve. While success is predicated on at least a small amount of these humans’ care, the systems are autonomously surveilled round-the-clock from Babylon’s base of operations. And artificial intelligence is helping to run the show.
Babylon piloted the use of specialized cameras that take pictures in different spectrums to gather some less-obvious visual data about plants’ wellbeing and alert people if something seems off.
Imagine consistently perfect greens and tomatoes and strawberries, grown hyper-locally, using less water, without chemicals or environmental contaminants. This is the hefty promise of controlled environment agriculture (CEA) — basically, indoor farms that can be hydroponic, aeroponic (plant roots are suspended and fed through misting), or aquaponic (where fish play a role in fertilizing vegetables). But whether they grow 4,160 leafy-green servings per year, like one Babylon farm, or millions of servings, like some of the large, centralized facilities starting to supply supermarkets across the U.S., they seek to minimize failure as much as possible.
Babylon’s soilless hydroponic growing system
Courtesy Babylon Micro-Farms
Here, AI is starting to play a pivotal role. CEA growers use it to help “make sense of what’s happening” to the plants in their care, says Scott Lowman, vice president of applied research at the Institute for Advanced Learning and Research (IALR) in Virginia, a state that’s investing heavily in CEA companies. And although these companies say they’re not aiming for a future with zero human employees, AI is certainly poised to take a lot of human farming intervention out of the equation — for better and worse.
Most of these companies are compiling their own data sets to identify anything that might block the success of their systems. Babylon had already integrated sensor data into its farms to measure heat and humidity, the nutrient content of water, and the amount of light plants receive. Last year, they got a National Science Foundation grant that allowed them to pilot the use of specialized cameras that take pictures in different spectrums to gather some less-obvious visual data about plants’ wellbeing and alert people if something seems off. “Will this plant be healthy tomorrow? Are there things…that the human eye can't see that the plant starts expressing?” says Amandeep Ratte, the company’s head of data science. “If our system can say, Hey, this plant is unhealthy, we can reach out to [users] preemptively about what they’re doing wrong, or is there a disease at the farm?” Ratte says. The earlier the better, to avoid crop failures.
Natural light accounts for 70 percent of Greenswell Growers’ energy use on a sunny day.
Courtesy Greenswell Growers
IALR’s Lowman says that other CEA companies are developing their AI systems to account for the different crops they grow — lettuces come in all shapes and sizes, after all, and each has different growing needs than, for example, tomatoes. The ways they run their operations differs also. Babylon is unusual in its decentralized structure. But centralized growing systems with one main location have variabilities, too. AeroFarms, which recently declared bankruptcy but will continue to run its 140,000-square foot vertical operation in Danville, Virginia, is entirely enclosed and reliant on the intense violet glow of grow lights to produce microgreens.
Different companies have different data needs. What data is essential to AeroFarms isn’t quite the same as for Greenswell Growers located in Goochland County, Virginia. Raising four kinds of lettuce in a 77,000-square-foot automated hydroponic greenhouse, the vagaries of naturally available light, which accounts for 70 percent of Greenswell’s energy use on a sunny day, affect operations. Their tech needs to account for “outside weather impacts,” says president Carl Gupton. “What adjustments do we have to make inside of the greenhouse to offset what's going on outside environmentally, to give that plant optimal conditions? When it's 85 percent humidity outside, the system needs to do X, Y and Z to get the conditions that we want inside.”
AI will help identify diseases, as well as when a plant is thirsty or overly hydrated, when it needs more or less calcium, phosphorous, nitrogen.
Nevertheless, every CEA system has the same core needs — consistent yield of high quality crops to keep up year-round supply to customers. Additionally, “Everybody’s got the same set of problems,” Gupton says. Pests may come into a facility with seeds. A disease called pythium, one of the most common in CEA, can damage plant roots. “Then you have root disease pressures that can also come internally — a change in [growing] substrate can change the way the plant performs,” Gupton says.
AI will help identify diseases, as well as when a plant is thirsty or overly hydrated, when it needs more or less calcium, phosphorous, nitrogen. So, while companies amass their own hyper-specific data sets, Lowman foresees a time within the next decade “when there will be some type of [open-source] database that has the most common types of plant stress identified” that growers will be able to tap into. Such databases will “create a community and move the science forward,” says Lowman.
In fact, IALR is working on assembling images for just such a database now. On so-called “smart tables” inside an Institute lab, a team is growing greens and subjects them to various stressors. Then, they’re administering treatments while taking images of every plant every 15 minutes, says Lowman. Some experiments generate 80,000 images; the challenge lies in analyzing and annotating the vast trove of them, marking each one to reflect outcome—for example increasing the phosphate delivery and the plant’s response to it. Eventually, they’ll be fed into AI systems to help them learn.
For all the enthusiasm surrounding this technology, it’s not without downsides. Training just one AI system can emit over 250,000 pounds of carbon dioxide, according to MIT Technology Review. AI could also be used “to enhance environmental benefit for CEA and optimize [its] energy consumption,” says Rozita Dara, a computer science professor at the University of Guelph in Canada, specializing in AI and data governance, “but we first need to collect data to measure [it].”
The chef-farmers can choose from 45 types of herb and leafy-greens seeds.
Courtesy Babylon Micro-Farms
Any system connected to the Internet of Things is also vulnerable to hacking; if CEA grows to the point where “there are many of these similar farms, and you're depending on feeding a population based on those, it would be quite scary,” Dara says. And there are privacy concerns, too, in systems where imaging is happening constantly. It’s partly for this reason, says Babylon’s Ratte, that the company’s in-farm cameras all “face down into the trays, so the only thing [visible] is pictures of plants.”
Tweaks to improve AI for CEA are happening all the time. Greenswell made its first harvest in 2022 and now has annual data points they can use to start making more intelligent choices about how to feed, water, and supply light to plants, says Gupton. Ratte says he’s confident Babylon’s system can already “get our customers reliable harvests. But in terms of how far we have to go, it's a different problem,” he says. For example, if AI could detect whether the farm is mostly empty—meaning the farm’s user hasn’t planted a new crop of greens—it can alert Babylon to check “what's going on with engagement with this user?” Ratte says. “Do they need more training? Did the main person responsible for the farm quit?”
Lowman says more automation is coming, offering greater ability for systems to identify problems and mitigate them on the spot. “We still have to develop datasets that are specific, so you can have a very clear control plan, [because] artificial intelligence is only as smart as what we tell it, and in plant science, there's so much variation,” he says. He believes AI’s next level will be “looking at those first early days of plant growth: when the seed germinates, how fast it germinates, what it looks like when it germinates.” Imaging all that and pairing it with AI, “can be a really powerful tool, for sure.”
Researchers from the University of Cambridge have laid the foundations for growing synthetic embryos that could develop a beating heart, gut and brain.
The organoid revolution
In 1981, scientists discovered how to keep stem cells alive. This was a significant breakthrough, as stem cells have notoriously rigorous demands. Nevertheless, stem cells remained a relatively niche research area, mainly because scientists didn’t know how to convince the cells to turn into other cells.
Then, in 1987, scientists embedded isolated stem cells in a gelatinous protein mixture called Matrigel, which simulated the three-dimensional environment of animal tissue. The cells thrived, but they also did something remarkable: they created breast tissue capable of producing milk proteins. This was the first organoid — a clump of cells that behave and function like a real organ. The organoid revolution had begun, and it all started with a boob in Jello.
For the next 20 years, it was rare to find a scientist who identified as an “organoid researcher,” but there were many “stem cell researchers” who wanted to figure out how to turn stem cells into other cells. Eventually, they discovered the signals (called growth factors) that stem cells require to differentiate into other types of cells.
For a human embryo (and its organs) to develop successfully, there needs to be a “dialogue” between these three types of stem cells.
By the end of the 2000s, researchers began combining stem cells, Matrigel, and the newly characterized growth factors to create dozens of organoids, from liver organoids capable of producing the bile salts necessary for digesting fat to brain organoids with components that resemble eyes, the spinal cord, and arguably, the beginnings of sentience.
Synthetic embryos
Organoids possess an intrinsic flaw: they are organ-like. They share some characteristics with real organs, making them powerful tools for research. However, no one has found a way to create an organoid with all the characteristics and functions of a real organ. But Magdalena Żernicka-Goetz, a developmental biologist, might have set the foundation for that discovery.
Żernicka-Goetz hypothesized that organoids fail to develop into fully functional organs because organs develop as a collective. Organoid research often uses embryonic stem cells, which are the cells from which the developing organism is created. However, there are two other types of stem cells in an early embryo: stem cells that become the placenta and those that become the yolk sac (where the embryo grows and gets its nutrients in early development). For a human embryo (and its organs) to develop successfully, there needs to be a “dialogue” between these three types of stem cells. In other words, Żernicka-Goetz suspected the best way to grow a functional organoid was to produce a synthetic embryoid.
As described in the aforementioned Nature paper, Żernicka-Goetz and her team mimicked the embryonic environment by mixing these three types of stem cells from mice. Amazingly, the stem cells self-organized into structures and progressed through the successive developmental stages until they had beating hearts and the foundations of the brain.
“Our mouse embryo model not only develops a brain, but also a beating heart [and] all the components that go on to make up the body,” said Żernicka-Goetz. “It’s just unbelievable that we’ve got this far. This has been the dream of our community for years and major focus of our work for a decade and finally we’ve done it.”
If the methods developed by Żernicka-Goetz’s team are successful with human stem cells, scientists someday could use them to guide the development of synthetic organs for patients awaiting transplants. It also opens the door to studying how embryos develop during pregnancy.
This article originally appeared on Big Think, home of the brightest minds and biggest ideas of all time.
