World’s First “Augmented Reality” Contact Lens Aims to Revolutionize Much More Than Medicine
Imagine a world without screens. Instead of endlessly staring at your computer or craning your neck down to scroll through social media feeds and emails, information simply appears in front of your eyes when you need it and disappears when you don't.
"The vision is super clear...I was reading the poem with my eyes closed."
No more rude interruptions during dinner, no more bumping into people on the street while trying to follow GPS directions — just the information you want, when you need it, projected directly onto your visual field.
While this screenless future sounds like science fiction, it may soon be a reality thanks to the new Silicon Valley startup Mojo Vision, creator of the world's first smart contact lens. With a 14,000 pixel-per-inch display with eye-tracking, image stabilization, and a custom wireless radio, the Mojo smart lens bills itself the "smallest and densest dynamic display ever made." Unlike current augmented reality wearables such as Google Glass or ThirdEye, which project images onto a glass screen, the Mojo smart lens can project images directly onto the retina.
A current prototype displayed at the Consumer Electronics Show earlier this year in Las Vegas includes a tiny screen positioned right above the most sensitive area of the pupil. "[The Mojo lens] is a contact lens that essentially has wireless power and data transmission for a small micro LED projector that is placed over the center of the eye," explains David Hobbs, Director of Product Management at Mojo Vision. "[It] displays critical heads-up information when you need it and fades into the background when you're ready to continue on with your day."
Eventually, Mojo Visions' technology could replace our beloved smart devices but the first generation of the Mojo smart lens will be used to help the 2.2 billion people globally who suffer from vision impairment.
"If you think of the eye as a camera [for the visually impaired], the sensors are not working properly," explains Dr. Ashley Tuan, Vice President of Medical Devices at Mojo Vision and fellow of the American Academy of Optometry. "For this population, our lens can process the image so the contrast can be enhanced, we can make the image larger, magnify it so that low-vision people can see it or we can make it smaller so they can check their environment." In January of this year, the FDA granted Breakthrough Device Designation to Mojo, allowing them to have early and frequent discussions with the FDA about technical, safety and efficacy topics before clinical trials can be done and certification granted.
For now, Dr. Tuan is one of the few people who has actually worn the Mojo lens. "I put the contact lens on my eye. It was very comfortable like any contact lenses I've worn before," she describes. "The vision is super clear and then when I put on the accessories, suddenly I see Yoda in front of me and I see my vital signs. And then I have my colleague that prepared a beautiful poem that I loved when I was young [and] I was reading the poem with my eyes closed."
At the moment, there are several electronic glasses on the market like Acesight and Nueyes Pro that provide similar solutions for those suffering from visual impairment, but they are large, cumbersome, and highly visible. Mojo lens would be a discreet, more comfortable alternative that offers users more freedom of movement and independence.
"In the case of augmented-reality contact lenses, there could be an opportunity to improve the lives of people with low vision," says Dr. Thomas Steinemann, spokesperson for the American Academy of Ophthalmology and professor of ophthalmology at MetroHealth Medical Center in Cleveland. "There are existing tools for people currently living with low vision—such as digital apps, magnifiers, etc.— but something wearable could provide more flexibility and significantly more aid in day-to-day tasks."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless.
According to Dr. Tuan, the visually impaired often suffer from depression due to their lack of mobility and 70 percent of them are underemployed. "We hope that they can use this device to gain their mobility so they can get that social aspect back in their lives and then, eventually, employment," she explains. "That is our first and most important goal."
But helping those with low visual capabilities is only Mojo lens' first possible medical application; augmented reality is already being used in medicine and is poised to revolutionize the field in the coming decades. For example, Accuvein, a device that uses lasers to provide real-time images of veins, is widely used by nurses and doctors to help with the insertion of needles for IVs and blood tests.
According to the National Center for Biotechnology Information, augmentation of reality has been used in surgery for many years with surgeons using devices such as Google Glass to overlay critical information about their patients into their visual field. Using software like the Holographic Navigation Platform by Scopsis, surgeons can see a mixed-reality overlay that can "show you complicated tumor boundaries, assist with implant placements and guide you along anatomical pathways," its developers say.
However, according to Dr. Tuan, augmented reality headsets have drawbacks in the surgical setting. "The advantage of [Mojo lens] is you don't need to worry about sweating or that the headset or glasses will slide down to your nose," she explains "Also, our lens is designed so that it will understand your intent, so when you don't want the image overlay it will disappear, it will not block your visual field, and when you need it, it will come back at the right time."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless. Possibilities include live translation of sign language for deaf people; helping those with autism to read emotions; and improving doctors' bedside manner by allowing them to fully engage with patients without relying on a computer.
"[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
Furthermore, the lens could be used to monitor health issues. "We have image sensors in the lens right now that point to the world but we can have a camera pointing inside of your eye to your retina," says Dr. Tuan, "[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
For the moment, the future medical applications of the Mojo lens are still theoretical, but the team is confident they can eventually become a reality after going through the proper regulatory review. The company is still in the process of design, prototype and testing of the lens, so they don't know exactly when it will be available for use, but they anticipate shipping the first available products in the next couple of years. Once it does go to market, it will be available by prescription only for those with visual impairments, but the team's goal is to bring it to broader consumer markets pending regulatory clearance.
"We see that right now there's a unique opportunity here for Mojo lens and invisible computing to help to shape what the next decade of technology development looks like," explains David Hobbs. "We can use [the Mojo lens] to better serve us as opposed to us serving technology better."
A startup aims to make medicines in space
Story by Big Think
On June 12, a SpaceX Falcon 9 rocket deployed 72 small satellites for customers — including the world’s first space factory.
The challenge: In 2019, pharma giant Merck revealed that an experiment on the International Space Station had shown how to make its blockbuster cancer drug Keytruda more stable. That meant it could now be administered via a shot rather than through an IV infusion.
The key to the discovery was the fact that particles behave differently when freed from the force of gravity — seeing how its drug crystalized in microgravity helped Merck figure out how to tweak its manufacturing process on Earth to produce the more stable version.
Microgravity research could potentially lead to many more discoveries like this one, or even the development of brand-new drugs, but ISS astronauts only have so much time for commercial experiments.
“There are many high-performance products that are only possible to make in zero-gravity, which is a manufacturing capability that cannot be replicated in any factory on Earth.”-- Will Bruey.
The only options for accessing microgravity (or free fall) outside of orbit, meanwhile, are parabolic airplane flights and drop towers, and those are only useful for experiments that require less than a minute in microgravity — Merck’s ISS experiment took 18 days.
The idea: In 2021, California startup Varda Space Industries announced its intention to build the world’s first space factory, to manufacture not only pharmaceuticals but other products that could benefit from being made in microgravity, such as semiconductors and fiber optic cables.
This factory would consist of a commercial satellite platform attached to two Varda-made modules. One module would contain equipment capable of autonomously manufacturing a product. The other would be a reentry capsule to bring the finished goods back to Earth.
“There are many high-performance products that are only possible to make in zero-gravity, which is a manufacturing capability that cannot be replicated in any factory on Earth,” said CEO Will Bruey, who’d previously developed and flown spacecraft for SpaceX.
“We have a team stacked with aerospace talent in the prime of their careers, focused on getting working hardware to orbit as quickly as possible,” he continued.
“[Pharmaceuticals] are the most valuable chemicals per unit mass. And they also have a large market on Earth.” -- Will Bruey, CEO of Varda Space.
What’s new? At the time, Varda said it planned to launch its first space factory in 2023, and, in what feels like a first for a space startup, it has actually hit that ambitious launch schedule.
“We have ACQUISITION OF SIGNAL,” the startup tweeted soon after the Falcon 9 launch on June 12. “The world’s first space factory’s solar panels have found the sun and it’s beginning to de-tumble.”
During the satellite’s first week in space, Varda will focus on testing its systems to make sure everything works as hoped. The second week will be dedicated to heating and cooling the old HIV-AIDS drug ritonavir repeatedly to study how its particles crystalize in microgravity.
After about a month in space, Varda will attempt to bring its first space factory back to Earth, sending it through the atmosphere at hypersonic speeds and then using a parachute system to safely land at the Department of Defense’s Utah Test and Training Range.
Looking ahead: Ultimately, Varda’s space factories could end up serving dual purposes as manufacturing facilities and hypersonic testbeds — the Air Force has already awarded the startup a contract to use its next reentry capsule to test hardware for hypersonic missiles.
But as for manufacturing other types of goods, Varda plans to stick with drugs for now.
“[Pharmaceuticals] are the most valuable chemicals per unit mass,” Bruey told CNN. “And they also have a large market on Earth.”
“You’re not going to see Varda do anything other than pharmaceuticals for the next minimum of six, seven years,” added Delian Asparouhov, Varda’s co-founder and president.
Genes that protect health with Dr. Nir Barzilai
In today’s podcast episode, I talk with Nir Barzilai, a geroscientist, which means he studies the biology of aging. Barzilai directs the Institute for Aging Research at the Albert Einstein College of Medicine.
My first question for Dr. Barzilai was: why do we age? And is there anything to be done about it? His answers were encouraging. We can’t live forever, but we have some control over the process, as he argues in his book, Age Later.
Dr. Barzilai told me that centenarians differ from the rest of us because they have unique gene mutations that help them stay healthy longer. For most of us, the words “gene mutations” spell trouble - we associate these words with cancer or neurodegenerative diseases, but apparently not all mutations are bad.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Centenarians may have essentially won the genetic lottery, but that doesn’t mean the rest of us are predestined to have a specific lifespan and health span, or the amount of time spent living productively and enjoyably. “Aging is a mother of all diseases,” Dr. Barzilai told me. And as a disease, it can be targeted by therapeutics. Dr. Barzilai’s team is already running clinical trials on such therapeutics — and the results are promising.
More about Dr. Barzilai: He is scientific director of AFAR, American Federation for Aging Research. As part of his work, Dr. Barzilai studies families of centenarians and their genetics to learn how the rest of us can learn and benefit from their super-aging. He also organizing a clinical trial to test a specific drug that may slow aging.
Show Links
Age Later: Health Span, Life Span, and the New Science of Longevity https://www.amazon.com/Age-Later-Healthiest-Sharpest-Centenarians/dp/1250230853
American Federation for Aging Research https://www.afar.org
https://www.afar.org/nir-barzilai
https://www.einsteinmed.edu/faculty/484/nir-barzilai/
Metformin as a Tool to Target Aging
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5943638/
Benefits of Metformin in Attenuating the Hallmarks of Aging https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7347426/
The Longevity Genes Project https://www.einsteinmed.edu/centers/aging/longevity-genes-project/
Lina Zeldovich has written about science, medicine and technology for Popular Science, Smithsonian, National Geographic, Scientific American, Reader’s Digest, the New York Times and other major national and international publications. A Columbia J-School alumna, she has won several awards for her stories, including the ASJA Crisis Coverage Award for Covid reporting, and has been a contributing editor at Nautilus Magazine. In 2021, Zeldovich released her first book, The Other Dark Matter, published by the University of Chicago Press, about the science and business of turning waste into wealth and health. You can find her on http://linazeldovich.com/ and @linazeldovich.