World’s First “Augmented Reality” Contact Lens Aims to Revolutionize Much More Than Medicine
Imagine a world without screens. Instead of endlessly staring at your computer or craning your neck down to scroll through social media feeds and emails, information simply appears in front of your eyes when you need it and disappears when you don't.
"The vision is super clear...I was reading the poem with my eyes closed."
No more rude interruptions during dinner, no more bumping into people on the street while trying to follow GPS directions — just the information you want, when you need it, projected directly onto your visual field.
While this screenless future sounds like science fiction, it may soon be a reality thanks to the new Silicon Valley startup Mojo Vision, creator of the world's first smart contact lens. With a 14,000 pixel-per-inch display with eye-tracking, image stabilization, and a custom wireless radio, the Mojo smart lens bills itself the "smallest and densest dynamic display ever made." Unlike current augmented reality wearables such as Google Glass or ThirdEye, which project images onto a glass screen, the Mojo smart lens can project images directly onto the retina.
A current prototype displayed at the Consumer Electronics Show earlier this year in Las Vegas includes a tiny screen positioned right above the most sensitive area of the pupil. "[The Mojo lens] is a contact lens that essentially has wireless power and data transmission for a small micro LED projector that is placed over the center of the eye," explains David Hobbs, Director of Product Management at Mojo Vision. "[It] displays critical heads-up information when you need it and fades into the background when you're ready to continue on with your day."
Eventually, Mojo Visions' technology could replace our beloved smart devices but the first generation of the Mojo smart lens will be used to help the 2.2 billion people globally who suffer from vision impairment.
"If you think of the eye as a camera [for the visually impaired], the sensors are not working properly," explains Dr. Ashley Tuan, Vice President of Medical Devices at Mojo Vision and fellow of the American Academy of Optometry. "For this population, our lens can process the image so the contrast can be enhanced, we can make the image larger, magnify it so that low-vision people can see it or we can make it smaller so they can check their environment." In January of this year, the FDA granted Breakthrough Device Designation to Mojo, allowing them to have early and frequent discussions with the FDA about technical, safety and efficacy topics before clinical trials can be done and certification granted.
For now, Dr. Tuan is one of the few people who has actually worn the Mojo lens. "I put the contact lens on my eye. It was very comfortable like any contact lenses I've worn before," she describes. "The vision is super clear and then when I put on the accessories, suddenly I see Yoda in front of me and I see my vital signs. And then I have my colleague that prepared a beautiful poem that I loved when I was young [and] I was reading the poem with my eyes closed."
At the moment, there are several electronic glasses on the market like Acesight and Nueyes Pro that provide similar solutions for those suffering from visual impairment, but they are large, cumbersome, and highly visible. Mojo lens would be a discreet, more comfortable alternative that offers users more freedom of movement and independence.
"In the case of augmented-reality contact lenses, there could be an opportunity to improve the lives of people with low vision," says Dr. Thomas Steinemann, spokesperson for the American Academy of Ophthalmology and professor of ophthalmology at MetroHealth Medical Center in Cleveland. "There are existing tools for people currently living with low vision—such as digital apps, magnifiers, etc.— but something wearable could provide more flexibility and significantly more aid in day-to-day tasks."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless.
According to Dr. Tuan, the visually impaired often suffer from depression due to their lack of mobility and 70 percent of them are underemployed. "We hope that they can use this device to gain their mobility so they can get that social aspect back in their lives and then, eventually, employment," she explains. "That is our first and most important goal."
But helping those with low visual capabilities is only Mojo lens' first possible medical application; augmented reality is already being used in medicine and is poised to revolutionize the field in the coming decades. For example, Accuvein, a device that uses lasers to provide real-time images of veins, is widely used by nurses and doctors to help with the insertion of needles for IVs and blood tests.
According to the National Center for Biotechnology Information, augmentation of reality has been used in surgery for many years with surgeons using devices such as Google Glass to overlay critical information about their patients into their visual field. Using software like the Holographic Navigation Platform by Scopsis, surgeons can see a mixed-reality overlay that can "show you complicated tumor boundaries, assist with implant placements and guide you along anatomical pathways," its developers say.
However, according to Dr. Tuan, augmented reality headsets have drawbacks in the surgical setting. "The advantage of [Mojo lens] is you don't need to worry about sweating or that the headset or glasses will slide down to your nose," she explains "Also, our lens is designed so that it will understand your intent, so when you don't want the image overlay it will disappear, it will not block your visual field, and when you need it, it will come back at the right time."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless. Possibilities include live translation of sign language for deaf people; helping those with autism to read emotions; and improving doctors' bedside manner by allowing them to fully engage with patients without relying on a computer.
"[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
Furthermore, the lens could be used to monitor health issues. "We have image sensors in the lens right now that point to the world but we can have a camera pointing inside of your eye to your retina," says Dr. Tuan, "[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
For the moment, the future medical applications of the Mojo lens are still theoretical, but the team is confident they can eventually become a reality after going through the proper regulatory review. The company is still in the process of design, prototype and testing of the lens, so they don't know exactly when it will be available for use, but they anticipate shipping the first available products in the next couple of years. Once it does go to market, it will be available by prescription only for those with visual impairments, but the team's goal is to bring it to broader consumer markets pending regulatory clearance.
"We see that right now there's a unique opportunity here for Mojo lens and invisible computing to help to shape what the next decade of technology development looks like," explains David Hobbs. "We can use [the Mojo lens] to better serve us as opposed to us serving technology better."
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Here are the promising studies covered in this week's Friday Five, featuring interviews with Dr. David Spiegel, associate chair of psychiatry and behavioral sciences at Stanford, and Dr. Filip Swirski, professor of medicine and cardiology at the Icahn School of Medicine at Mount Sinai.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five, featuring interviews with Dr. David Spiegel, associate chair of psychiatry and behavioral sciences at Stanford, and Dr. Filip Swirski, professor of medicine and cardiology at the Icahn School of Medicine at Mount Sinai.
- Breathing this way cuts down on anxiety*
- Could your fasting regimen make you sick?
- This type of job makes men more virile
- 3D printed hearts could save your life
- Yet another potential benefit of metformin
* This video with Dr. Andrew Huberman of Stanford shows exactly how to do the breathing practice.
This podcast originally aired on March 3, 2023.
Breakthrough drones deliver breast milk in rural Uruguay
Until three months ago, nurse Leopoldina Castelli used to send bottles of breast milk to nourish babies in the remote areas of Tacuarembó, in northern Uruguay, by way of ambulances or military trucks. That is, if the vehicles were available and the roads were passable, which wasn’t always the case. Now, five days per week, she stands by a runway at the hospital, located in Tacuarembó’s capital, watching a drone take off and disappear from view, carrying the milk to clinics that serve the babies’ families.
The drones can fly as far as 62 miles. Long distances and rough roads are no obstacles. The babies, whose mothers struggle to produce sufficient milk and cannot afford formula, now receive ample supplies for healthy growth. “Today we provided nourishment to a significantly larger number of children, and this is something that deeply moves me,” Castelli says.
About two decades ago, the Tacuarembó hospital established its own milk bank, supported by donations from mothers across Tacuarembó. Over the years, the bank has provided milk to infants immediately after birth. It's helped drive a “significant and sustained” decrease in infant mortality, says the hospital director, Ciro Ferreira.
But these children need breast milk throughout their first six months, if not longer, to prevent malnutrition and other illnesses that are prevalent in rural Tacuarembó. Ground transport isn't quick or reliable enough to meet this goal. It can take several hours, during which the milk may spoil due to a lack of refrigeration.
The battery-powered drones have been the difference-maker. The project to develop them, financed by the UNICEF Innovation Fund, is the first of its kind in Latin America. To Castelli, it's nothing short of a revolution. Tacuarembó Hospital, along with three rural clinics in the most impoverished part of Uruguay, are its leaders.
"This marks the first occasion when the public health system has been directly impacted [by our technology]," says Sebastián Macías, the CEO and co-founder of Cielum, an engineer at the University Republic, which collaborated on the technology with a Uruguayan company called Cielum and a Swiss company, Rigitech.
The drone can achieve a top speed of up to 68 miles per hour, is capable of flying in light rain, and can withstand winds of up to 30 miles per hour at a maximum altitude of 120 meters.
"We have succeeded in embracing the mothers from rural areas who were previously slipping through the cracks of the system," says Ferreira, the hospital director. He envisions an expansion of the service so it can improve health for children in other rural areas.
Nurses load the drone for breast milk delivery.
Sebastián Macías - Cielum
The star aircraft
The drone, which costs approximately $70,000, was specifically designed for the transportation of biological materials. Constructed from carbon fiber, it's three meters wide, two meters long and weighs 42 pounds when fully loaded. Additionally, it is equipped with a ballistic parachute to ensure a safe descent in case the technology fails in midair. Furthermore, it can achieve a top speed of 68 miles per hour, fly in light rain, and withstand winds of 30 miles per hour at a height of 120 meters.
Inside, the drones feature three refrigerated compartments that maintain a stable temperature and adhere to the United Nations’ standards for transporting perishable products. These compartments accommodate four gallons or 6.5 pounds of cargo. According to Macías, that's more than sufficient to carry a week’s worth of milk for one infant on just two flights, or 3.3 pounds of blood samples collected in a rural clinic.
“From an energy perspective, it serves as an efficient mode of transportation and helps reduce the carbon emissions associated with using an ambulance,” said Macías. Plus, the ambulance can remain available in the town.
Macías, who has led software development for the drone, and three other technicians have been trained to operate it. They ensure that the drone stays on course, monitor weather conditions and implement emergency changes when needed. The software displays the in-flight positions of the drones in relation to other aircraft. All agricultural planes in the region receive notification about the drone's flight path, departure and arrival times, and current location.
The future: doubling the drone's reach
Forty-five days after its inaugural flight, the drone is now making five flights per week. It serves two routes: 34 miles to Curtina and 31 miles to Tambores. The drone reaches Curtina in 50 minutes while ambulances take double that time, partly due to the subpar road conditions. Pueblo Ansina, located 40 miles from the state capital, will soon be introduced as the third destination.
Overall, the drone’s schedule is expected to become much busier, with plans to accomplish 20 weekly flights by the end of October and over 30 in 2024. Given the drone’s speed, Macías is contemplating using it to transport cancer medications as well.
“When it comes to using drones to save lives, for us, the sky is not the limit," says Ciro Ferreira, Tacuarembó hospital director.
In future trips to clinics in San Gregorio de Polanco and Caraguatá, the drone will be pushed to the limit. At these locations, a battery change will be necessary, but it's worth it. The route will cover up to 10 rural Tacuarembó clinics plus one hospital outside Tacuarembó, in Rivera, close to the border with Brazil. Currently, because of a shortage of ambulances, the delivery of pasteurized breast milk to Rivera only occurs every 15 days.
“The expansion to Rivera will include 100,000 more inhabitants, doubling the healthcare reach,” said Ferreira, the director of the Tacuarembó Hospital. In itself, Ferreira's hospital serves the medical needs of 500,000 people as one of the largest in Uruguay's interior.
Alejandro Del Estal, an aeronautical engineer at Rigitech, traveled from Europe to Tacuarembó to oversee the construction of the vertiports – the defined areas that can support drones’ take-off and landing – and the first flights. He pointed out that once the flight network between hospitals and rural polyclinics is complete in Uruguay, it will rank among the five most extensive drone routes in the world for any activity, including healthcare and commercial uses.
Cielum is already working on the long-term sustainability of the project. The aim is to have more drones operating in other rural regions in the western and northern parts of the country. The company has received inquiries from Argentina and Colombia, but, as Macías pointed out, they are exercising caution when making commitments. Expansion will depend on the development of each country’s regulations for airspace use.
For Ferreira, the advantages in Uruguay are evident: "This approach enables us to bridge the geographical gap, enhance healthcare accessibility, and reduce the time required for diagnosing and treating rural inhabitants, all without the necessity of them traveling to the hospital,” he says. "When it comes to using drones to save lives, for us, the sky is not the limit."