World’s First “Augmented Reality” Contact Lens Aims to Revolutionize Much More Than Medicine
Imagine a world without screens. Instead of endlessly staring at your computer or craning your neck down to scroll through social media feeds and emails, information simply appears in front of your eyes when you need it and disappears when you don't.
"The vision is super clear...I was reading the poem with my eyes closed."
No more rude interruptions during dinner, no more bumping into people on the street while trying to follow GPS directions — just the information you want, when you need it, projected directly onto your visual field.
While this screenless future sounds like science fiction, it may soon be a reality thanks to the new Silicon Valley startup Mojo Vision, creator of the world's first smart contact lens. With a 14,000 pixel-per-inch display with eye-tracking, image stabilization, and a custom wireless radio, the Mojo smart lens bills itself the "smallest and densest dynamic display ever made." Unlike current augmented reality wearables such as Google Glass or ThirdEye, which project images onto a glass screen, the Mojo smart lens can project images directly onto the retina.
A current prototype displayed at the Consumer Electronics Show earlier this year in Las Vegas includes a tiny screen positioned right above the most sensitive area of the pupil. "[The Mojo lens] is a contact lens that essentially has wireless power and data transmission for a small micro LED projector that is placed over the center of the eye," explains David Hobbs, Director of Product Management at Mojo Vision. "[It] displays critical heads-up information when you need it and fades into the background when you're ready to continue on with your day."
Eventually, Mojo Visions' technology could replace our beloved smart devices but the first generation of the Mojo smart lens will be used to help the 2.2 billion people globally who suffer from vision impairment.
"If you think of the eye as a camera [for the visually impaired], the sensors are not working properly," explains Dr. Ashley Tuan, Vice President of Medical Devices at Mojo Vision and fellow of the American Academy of Optometry. "For this population, our lens can process the image so the contrast can be enhanced, we can make the image larger, magnify it so that low-vision people can see it or we can make it smaller so they can check their environment." In January of this year, the FDA granted Breakthrough Device Designation to Mojo, allowing them to have early and frequent discussions with the FDA about technical, safety and efficacy topics before clinical trials can be done and certification granted.
For now, Dr. Tuan is one of the few people who has actually worn the Mojo lens. "I put the contact lens on my eye. It was very comfortable like any contact lenses I've worn before," she describes. "The vision is super clear and then when I put on the accessories, suddenly I see Yoda in front of me and I see my vital signs. And then I have my colleague that prepared a beautiful poem that I loved when I was young [and] I was reading the poem with my eyes closed."
At the moment, there are several electronic glasses on the market like Acesight and Nueyes Pro that provide similar solutions for those suffering from visual impairment, but they are large, cumbersome, and highly visible. Mojo lens would be a discreet, more comfortable alternative that offers users more freedom of movement and independence.
"In the case of augmented-reality contact lenses, there could be an opportunity to improve the lives of people with low vision," says Dr. Thomas Steinemann, spokesperson for the American Academy of Ophthalmology and professor of ophthalmology at MetroHealth Medical Center in Cleveland. "There are existing tools for people currently living with low vision—such as digital apps, magnifiers, etc.— but something wearable could provide more flexibility and significantly more aid in day-to-day tasks."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless.
According to Dr. Tuan, the visually impaired often suffer from depression due to their lack of mobility and 70 percent of them are underemployed. "We hope that they can use this device to gain their mobility so they can get that social aspect back in their lives and then, eventually, employment," she explains. "That is our first and most important goal."
But helping those with low visual capabilities is only Mojo lens' first possible medical application; augmented reality is already being used in medicine and is poised to revolutionize the field in the coming decades. For example, Accuvein, a device that uses lasers to provide real-time images of veins, is widely used by nurses and doctors to help with the insertion of needles for IVs and blood tests.
According to the National Center for Biotechnology Information, augmentation of reality has been used in surgery for many years with surgeons using devices such as Google Glass to overlay critical information about their patients into their visual field. Using software like the Holographic Navigation Platform by Scopsis, surgeons can see a mixed-reality overlay that can "show you complicated tumor boundaries, assist with implant placements and guide you along anatomical pathways," its developers say.
However, according to Dr. Tuan, augmented reality headsets have drawbacks in the surgical setting. "The advantage of [Mojo lens] is you don't need to worry about sweating or that the headset or glasses will slide down to your nose," she explains "Also, our lens is designed so that it will understand your intent, so when you don't want the image overlay it will disappear, it will not block your visual field, and when you need it, it will come back at the right time."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless. Possibilities include live translation of sign language for deaf people; helping those with autism to read emotions; and improving doctors' bedside manner by allowing them to fully engage with patients without relying on a computer.
"[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
Furthermore, the lens could be used to monitor health issues. "We have image sensors in the lens right now that point to the world but we can have a camera pointing inside of your eye to your retina," says Dr. Tuan, "[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
For the moment, the future medical applications of the Mojo lens are still theoretical, but the team is confident they can eventually become a reality after going through the proper regulatory review. The company is still in the process of design, prototype and testing of the lens, so they don't know exactly when it will be available for use, but they anticipate shipping the first available products in the next couple of years. Once it does go to market, it will be available by prescription only for those with visual impairments, but the team's goal is to bring it to broader consumer markets pending regulatory clearance.
"We see that right now there's a unique opportunity here for Mojo lens and invisible computing to help to shape what the next decade of technology development looks like," explains David Hobbs. "We can use [the Mojo lens] to better serve us as opposed to us serving technology better."
Some hospitals are pioneers in ditching plastic, turning green
This is part 2 of a three part series on a new generation of doctors leading the charge to make the health care industry more sustainable - for the benefit of their patients and the planet. Read part 1 here and part 3 here.
After graduating from her studies as an engineer, Nora Stroetzel ticked off the top item on her bucket list and traveled the world for a year. She loved remote places like the Indonesian rain forest she reached only by hiking for several days on foot, mountain villages in the Himalayas, and diving at reefs that were only accessible by local fishing boats.
“But no matter how far from civilization I ventured, one thing was already there: plastic,” Stroetzel says. “Plastic that would stay there for centuries, on 12,000 foot peaks and on beaches several hundred miles from the nearest city.” She saw “wild orangutans that could be lured by rustling plastic and hermit crabs that used plastic lids as dwellings instead of shells.”
While traveling she started volunteering for beach cleanups and helped build a recycling station in Indonesia. But the pivotal moment for her came after she returned to her hometown Kiel in Germany. “At the dentist, they gave me a plastic cup to rinse my mouth. I used it for maybe ten seconds before it was tossed out,” Stroetzel says. “That made me really angry.”
She decided to research alternatives for plastic in the medical sector and learned that cups could be reused and easily disinfected. All dentists routinely disinfect their tools anyway and, Stroetzel reasoned, it wouldn’t be too hard to extend that practice to cups.
It's a good example for how often plastic is used unnecessarily in medical practice, she says. The health care sector is the fifth biggest source of pollution and trash in industrialized countries. In the U.S., hospitals generate an estimated 6,000 tons of waste per day, including an average of 400 grams of plastic per patient per day, and this sector produces 8.5 percent of greenhouse gas emissions nationwide.
“Sustainable alternatives exist,” Stroetzel says, “but you have to painstakingly look for them; they are often not offered by the big manufacturers, and all of this takes way too much time [that] medical staff simply does not have during their hectic days.”
When Stroetzel spoke with medical staff in Germany, she found they were often frustrated by all of this waste, especially as they took care to avoid single-use plastic at home. Doctors in other countries share this frustration. In a recent poll, nine out of ten doctors in Germany said they’re aware of the urgency to find sustainable solutions in the health industry but don’t know how to achieve this goal.
After a year of researching more sustainable alternatives, Stroetzel founded a social enterprise startup called POP, short for Practice Without Plastic, together with IT expert Nicolai Niethe, to offer well-researched solutions. “Sustainable alternatives exist,” she says, “but you have to painstakingly look for them; they are often not offered by the big manufacturers, and all of this takes way too much time [that] medical staff simply does not have during their hectic days.”
In addition to reusable dentist cups, other good options for the heath care sector include washable N95 face masks and gloves made from nitrile, which waste less water and energy in their production. But Stroetzel admits that truly making a medical facility more sustainable is a complex task. “This includes negotiating with manufacturers who often package medical materials in double and triple layers of extra plastic.”
While initiatives such as Stroetzel’s provide much needed information, other experts reason that a wholesale rethinking of healthcare is needed. Voluntary action won’t be enough, and government should set the right example. Kari Nadeau, a Stanford physician who has spent 30 years researching the effects of environmental pollution on the immune system, and Kenneth Kizer, the former undersecretary for health in the U.S. Department of Veterans Affairs, wrote in JAMA last year that the medical industry and federal agencies that provide health care should be required to measure and make public their carbon footprints. “Government health systems do not disclose these data (and very rarely do private health care organizations), unlike more than 90% of the Standard & Poor’s top 500 companies and many nongovernment entities," they explained. "This could constitute a substantial step toward better equipping health professionals to confront climate change and other planetary health problems.”
Compared to the U.K., the U.S. healthcare industry lags behind in terms of measuring and managing its carbon footprint, and hospitals are the second highest energy user of any sector in the U.S.
Kizer and Nadeau look to the U.K. National Health Service (NHS), which created a Sustainable Development Unit in 2008 and began that year to conduct assessments of the NHS’s carbon footprint. The NHS also identified its biggest culprits: Of the 2019 footprint, with emissions totaling 25 megatons of carbon dioxide equivalent, 62 percent came from the supply chain, 24 percent from the direct delivery of care, 10 percent from staff commute and patient and visitor travel, and 4 percent from private health and care services commissioned by the NHS. From 1990 to 2019, the NHS has reduced its emission of carbon dioxide equivalents by 26 percent, mostly due to the switch to renewable energy for heat and power. Meanwhile, the NHS has encouraged health clinics in the U.K. to install wind generators or photovoltaics that convert light to electricity -- relatively quick ways to decarbonize buildings in the health sector.
Compared to the U.K., the U.S. healthcare industry lags behind in terms of measuring and managing its carbon footprint, and hospitals are the second highest energy user of any sector in the U.S. “We are already seeing patients with symptoms from climate change, such as worsened respiratory symptoms from increased wildfires and poor air quality in California,” write Thomas B. Newman, a pediatrist at the University of California, San Francisco, and UCSF clinical research coordinator Daisy Valdivieso. “Because of the enormous health threat posed by climate change, health professionals should mobilize support for climate mitigation and adaptation efforts.” They believe “the most direct place to start is to approach the low-lying fruit: reducing healthcare waste and overuse.”
In addition to resulting in waste, the plastic in hospitals ultimately harms patients, who may be even more vulnerable to the effects due to their health conditions. Microplastics have been detected in most humans, and on average, a human ingests five grams of microplastic per week. Newman and Valdivieso refer to the American Board of Internal Medicine's Choosing Wisely program as one of many initiatives that identify and publicize options for “safely doing less” as a strategy to reduce unnecessary healthcare practices, and in turn, reduce cost, resource use, and ultimately reduce medical harm.
A few U.S. clinics are pioneers in transitioning to clean energy sources. In Wisconsin, the nonprofit Gundersen Health network became the first hospital to cut its reliance on petroleum by switching to locally produced green energy in 2015, and it saved $1.2 million per year in the process. Kaiser Permanente eliminated its 800,000 ton carbon footprint through energy efficiency and purchasing carbon offsets, reaching a balance between carbon emissions and removing carbon from the atmosphere in 2020, the first U.S. health system to do so.
Cleveland Clinic has pledged to join Kaiser in becoming carbon neutral by 2027. Realizing that 80 percent of its 2008 carbon emissions came from electricity consumption, the Clinic started switching to renewable energy and installing solar panels, and it has invested in researching recyclable products and packaging. The Clinic’s sustainability report outlines several strategies for producing less waste, such as reusing cases for sterilizing instruments, cutting back on materials that can’t be recycled, and putting pressure on vendors to reduce product packaging.
The Charité Berlin, Europe’s biggest university hospital, has also announced its goal to become carbon neutral. Its sustainability managers have begun to identify the biggest carbon culprits in its operations. “We’ve already reduced CO2 emissions by 21 percent since 2016,” says Simon Batt-Nauerz, the director of infrastructure and sustainability.
The hospital still emits 100,000 tons of CO2 every year, as much as a city with 10,000 residents, but it’s making progress through ride share and bicycle programs for its staff of 20,000 employees, who can get their bikes repaired for free in one of the Charité-operated bike workshops. Another program targets doctors’ and nurses’ scrubs, which cause more than 200 tons of CO2 during manufacturing and cleaning. The staff is currently testing lighter, more sustainable scrubs made from recycled cellulose that is grown regionally and requires 80 percent less land use and 30 percent less water.
The Charité hospital in Berlin still emits 100,000 tons of CO2 every year, but it’s making progress through ride share and bicycle programs for its staff of 20,000 employees.
Wiebke Peitz | Specific to Charité
Anesthesiologist Susanne Koch spearheads sustainability efforts in anesthesiology at the Charité. She says that up to a third of hospital waste comes from surgery rooms. To reduce medical waste, she recommends what she calls the 5 Rs: Reduce, Reuse, Recycle, Rethink, Research. “In medicine, people don’t question the use of plastic because of safety concerns,” she says. “Nobody wants to be sued because something is reused. However, it is possible to reduce plastic and other materials safely.”
For instance, she says, typical surgery kits are single-use and contain more supplies than are actually needed, and the entire kit is routinely thrown out after the surgery. “Up to 20 percent of materials in a surgery room aren’t used but will be discarded,” Koch says. One solution could be smaller kits, she explains, and another would be to recycle the plastic. Another example is breathing tubes. “When they became scarce during the pandemic, studies showed that they can be used seven days instead of 24 hours without increased bacteria load when we change the filters regularly,” Koch says, and wonders, “What else can we reuse?”
In the Netherlands, TU Delft researchers Tim Horeman and Bart van Straten designed a method to melt down the blue polypropylene wrapping paper that keeps medical instruments sterile, so that the material can be turned it into new medical devices. Currently, more than a million kilos of the blue paper are used in Dutch hospitals every year. A growing number of Dutch hospitals are adopting this approach.
Another common practice that’s ripe for improvement is the use of a certain plastic, called PVC, in hospital equipment such as blood bags, tubes and masks. Because of its toxic components, PVC is almost never recycled in the U.S., but University of Michigan researchers Danielle Fagnani and Anne McNeil have discovered a chemical process that can break it down into material that could be incorporated back into production. This could be a step toward a circular economy “that accounts for resource inputs and emissions throughout a product’s life cycle, including extraction of raw materials, manufacturing, transport, use and reuse, and disposal,” as medical experts have proposed. “It’s a failure of humanity to have created these amazing materials which have improved our lives in many ways, but at the same time to be so shortsighted that we didn’t think about what to do with the waste,” McNeil said in a press release.
Susanne Koch puts it more succinctly: “What’s the point if we save patients while killing the planet?”
The Friday Five: A surprising health benefit for people who have kids
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five:
- Kids stressing you out? They could be protecting your health.
- A new device unlocks the heart's secrets
- Super-ager gene transplants
- Surgeons could 3D print your organs before operations
- A skull cap looks into the brain like an fMRI