World’s First “Augmented Reality” Contact Lens Aims to Revolutionize Much More Than Medicine
Imagine a world without screens. Instead of endlessly staring at your computer or craning your neck down to scroll through social media feeds and emails, information simply appears in front of your eyes when you need it and disappears when you don't.
"The vision is super clear...I was reading the poem with my eyes closed."
No more rude interruptions during dinner, no more bumping into people on the street while trying to follow GPS directions — just the information you want, when you need it, projected directly onto your visual field.
While this screenless future sounds like science fiction, it may soon be a reality thanks to the new Silicon Valley startup Mojo Vision, creator of the world's first smart contact lens. With a 14,000 pixel-per-inch display with eye-tracking, image stabilization, and a custom wireless radio, the Mojo smart lens bills itself the "smallest and densest dynamic display ever made." Unlike current augmented reality wearables such as Google Glass or ThirdEye, which project images onto a glass screen, the Mojo smart lens can project images directly onto the retina.
A current prototype displayed at the Consumer Electronics Show earlier this year in Las Vegas includes a tiny screen positioned right above the most sensitive area of the pupil. "[The Mojo lens] is a contact lens that essentially has wireless power and data transmission for a small micro LED projector that is placed over the center of the eye," explains David Hobbs, Director of Product Management at Mojo Vision. "[It] displays critical heads-up information when you need it and fades into the background when you're ready to continue on with your day."
Eventually, Mojo Visions' technology could replace our beloved smart devices but the first generation of the Mojo smart lens will be used to help the 2.2 billion people globally who suffer from vision impairment.
"If you think of the eye as a camera [for the visually impaired], the sensors are not working properly," explains Dr. Ashley Tuan, Vice President of Medical Devices at Mojo Vision and fellow of the American Academy of Optometry. "For this population, our lens can process the image so the contrast can be enhanced, we can make the image larger, magnify it so that low-vision people can see it or we can make it smaller so they can check their environment." In January of this year, the FDA granted Breakthrough Device Designation to Mojo, allowing them to have early and frequent discussions with the FDA about technical, safety and efficacy topics before clinical trials can be done and certification granted.
For now, Dr. Tuan is one of the few people who has actually worn the Mojo lens. "I put the contact lens on my eye. It was very comfortable like any contact lenses I've worn before," she describes. "The vision is super clear and then when I put on the accessories, suddenly I see Yoda in front of me and I see my vital signs. And then I have my colleague that prepared a beautiful poem that I loved when I was young [and] I was reading the poem with my eyes closed."
At the moment, there are several electronic glasses on the market like Acesight and Nueyes Pro that provide similar solutions for those suffering from visual impairment, but they are large, cumbersome, and highly visible. Mojo lens would be a discreet, more comfortable alternative that offers users more freedom of movement and independence.
"In the case of augmented-reality contact lenses, there could be an opportunity to improve the lives of people with low vision," says Dr. Thomas Steinemann, spokesperson for the American Academy of Ophthalmology and professor of ophthalmology at MetroHealth Medical Center in Cleveland. "There are existing tools for people currently living with low vision—such as digital apps, magnifiers, etc.— but something wearable could provide more flexibility and significantly more aid in day-to-day tasks."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless.
According to Dr. Tuan, the visually impaired often suffer from depression due to their lack of mobility and 70 percent of them are underemployed. "We hope that they can use this device to gain their mobility so they can get that social aspect back in their lives and then, eventually, employment," she explains. "That is our first and most important goal."
But helping those with low visual capabilities is only Mojo lens' first possible medical application; augmented reality is already being used in medicine and is poised to revolutionize the field in the coming decades. For example, Accuvein, a device that uses lasers to provide real-time images of veins, is widely used by nurses and doctors to help with the insertion of needles for IVs and blood tests.
According to the National Center for Biotechnology Information, augmentation of reality has been used in surgery for many years with surgeons using devices such as Google Glass to overlay critical information about their patients into their visual field. Using software like the Holographic Navigation Platform by Scopsis, surgeons can see a mixed-reality overlay that can "show you complicated tumor boundaries, assist with implant placements and guide you along anatomical pathways," its developers say.
However, according to Dr. Tuan, augmented reality headsets have drawbacks in the surgical setting. "The advantage of [Mojo lens] is you don't need to worry about sweating or that the headset or glasses will slide down to your nose," she explains "Also, our lens is designed so that it will understand your intent, so when you don't want the image overlay it will disappear, it will not block your visual field, and when you need it, it will come back at the right time."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless. Possibilities include live translation of sign language for deaf people; helping those with autism to read emotions; and improving doctors' bedside manner by allowing them to fully engage with patients without relying on a computer.
"[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
Furthermore, the lens could be used to monitor health issues. "We have image sensors in the lens right now that point to the world but we can have a camera pointing inside of your eye to your retina," says Dr. Tuan, "[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
For the moment, the future medical applications of the Mojo lens are still theoretical, but the team is confident they can eventually become a reality after going through the proper regulatory review. The company is still in the process of design, prototype and testing of the lens, so they don't know exactly when it will be available for use, but they anticipate shipping the first available products in the next couple of years. Once it does go to market, it will be available by prescription only for those with visual impairments, but the team's goal is to bring it to broader consumer markets pending regulatory clearance.
"We see that right now there's a unique opportunity here for Mojo lens and invisible computing to help to shape what the next decade of technology development looks like," explains David Hobbs. "We can use [the Mojo lens] to better serve us as opposed to us serving technology better."
After spaceflight record, NASA looks to protect astronauts on even longer trips
At T-minus six seconds, the main engines of the Atlantis Space Shuttle ignited, rattling its capsule “like a skyscraper in an earthquake,” according to astronaut Tom Jones, describing the 1988 launch. As the rocket lifted off and accelerated to three times the force of Earth's gravity, “It felt as if two of my friends were standing on my chest and wouldn’t get off.” But when Atlantis reached orbit, the main engines cut off, and the astronauts were suddenly weightless.
Since 1961, NASA has sent hundreds of astronauts into space while working to making their voyages safer and smoother. Yet, challenges remain. Weightlessness may look amusing when watched from Earth, but it has myriad effects on cognition, movement and other functions. When missions to space stretch to six months or longer, microgravity can impact astronauts’ health and performance, making it more difficult to operate their spacecraft.
Yesterday, NASA astronaut Frank Rubio returned to Earth after over one year, the longest single spaceflight for a U.S. astronaut. But this is just the start; longer and more complex missions into deep space loom ahead, from returning to the moon in 2025 to eventually sending humans to Mars. To ensure that these missions succeed, NASA is increasing efforts to study the biological effects and prevent harm.
The dangers of microgravity are real
A NASA report published in 2016 details a long list of incidents and near-misses caused – at least partly – by space-induced changes in astronauts’ vision and coordination. These issues make it harder to move with precision and to judge distance and velocity.
According to the report, in 1997, a resupply ship collided with the Mir space station, possibly because a crew member bumped into the commander during the final docking maneuver. This mishap caused significant damage to the space station.
Returns to Earth suffered from problems, too. The same report notes that touchdown speeds during the first 100 space shuttle landings were “outside acceptable limits. The fastest landing on record – 224 knots (258 miles) per hour – was linked to the commander’s momentary spatial disorientation.” Earlier, each of the six Apollo crews that landed on the moon had difficulty recognizing moon landmarks and estimating distances. For example, Apollo 15 landed in an unplanned area, ultimately straddling the rim of a five-foot deep crater on the moon, harming one of its engines.
Spaceflight causes unique stresses on astronauts’ brains and central nervous systems. NASA is working to reduce these harmful effects.
NASA
Space messes up your brain
In space, astronauts face the challenges of microgravity, ionizing radiation, social isolation, high workloads, altered circadian rhythms, monotony, confined living quarters and a high-risk environment. Among these issues, microgravity is one of the most consequential in terms of physiological changes. It changes the brain’s structure and its functioning, which can hurt astronauts’ performance.
The brain shifts upwards within the skull, displacing the cerebrospinal fluid, which reduces the brain’s cushioning. Essentially, the brain becomes crowded inside the skull like a pair of too-tight shoes.
That’s partly because of how being in space alters blood flow. On Earth, gravity pulls our blood and other internal fluids toward our feet, but our circulatory valves ensure that the fluids are evenly distributed throughout the body. In space, there’s not enough gravity to pull the fluids down, and they shift up, says Rachael D. Seidler, a physiologist specializing in spaceflight at the University of Florida and principal investigator on many space-related studies. The head swells and legs appear thinner, causing what astronauts call “puffy face chicken legs.”
“The brain changes at the structural and functional level,” says Steven Jillings, equilibrium and aerospace researcher at the University of Antwerp in Belgium. “The brain shifts upwards within the skull,” displacing the cerebrospinal fluid, which reduces the brain’s cushioning. Essentially, the brain becomes crowded inside the skull like a pair of too-tight shoes. Some of the displaced cerebrospinal fluid goes into cavities within the brain, called ventricles, enlarging them. “The remaining fluids pool near the chest and heart,” explains Jillings. After 12 consecutive months in space, one astronaut had a ventricle that was 25 percent larger than before the mission.
Some changes reverse themselves while others persist for a while. An example of a longer-lasting problem is spaceflight-induced neuro-ocular syndrome, which results in near-sightedness and pressure inside the skull. A study of approximately 300 astronauts shows near-sightedness affects about 60 percent of astronauts after long missions on the International Space Station (ISS) and more than 25 percent after spaceflights of only a few weeks.
Another long-term change could be the decreased ability of cerebrospinal fluid to clear waste products from the brain, Seidler says. That’s because compressing the brain also compresses its waste-removing glymphatic pathways, resulting in inflammation, vulnerability to injuries and worsening its overall health.
The effects of long space missions were best demonstrated on astronaut twins Scott and Mark Kelly. This NASA Twins Study showed multiple, perhaps permanent, changes in Scott after his 340-day mission aboard the ISS, compared to Mark, who remained on Earth. The differences included declines in Scott’s speed, accuracy and cognitive abilities that persisted longer than six months after returning to Earth in March 2016.
By the end of 2020, Scott’s cognitive abilities improved, but structural and physiological changes to his eyes still remained, he said in a BBC interview.
“It seems clear that the upward shift of the brain and compression of the surrounding tissues with ventricular expansion might not be a good thing,” Seidler says. “But, at this point, the long-term consequences to brain health and human performance are not really known.”
NASA astronaut Kate Rubins conducts a session for the Neuromapping investigation.
NASA
Staying sharp in space
To investigate how prolonged space travel affects the brain, NASA launched a new initiative called the Complement of Integrated Protocols for Human Exploration Research (CIPHER). “CIPHER investigates how long-duration spaceflight affects both brain structure and function,” says neurobehavioral scientist Mathias Basner at the University of Pennsylvania, a principal investigator for several NASA studies. “Through it, we can find out how the brain adapts to the spaceflight environment and how certain brain regions (behave) differently after – relative to before – the mission.”
To do this, he says, “Astronauts will perform NASA’s cognition test battery before, during and after six- to 12-month missions, and will also perform the same test battery in an MRI scanner before and after the mission. We have to make sure we better understand the functional consequences of spaceflight on the human brain before we can send humans safely to the moon and, especially, to Mars.”
As we go deeper into space, astronauts cognitive and physical functions will be even more important. “A trip to Mars will take about one year…and will introduce long communication delays,” Seidler says. “If you are on that mission and have a problem, it may take eight to 10 minutes for your message to reach mission control, and another eight to 10 minutes for the response to get back to you.” In an emergency situation, that may be too late for the response to matter.
“On a mission to Mars, astronauts will be exposed to stressors for unprecedented amounts of time,” Basner says. To counter them, NASA is considering the continuous use of artificial gravity during the journey, and Seidler is studying whether artificial gravity can reduce the harmful effects of microgravity. Some scientists are looking at precision brain stimulation as a way to improve memory and reduce anxiety due to prolonged exposure to radiation in space.
Other scientists are exploring how to protect neural stem cells (which create brain cells) from radiation damage, developing drugs to repair damaged brain cells and protect cells from radiation.
To boldly go where no astronauts have gone before, they must have optimal reflexes, vision and decision-making. In the era of deep space exploration, the brain—without a doubt—is the final frontier.
Additionally, NASA is scrutinizing each aspect of the mission, including astronaut exercise, nutrition and intellectual engagement. “We need to give astronauts meaningful work. We need to stimulate their sensory, cognitive and other systems appropriately,” Basner says, especially given their extreme confinement and isolation. The scientific experiments performed on the ISS – like studying how microgravity affects the ability of tissue to regenerate is a good example.
“We need to keep them engaged socially, too,” he continues. The ISS crew, for example, regularly broadcasts from space and answers prerecorded questions from students on Earth, and can engage with social media in real time. And, despite tight quarters, NASA is ensuring the crew capsule and living quarters on the moon or Mars include private space, which is critical for good mental health.
Exploring deep space builds on a foundation that began when astronauts first left the planet. With each mission, scientists learn more about spaceflight effects on astronauts’ bodies. NASA will be using these lessons to succeed with its plans to build science stations on the moon and, eventually, Mars.
“Through internally and externally led research, investigations implemented in space and in spaceflight simulations on Earth, we are striving to reduce the likelihood and potential impacts of neurostructural changes in future, extended spaceflight,” summarizes NASA scientist Alexandra Whitmire. To boldly go where no astronauts have gone before, they must have optimal reflexes, vision and decision-making. In the era of deep space exploration, the brain—without a doubt—is the final frontier.
A newly discovered brain cell may lead to better treatments for cognitive disorders
Swiss researchers have discovered a third type of brain cell that appears to be a hybrid of the two other primary types — and it could lead to new treatments for many brain disorders.
The challenge: Most of the cells in the brain are either neurons or glial cells. While neurons use electrical and chemical signals to send messages to one another across small gaps called synapses, glial cells exist to support and protect neurons.
Astrocytes are a type of glial cell found near synapses. This close proximity to the place where brain signals are sent and received has led researchers to suspect that astrocytes might play an active role in the transmission of information inside the brain — a.k.a. “neurotransmission” — but no one has been able to prove the theory.
A new brain cell: Researchers at the Wyss Center for Bio and Neuroengineering and the University of Lausanne believe they’ve definitively proven that some astrocytes do actively participate in neurotransmission, making them a sort of hybrid of neurons and glial cells.
According to the researchers, this third type of brain cell, which they call a “glutamatergic astrocyte,” could offer a way to treat Alzheimer’s, Parkinson’s, and other disorders of the nervous system.
“Its discovery opens up immense research prospects,” said study co-director Andrea Volterra.
The study: Neurotransmission starts with a neuron releasing a chemical called a neurotransmitter, so the first thing the researchers did in their study was look at whether astrocytes can release the main neurotransmitter used by neurons: glutamate.
By analyzing astrocytes taken from the brains of mice, they discovered that certain astrocytes in the brain’s hippocampus did include the “molecular machinery” needed to excrete glutamate. They found evidence of the same machinery when they looked at datasets of human glial cells.
Finally, to demonstrate that these hybrid cells are actually playing a role in brain signaling, the researchers suppressed their ability to secrete glutamate in the brains of mice. This caused the rodents to experience memory problems.
“Our next studies will explore the potential protective role of this type of cell against memory impairment in Alzheimer’s disease, as well as its role in other regions and pathologies than those explored here,” said Andrea Volterra, University of Lausanne.
But why? The researchers aren’t sure why the brain needs glutamatergic astrocytes when it already has neurons, but Volterra suspects the hybrid brain cells may help with the distribution of signals — a single astrocyte can be in contact with thousands of synapses.
“Often, we have neuronal information that needs to spread to larger ensembles, and neurons are not very good for the coordination of this,” researcher Ludovic Telley told New Scientist.
Looking ahead: More research is needed to see how the new brain cell functions in people, but the discovery that it plays a role in memory in mice suggests it might be a worthwhile target for Alzheimer’s disease treatments.
The researchers also found evidence during their study that the cell might play a role in brain circuits linked to seizures and voluntary movements, meaning it’s also a new lead in the hunt for better epilepsy and Parkinson’s treatments.
“Our next studies will explore the potential protective role of this type of cell against memory impairment in Alzheimer’s disease, as well as its role in other regions and pathologies than those explored here,” said Volterra.