This App Helps Diagnose Rare Genetic Disorders from a Picture
Medical geneticist Omar Abdul-Rahman had a hunch. He thought that the three-year-old boy with deep-set eyes, a rounded nose, and uplifted earlobes might have Mowat-Wilson syndrome, but he'd never seen a patient with the rare disorder before.
"If it weren't for the app I'm not sure I would have had the confidence to say 'yes you should spend $1000 on this test."
Rahman had already ordered genetic tests for three different conditions without any luck, and he didn't want to cost the family any more money—or hope—if he wasn't sure of the diagnosis. So he took a picture of the boy and uploaded the photo to Face2Gene, a diagnostic aid for rare genetic disorders. Sure enough, Mowat-Wilson came up as a potential match. The family agreed to one final genetic test, which was positive for the syndrome.
"If it weren't for the app I'm not sure I would have had the confidence to say 'yes you should spend $1000 on this test,'" says Rahman, who is now the director of Genetic Medicine at the University of Nebraska Medical Center, but saw the boy when he was in the Department of Pediatrics at the University of Mississippi Medical Center in 2012.
"Families who are dealing with undiagnosed diseases never know what's going to come around the corner, what other organ system might be a problem next week," Rahman says. With a diagnosis, "You don't have to wait for the other shoe to drop because now you know the extent of the condition."
A diagnosis is the first and most important step for patients to attain medical care. Disease prognosis, treatment plans, and emotional coping all stem from this critical phase. But diagnosis can also be the trickiest part of the process, particularly for rare disorders. According to one European survey, 40 percent of rare diseases are initially misdiagnosed.
Healthcare professionals and medical technology companies hope that facial recognition software will help prevent families from facing difficult disruptions due to misdiagnoses.
"Patients with rare diseases or genetic disorders go through a long period of diagnostic odyssey, and just putting a name to a syndrome or finding a diagnosis can be very helpful and relieve a lot of tension for the family," says Dekel Gelbman, CEO of FDNA.
Consequently, a misdiagnosis can be devastating for families. Money and time may have been wasted on fruitless treatments, while opportunities for potentially helpful therapies or clinical trials were missed. Parents led down the wrong path must change their expectations of their child's long-term prognosis and care. In addition, they may be misinformed regarding future decisions about family planning.
Healthcare professionals and medical technology companies hope that facial recognition software will help prevent families from facing these difficult disruptions by improving the accuracy and ease of diagnosing genetic disorders. Traditionally, doctors diagnose these types of conditions by identifying unique patterns of facial features, a practice called dysmorphology. Trained physicians can read a child's face like a map and detect any abnormal ridges or plateaus—wide-set eyes, broad forehead, flat nose, rotated ears—that, combined with other symptoms such as intellectual disability or abnormal height and weight, signify a specific genetic disorder.
These morphological changes can be subtle, though, and often only specialized medical geneticists are able to detect and interpret these facial clues. What's more, some genetic disorders are so rare that even a specialist may not have encountered it before, much less a general practitioner. Diagnosing rare conditions has improved thanks to genomic testing that can confirm (or refute) a doctor's suspicion. Yet with thousands of variants in each person's genome, identifying the culprit mutation or deletion can be extremely difficult if you don't know what you're looking for.
Facial recognition technology is trying to take some of the guesswork out of this process. Software such as the Face2Gene app use machine learning to compare a picture of a patient against images of thousands of disorders and come back with suggestions of possible diagnoses.
"This is a classic field for artificial intelligence because no human being can really have enough knowledge and enough experience to be able to do this for thousands of different disorders."
"When we met a geneticist for the first time we were pretty blown away with the fact that they actually use their own human pattern recognition" to diagnose patients, says Gelbman. "This is a classic field for AI [artificial intelligence], for machine learning because no human being can really have enough knowledge and enough experience to be able to do this for thousands of different disorders."
When a physician uploads a photo to the app, they are given a list of different diagnostic suggestions, each with a heat map to indicate how similar the facial features are to a classic representation of the syndrome. The physician can hone the suggestions by adding in other symptoms or family history. Gelbman emphasized that the app is a "search and reference tool" and should not "be used to diagnose or treat medical conditions." It is not approved by the FDA as a diagnostic.
"As a tool, we've all been waiting for this, something that can help everyone," says Julian Martinez-Agosto, an associate professor in human genetics and pediatrics at UCLA. He sees the greatest benefit of facial recognition technology in its ability to empower non-specialists to make a diagnosis. Many areas, including rural communities or resource-poor countries, do not have access to either medical geneticists trained in these types of diagnostics or genomic screens. Apps like Face2Gene can help guide a general practitioner or flag diseases they might not be familiar with.
One concern is that most textbook images of genetic disorders come from the West, so the "classic" face of a condition is often a child of European descent.
Maximilian Muenke, a senior investigator at the National Human Genome Research Institute (NHGRI), agrees that in many countries, facial recognition programs could be the only way for a doctor to make a diagnosis.
"There are only geneticists in countries like the U.S., Canada, Europe, Japan. In most countries, geneticists don't exist at all," Muenke says. "In Nigeria, the most populous country in all of Africa with 160 million people, there's not a single clinical geneticist. So in a country like that, facial recognition programs will be sought after and will be extremely useful to help make a diagnosis to the non-geneticists."
One concern about providing this type of technology to a global population is that most textbook images of genetic disorders come from the West, so the "classic" face of a condition is often a child of European descent. However, the defining facial features of some of these disorders manifest differently across ethnicities, leaving clinicians from other geographic regions at a disadvantage.
"Every syndrome is either more easy or more difficult to detect in people from different geographic backgrounds," explains Muenke. For example, "in some countries of Southeast Asia, the eyes are slanted upward, and that happens to be one of the findings that occurs mostly with children with Down Syndrome. So then it might be more difficult for some individuals to recognize Down Syndrome in children from Southeast Asia."
There is a risk that providing this type of diagnostic information online will lead to parents trying to classify their own children.
To combat this issue, Muenke helped develop the Atlas of Human Malformation Syndromes, a database that incorporates descriptions and pictures of patients from every continent. By providing examples of rare genetic disorders in children from outside of the United States and Europe, Muenke hopes to provide clinicians with a better understanding of what to look for in each condition, regardless of where they practice.
There is a risk that providing this type of diagnostic information online will lead to parents trying to classify their own children. Face2Gene is free to download in the app store, although users must be authenticated by the company as a healthcare professional before they can access the database. The NHGRI Atlas can be accessed by anyone through their website. However, Martinez and Muenke say parents already use Google and WebMD to look up their child's symptoms; facial recognition programs and databases are just an extension of that trend. In fact, Martinez says, "Empowering families is another way to facilitate access to care. Some families live in rural areas and have no access to geneticists. If they can use software to get a diagnosis and then contact someone at a large hospital, it can help facilitate the process."
Martinez also says the app could go further by providing greater transparency about how the program makes its assessments. Giving clinicians feedback about why a diagnosis fits certain facial features would offer a valuable teaching opportunity in addition to a diagnostic aid.
Both Martinez and Muenke think the technology is an innovation that could vastly benefit patients. "In the beginning, I was quite skeptical and I could not believe that a machine could replace a human," says Muenke. "However, I am a convert that it actually can help tremendously in making a diagnosis. I think there is a place for facial recognition programs, and I am a firm believer that this will spread over the next five years."
A sleek, four-foot tall white robot glides across a cafe storefront in Tokyo’s Nihonbashi district, holding a two-tiered serving tray full of tea sandwiches and pastries. The cafe’s patrons smile and say thanks as they take the tray—but it’s not the robot they’re thanking. Instead, the patrons are talking to the person controlling the robot—a restaurant employee who operates the avatar from the comfort of their home.
It’s a typical scene at DAWN, short for Diverse Avatar Working Network—a cafe that launched in Tokyo six years ago as an experimental pop-up and quickly became an overnight success. Today, the cafe is a permanent fixture in Nihonbashi, staffing roughly 60 remote workers who control the robots remotely and communicate to customers via a built-in microphone.
More than just a creative idea, however, DAWN is being hailed as a life-changing opportunity. The workers who control the robots remotely (known as “pilots”) all have disabilities that limit their ability to move around freely and travel outside their homes. Worldwide, an estimated 16 percent of the global population lives with a significant disability—and according to the World Health Organization, these disabilities give rise to other problems, such as exclusion from education, unemployment, and poverty.
These are all problems that Kentaro Yoshifuji, founder and CEO of Ory Laboratory, which supplies the robot servers at DAWN, is looking to correct. Yoshifuji, who was bedridden for several years in high school due to an undisclosed health problem, launched the company to help enable people who are house-bound or bedridden to more fully participate in society, as well as end the loneliness, isolation, and feelings of worthlessness that can sometimes go hand-in-hand with being disabled.
“It’s heartbreaking to think that [people with disabilities] feel they are a burden to society, or that they fear their families suffer by caring for them,” said Yoshifuji in an interview in 2020. “We are dedicating ourselves to providing workable, technology-based solutions. That is our purpose.”
Shota Kuwahara, a DAWN employee with muscular dystrophy. Ory Labs, Inc.
Wanting to connect with others and feel useful is a common sentiment that’s shared by the workers at DAWN. Marianne, a mother of two who lives near Mt. Fuji, Japan, is functionally disabled due to chronic pain and fatigue. Working at DAWN has allowed Marianne to provide for her family as well as help alleviate her loneliness and grief.Shota, Kuwahara, a DAWN employee with muscular dystrophy, agrees. "There are many difficulties in my daily life, but I believe my life has a purpose and is not being wasted," he says. "Being useful, able to help other people, even feeling needed by others, is so motivational."
When a patient is diagnosed with early-stage breast cancer, having surgery to remove the tumor is considered the standard of care. But what happens when a patient can’t have surgery?
Whether it’s due to high blood pressure, advanced age, heart issues, or other reasons, some breast cancer patients don’t qualify for a lumpectomy—one of the most common treatment options for early-stage breast cancer. A lumpectomy surgically removes the tumor while keeping the patient’s breast intact, while a mastectomy removes the entire breast and nearby lymph nodes.
Fortunately, a new technique called cryoablation is now available for breast cancer patients who either aren’t candidates for surgery or don’t feel comfortable undergoing a surgical procedure. With cryoablation, doctors use an ultrasound or CT scan to locate any tumors inside the patient’s breast. They then insert small, needle-like probes into the patient's breast which create an “ice ball” that surrounds the tumor and kills the cancer cells.
Cryoablation has been used for decades to treat cancers of the kidneys and liver—but only in the past few years have doctors been able to use the procedure to treat breast cancer patients. And while clinical trials have shown that cryoablation works for tumors smaller than 1.5 centimeters, a recent clinical trial at Memorial Sloan Kettering Cancer Center in New York has shown that it can work for larger tumors, too.
In this study, doctors performed cryoablation on patients whose tumors were, on average, 2.5 centimeters. The cryoablation procedure lasted for about 30 minutes, and patients were able to go home on the same day following treatment. Doctors then followed up with the patients after 16 months. In the follow-up, doctors found the recurrence rate for tumors after using cryoablation was only 10 percent.
For patients who don’t qualify for surgery, radiation and hormonal therapy is typically used to treat tumors. However, said Yolanda Brice, M.D., an interventional radiologist at Memorial Sloan Kettering Cancer Center, “when treated with only radiation and hormonal therapy, the tumors will eventually return.” Cryotherapy, Brice said, could be a more effective way to treat cancer for patients who can’t have surgery.
“The fact that we only saw a 10 percent recurrence rate in our study is incredibly promising,” she said.