Genetic Testing Companies Are Facing a Racial Bias Problem in Disease Risk Tests
Earlier this year, California-based Ambry Genetics announced that it was discontinuing a test meant to estimate a person's risk of developing prostate or breast cancer. The test looks for variations in a person's DNA that are known to be associated with these cancers.
Known as a polygenic risk score, this type of test adds up the effects of variants in many genes — often in the dozens or hundreds — and calculates a person's risk of developing a particular health condition compared to other people. In this way, polygenic risk scores are different from traditional genetic tests that look for mutations in single genes, such as BRCA1 and BRCA2, which raise the risk of breast cancer.
Traditional genetic tests look for mutations that are relatively rare in the general population but have a large impact on a person's disease risk, like BRCA1 and BRCA2. By contrast, polygenic risk scores scan for more common genetic variants that, on their own, have a small effect on risk. Added together, however, they can raise a person's risk for developing disease.
These scores could become a part of routine healthcare in the next few years. Researchers are developing polygenic risk scores for cancer, heart, disease, diabetes and even depression. Before they can be rolled out widely, they'll have to overcome a key limitation: racial bias.
"The issue with these polygenic risk scores is that the scientific studies which they're based on have primarily been done in individuals of European ancestry," says Sara Riordan, president of the National Society of Genetics Counselors. These scores are calculated by comparing the genetic data of people with and without a particular disease. To make these scores accurate, researchers need genetic data from tens or hundreds of thousands of people.
Myriad's old test would have shown that a Black woman had twice as high of a risk for breast cancer compared to the average woman even if she was at low or average risk.
A 2018 analysis found that 78% of participants included in such large genetic studies, known as genome-wide association studies, were of European descent. That's a problem, because certain disease-associated genetic variants don't appear equally across different racial and ethnic groups. For example, a particular variant in the TTR gene, known as V1221, occurs more frequently in people of African descent. In recent years, the variant has been found in 3 to 4 percent of individuals of African ancestry in the United States. Mutations in this gene can cause protein to build up in the heart, leading to a higher risk of heart failure. A polygenic risk score for heart disease based on genetic data from mostly white people likely wouldn't give accurate risk information to African Americans.
Accuracy in genetic testing matters because such polygenic risk scores could help patients and their doctors make better decisions about their healthcare.
For instance, if a polygenic risk score determines that a woman is at higher-than-average risk of breast cancer, her doctor might recommend more frequent mammograms — X-rays that take a picture of the breast. Or, if a risk score reveals that a patient is more predisposed to heart attack, a doctor might prescribe preventive statins, a type of cholesterol-lowering drug.
"Let's be clear, these are not diagnostic tools," says Alicia Martin, a population and statistical geneticist at the Broad Institute of MIT and Harvard. "We can't use a polygenic score to say you will or will not get breast cancer or have a heart attack."
But combining a patient's polygenic risk score with other factors that affect disease risk — like age, weight, medication use or smoking status — may provide a better sense of how likely they are to develop a specific health condition than considering any one risk factor one its own. The accuracy of polygenic risk scores becomes even more important when considering that these scores may be used to guide medication prescription or help patients make decisions about preventive surgery, such as a mastectomy.
In a study published in September, researchers used results from large genetics studies of people with European ancestry and data from the UK Biobank to calculate polygenic risk scores for breast and prostate cancer for people with African, East Asian, European and South Asian ancestry. They found that they could identify individuals at higher risk of breast and prostate cancer when they scaled the risk scores within each group, but the authors say this is only a temporary solution. Recruiting more diverse participants for genetics studies will lead to better cancer detection and prevent, they conclude.
Recent efforts to do just that are expected to make these scores more accurate in the future. Until then, some genetics companies are struggling to overcome the European bias in their tests.
Acknowledging the limitations of its polygenic risk score, Ambry Genetics said in April that it would stop offering the test until it could be recalibrated. The company launched the test, known as AmbryScore, in 2018.
"After careful consideration, we have decided to discontinue AmbryScore to help reduce disparities in access to genetic testing and to stay aligned with current guidelines," the company said in an email to customers. "Due to limited data across ethnic populations, most polygenic risk scores, including AmbryScore, have not been validated for use in patients of diverse backgrounds." (The company did not make a spokesperson available for an interview for this story.)
In September 2020, the National Comprehensive Cancer Network updated its guidelines to advise against the use of polygenic risk scores in routine patient care because of "significant limitations in interpretation." The nonprofit, which represents 31 major cancer cancers across the United States, said such scores could continue to be used experimentally in clinical trials, however.
Holly Pederson, director of Medical Breast Services at the Cleveland Clinic, says the realization that polygenic risk scores may not be accurate for all races and ethnicities is relatively recent. Pederson worked with Salt Lake City-based Myriad Genetics, a leading provider of genetic tests, to improve the accuracy of its polygenic risk score for breast cancer.
The company announced in August that it had recalibrated the test, called RiskScore, for women of all ancestries. Previously, Myriad did not offer its polygenic risk score to women who self-reported any ancestry other than sole European or Ashkenazi ancestry.
"Black women, while they have a similar rate of breast cancer to white women, if not lower, had twice as high of a polygenic risk score because the development and validation of the model was done in white populations," Pederson said of the old test. In other words, Myriad's old test would have shown that a Black woman had twice as high of a risk for breast cancer compared to the average woman even if she was at low or average risk.
To develop and validate the new score, Pederson and other researchers assessed data from more than 275,000 women, including more than 31,000 African American women and nearly 50,000 women of East Asian descent. They looked at 56 different genetic variants associated with ancestry and 93 associated with breast cancer. Interestingly, they found that at least 95% of the breast cancer variants were similar amongst the different ancestries.
The company says the resulting test is now more accurate for all women across the board, but Pederson cautions that it's still slightly less accurate for Black women.
"It's not only the lack of data from Black women that leads to inaccuracies and a lack of validation in these types of risk models, it's also the pure genomic diversity of Africa," she says, noting that Africa is the most genetically diverse continent on the planet. "We just need more data, not only in American Black women but in African women to really further characterize that continent."
Martin says it's problematic that such scores are most accurate for white people because they could further exacerbate health disparities in traditionally underserved groups, such as Black Americans. "If we were to set up really representative massive genetic studies, we would do a much better job at predicting genetic risk for everybody," she says.
Earlier this year, the National Institutes of Health awarded $38 million to researchers to improve the accuracy of polygenic risk scores in diverse populations. Researchers will create new genome datasets and pool information from existing ones in an effort to diversify the data that polygenic scores rely on. They plan to make these datasets available to other scientists to use.
"By having adequate representation, we can ensure that the results of a genetic test are widely applicable," Riordan says.
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Here are the promising studies covered in this week's Friday Five, featuring interviews with Dr. David Spiegel, associate chair of psychiatry and behavioral sciences at Stanford, and Dr. Filip Swirski, professor of medicine and cardiology at the Icahn School of Medicine at Mount Sinai.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five, featuring interviews with Dr. David Spiegel, associate chair of psychiatry and behavioral sciences at Stanford, and Dr. Filip Swirski, professor of medicine and cardiology at the Icahn School of Medicine at Mount Sinai.
- Breathing this way cuts down on anxiety*
- Could your fasting regimen make you sick?
- This type of job makes men more virile
- 3D printed hearts could save your life
- Yet another potential benefit of metformin
* This video with Dr. Andrew Huberman of Stanford shows exactly how to do the breathing practice.
This podcast originally aired on March 3, 2023.
Breakthrough drones deliver breast milk in rural Uruguay
Until three months ago, nurse Leopoldina Castelli used to send bottles of breast milk to nourish babies in the remote areas of Tacuarembó, in northern Uruguay, by way of ambulances or military trucks. That is, if the vehicles were available and the roads were passable, which wasn’t always the case. Now, five days per week, she stands by a runway at the hospital, located in Tacuarembó’s capital, watching a drone take off and disappear from view, carrying the milk to clinics that serve the babies’ families.
The drones can fly as far as 62 miles. Long distances and rough roads are no obstacles. The babies, whose mothers struggle to produce sufficient milk and cannot afford formula, now receive ample supplies for healthy growth. “Today we provided nourishment to a significantly larger number of children, and this is something that deeply moves me,” Castelli says.
About two decades ago, the Tacuarembó hospital established its own milk bank, supported by donations from mothers across Tacuarembó. Over the years, the bank has provided milk to infants immediately after birth. It's helped drive a “significant and sustained” decrease in infant mortality, says the hospital director, Ciro Ferreira.
But these children need breast milk throughout their first six months, if not longer, to prevent malnutrition and other illnesses that are prevalent in rural Tacuarembó. Ground transport isn't quick or reliable enough to meet this goal. It can take several hours, during which the milk may spoil due to a lack of refrigeration.
The battery-powered drones have been the difference-maker. The project to develop them, financed by the UNICEF Innovation Fund, is the first of its kind in Latin America. To Castelli, it's nothing short of a revolution. Tacuarembó Hospital, along with three rural clinics in the most impoverished part of Uruguay, are its leaders.
"This marks the first occasion when the public health system has been directly impacted [by our technology]," says Sebastián Macías, the CEO and co-founder of Cielum, an engineer at the University Republic, which collaborated on the technology with a Uruguayan company called Cielum and a Swiss company, Rigitech.
The drone can achieve a top speed of up to 68 miles per hour, is capable of flying in light rain, and can withstand winds of up to 30 miles per hour at a maximum altitude of 120 meters.
"We have succeeded in embracing the mothers from rural areas who were previously slipping through the cracks of the system," says Ferreira, the hospital director. He envisions an expansion of the service so it can improve health for children in other rural areas.
Nurses load the drone for breast milk delivery.
Sebastián Macías - Cielum
The star aircraft
The drone, which costs approximately $70,000, was specifically designed for the transportation of biological materials. Constructed from carbon fiber, it's three meters wide, two meters long and weighs 42 pounds when fully loaded. Additionally, it is equipped with a ballistic parachute to ensure a safe descent in case the technology fails in midair. Furthermore, it can achieve a top speed of 68 miles per hour, fly in light rain, and withstand winds of 30 miles per hour at a height of 120 meters.
Inside, the drones feature three refrigerated compartments that maintain a stable temperature and adhere to the United Nations’ standards for transporting perishable products. These compartments accommodate four gallons or 6.5 pounds of cargo. According to Macías, that's more than sufficient to carry a week’s worth of milk for one infant on just two flights, or 3.3 pounds of blood samples collected in a rural clinic.
“From an energy perspective, it serves as an efficient mode of transportation and helps reduce the carbon emissions associated with using an ambulance,” said Macías. Plus, the ambulance can remain available in the town.
Macías, who has led software development for the drone, and three other technicians have been trained to operate it. They ensure that the drone stays on course, monitor weather conditions and implement emergency changes when needed. The software displays the in-flight positions of the drones in relation to other aircraft. All agricultural planes in the region receive notification about the drone's flight path, departure and arrival times, and current location.
The future: doubling the drone's reach
Forty-five days after its inaugural flight, the drone is now making five flights per week. It serves two routes: 34 miles to Curtina and 31 miles to Tambores. The drone reaches Curtina in 50 minutes while ambulances take double that time, partly due to the subpar road conditions. Pueblo Ansina, located 40 miles from the state capital, will soon be introduced as the third destination.
Overall, the drone’s schedule is expected to become much busier, with plans to accomplish 20 weekly flights by the end of October and over 30 in 2024. Given the drone’s speed, Macías is contemplating using it to transport cancer medications as well.
“When it comes to using drones to save lives, for us, the sky is not the limit," says Ciro Ferreira, Tacuarembó hospital director.
In future trips to clinics in San Gregorio de Polanco and Caraguatá, the drone will be pushed to the limit. At these locations, a battery change will be necessary, but it's worth it. The route will cover up to 10 rural Tacuarembó clinics plus one hospital outside Tacuarembó, in Rivera, close to the border with Brazil. Currently, because of a shortage of ambulances, the delivery of pasteurized breast milk to Rivera only occurs every 15 days.
“The expansion to Rivera will include 100,000 more inhabitants, doubling the healthcare reach,” said Ferreira, the director of the Tacuarembó Hospital. In itself, Ferreira's hospital serves the medical needs of 500,000 people as one of the largest in Uruguay's interior.
Alejandro Del Estal, an aeronautical engineer at Rigitech, traveled from Europe to Tacuarembó to oversee the construction of the vertiports – the defined areas that can support drones’ take-off and landing – and the first flights. He pointed out that once the flight network between hospitals and rural polyclinics is complete in Uruguay, it will rank among the five most extensive drone routes in the world for any activity, including healthcare and commercial uses.
Cielum is already working on the long-term sustainability of the project. The aim is to have more drones operating in other rural regions in the western and northern parts of the country. The company has received inquiries from Argentina and Colombia, but, as Macías pointed out, they are exercising caution when making commitments. Expansion will depend on the development of each country’s regulations for airspace use.
For Ferreira, the advantages in Uruguay are evident: "This approach enables us to bridge the geographical gap, enhance healthcare accessibility, and reduce the time required for diagnosing and treating rural inhabitants, all without the necessity of them traveling to the hospital,” he says. "When it comes to using drones to save lives, for us, the sky is not the limit."