The Death Predictor: A Helpful New Tool or an Ethical Morass?
Whenever Eric Karl Oermann has to tell a patient about a terrible prognosis, their first question is always: "how long do I have?" Oermann would like to offer a precise answer, to provide some certainty and help guide treatment. But although he's one of the country's foremost experts in medical artificial intelligence, Oermann is still dependent on a computer algorithm that's often wrong.
Doctors are notoriously terrible at guessing how long their patients will live.
Artificial intelligence, now often called deep learning or neural networks, has radically transformed language and image processing. It's allowed computers to play chess better than the world's grand masters and outwit the best Jeopardy players. But it still can't precisely tell a doctor how long a patient has left – or how to help that person live longer.
Someday, researchers predict, computers will be able to watch a video of a patient to determine their health status. Doctors will no longer have to spend hours inputting data into medical records. And computers will do a better job than specialists at identifying tiny tumors, impending crises, and, yes, figuring out how long the patient has to live. Oermann, a neurosurgeon at Mount Sinai, says all that technology will allow doctors to spend more time doing what they do best: talking with their patients. "I want to see more deep learning and computers in a clinical setting," he says, "so there can be more human interaction." But those days are still at least three to five years off, Oermann and other researchers say.
Doctors are notoriously terrible at guessing how long their patients will live, says Nigam Shah, an associate professor at Stanford University and assistant director of the school's Center for Biomedical Informatics Research. Doctors don't want to believe that their patient – whom they've come to like – will die. "Doctors over-estimate survival many-fold," Shah says. "How do you go into work, in say, oncology, and not be delusionally optimistic? You have to be."
But patients near the end of life will get better treatment – and even live longer – if they are overseen by hospice or palliative care, research shows. So, instead of relying on human bias to select those whose lives are nearing their end, Shah and his colleagues showed that they could use a deep learning algorithm based on medical records to flag incoming patients with a life expectancy of three months to a year. They use that data to indicate who might need palliative care. Then, the palliative care team can reach out to treating physicians proactively, instead of relying on their referrals or taking the time to read extensive medical charts.
But, although the system works well, Shah isn't yet sure if such indicators actually get the appropriate patients into palliative care. He's recently partnered with a palliative care doctor to run a gold-standard clinical trial to test whether patients who are flagged by this algorithm are indeed a better match for palliative care.
"What is effective from a health system perspective might not be effective from a treating physician's perspective and might not be effective from the patient's perspective," Shah notes. "I don't have a good way to guess everybody's reaction without actually studying it." Whether palliative care is appropriate, for instance, depends on more than just the patient's health status. "If the patient's not ready, the family's not ready and the doctor's not ready, then you're just banging your head against the wall," Shah says. "Given limited capacity, it's a waste of resources" to put that person in palliative care.
The algorithm isn't perfect, but "on balance, it leads to better decisions more often."
Alexander Smith and Sei Lee, both palliative care doctors, work together at the University of California, San Francisco, to develop predictions for patients who come to the hospital with a complicated prognosis or a history of decline. Their algorithm, they say, helps decide if this patient's problems – which might include diabetes, heart disease, a slow-growing cancer, and memory issues – make them eligible for hospice. The algorithm isn't perfect, they both agree, but "on balance, it leads to better decisions more often," Smith says.
Bethany Percha, an assistant professor at Mount Sinai, says that an algorithm may tell doctors that their patient is trending downward, but it doesn't do anything to change that trajectory. "Even if you can predict something, what can you do about it?" Algorithms may be able to offer treatment suggestions – but not what specific actions will alter a patient's future, says Percha, also the chief technology officer of Precise Health Enterprise, a product development group within Mount Sinai. And the algorithms remain challenging to develop. Electronic medical records may be great at her hospital, but if the patient dies at a different one, her system won't know. If she wants to be certain a patient has died, she has to merge social security records of death with her system's medical records – a time-consuming and cumbersome process.
An algorithm that learns from biased data will be biased, Shah says. Patients who are poor or African American historically have had worse health outcomes. If researchers train an algorithm on data that includes those biases, they get baked into the algorithms, which can then lead to a self-fulfilling prophesy. Smith and Lee say they've taken race out of their algorithms to avoid this bias.
Age is even trickier. There's no question that someone's risk of illness and death goes up with age. But an 85-year-old who breaks a hip running a marathon should probably be treated very differently than an 85-year-old who breaks a hip trying to get out of a chair in a dementia care unit. That's why the doctor can never be taken out of the equation, Shah says. Human judgment will always be required in medical care and an algorithm should never be followed blindly, he says.
Experts say that the flaws in artificial intelligence algorithms shouldn't prevent people from using them – carefully.
Researchers are also concerned that their algorithms will be used to ration care, or that insurance companies will use their data to justify a rate increase. If an algorithm predicts a patient is going to end up back in the hospital soon, "who's benefitting from knowing a patient is going to be readmitted? Probably the insurance company," Percha says.
Still, Percha and others say, the flaws in artificial intelligence algorithms shouldn't prevent people from using them – carefully. "These are new and exciting tools that have a lot of potential uses. We need to be conscious about how to use them going forward, but it doesn't mean we shouldn't go down this road," she says. "I think the potential benefits outweigh the risks, especially because we've barely scratched the surface of what big data can do right now."
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Here are the promising studies covered in this week's Friday Five, featuring interviews with Dr. David Spiegel, associate chair of psychiatry and behavioral sciences at Stanford, and Dr. Filip Swirski, professor of medicine and cardiology at the Icahn School of Medicine at Mount Sinai.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five, featuring interviews with Dr. David Spiegel, associate chair of psychiatry and behavioral sciences at Stanford, and Dr. Filip Swirski, professor of medicine and cardiology at the Icahn School of Medicine at Mount Sinai.
- Breathing this way cuts down on anxiety*
- Could your fasting regimen make you sick?
- This type of job makes men more virile
- 3D printed hearts could save your life
- Yet another potential benefit of metformin
* This video with Dr. Andrew Huberman of Stanford shows exactly how to do the breathing practice.
This podcast originally aired on March 3, 2023.
Breakthrough drones deliver breast milk in rural Uruguay
Until three months ago, nurse Leopoldina Castelli used to send bottles of breast milk to nourish babies in the remote areas of Tacuarembó, in northern Uruguay, by way of ambulances or military trucks. That is, if the vehicles were available and the roads were passable, which wasn’t always the case. Now, five days per week, she stands by a runway at the hospital, located in Tacuarembó’s capital, watching a drone take off and disappear from view, carrying the milk to clinics that serve the babies’ families.
The drones can fly as far as 62 miles. Long distances and rough roads are no obstacles. The babies, whose mothers struggle to produce sufficient milk and cannot afford formula, now receive ample supplies for healthy growth. “Today we provided nourishment to a significantly larger number of children, and this is something that deeply moves me,” Castelli says.
About two decades ago, the Tacuarembó hospital established its own milk bank, supported by donations from mothers across Tacuarembó. Over the years, the bank has provided milk to infants immediately after birth. It's helped drive a “significant and sustained” decrease in infant mortality, says the hospital director, Ciro Ferreira.
But these children need breast milk throughout their first six months, if not longer, to prevent malnutrition and other illnesses that are prevalent in rural Tacuarembó. Ground transport isn't quick or reliable enough to meet this goal. It can take several hours, during which the milk may spoil due to a lack of refrigeration.
The battery-powered drones have been the difference-maker. The project to develop them, financed by the UNICEF Innovation Fund, is the first of its kind in Latin America. To Castelli, it's nothing short of a revolution. Tacuarembó Hospital, along with three rural clinics in the most impoverished part of Uruguay, are its leaders.
"This marks the first occasion when the public health system has been directly impacted [by our technology]," says Sebastián Macías, the CEO and co-founder of Cielum, an engineer at the University Republic, which collaborated on the technology with a Uruguayan company called Cielum and a Swiss company, Rigitech.
The drone can achieve a top speed of up to 68 miles per hour, is capable of flying in light rain, and can withstand winds of up to 30 miles per hour at a maximum altitude of 120 meters.
"We have succeeded in embracing the mothers from rural areas who were previously slipping through the cracks of the system," says Ferreira, the hospital director. He envisions an expansion of the service so it can improve health for children in other rural areas.
Nurses load the drone for breast milk delivery.
Sebastián Macías - Cielum
The star aircraft
The drone, which costs approximately $70,000, was specifically designed for the transportation of biological materials. Constructed from carbon fiber, it's three meters wide, two meters long and weighs 42 pounds when fully loaded. Additionally, it is equipped with a ballistic parachute to ensure a safe descent in case the technology fails in midair. Furthermore, it can achieve a top speed of 68 miles per hour, fly in light rain, and withstand winds of 30 miles per hour at a height of 120 meters.
Inside, the drones feature three refrigerated compartments that maintain a stable temperature and adhere to the United Nations’ standards for transporting perishable products. These compartments accommodate four gallons or 6.5 pounds of cargo. According to Macías, that's more than sufficient to carry a week’s worth of milk for one infant on just two flights, or 3.3 pounds of blood samples collected in a rural clinic.
“From an energy perspective, it serves as an efficient mode of transportation and helps reduce the carbon emissions associated with using an ambulance,” said Macías. Plus, the ambulance can remain available in the town.
Macías, who has led software development for the drone, and three other technicians have been trained to operate it. They ensure that the drone stays on course, monitor weather conditions and implement emergency changes when needed. The software displays the in-flight positions of the drones in relation to other aircraft. All agricultural planes in the region receive notification about the drone's flight path, departure and arrival times, and current location.
The future: doubling the drone's reach
Forty-five days after its inaugural flight, the drone is now making five flights per week. It serves two routes: 34 miles to Curtina and 31 miles to Tambores. The drone reaches Curtina in 50 minutes while ambulances take double that time, partly due to the subpar road conditions. Pueblo Ansina, located 40 miles from the state capital, will soon be introduced as the third destination.
Overall, the drone’s schedule is expected to become much busier, with plans to accomplish 20 weekly flights by the end of October and over 30 in 2024. Given the drone’s speed, Macías is contemplating using it to transport cancer medications as well.
“When it comes to using drones to save lives, for us, the sky is not the limit," says Ciro Ferreira, Tacuarembó hospital director.
In future trips to clinics in San Gregorio de Polanco and Caraguatá, the drone will be pushed to the limit. At these locations, a battery change will be necessary, but it's worth it. The route will cover up to 10 rural Tacuarembó clinics plus one hospital outside Tacuarembó, in Rivera, close to the border with Brazil. Currently, because of a shortage of ambulances, the delivery of pasteurized breast milk to Rivera only occurs every 15 days.
“The expansion to Rivera will include 100,000 more inhabitants, doubling the healthcare reach,” said Ferreira, the director of the Tacuarembó Hospital. In itself, Ferreira's hospital serves the medical needs of 500,000 people as one of the largest in Uruguay's interior.
Alejandro Del Estal, an aeronautical engineer at Rigitech, traveled from Europe to Tacuarembó to oversee the construction of the vertiports – the defined areas that can support drones’ take-off and landing – and the first flights. He pointed out that once the flight network between hospitals and rural polyclinics is complete in Uruguay, it will rank among the five most extensive drone routes in the world for any activity, including healthcare and commercial uses.
Cielum is already working on the long-term sustainability of the project. The aim is to have more drones operating in other rural regions in the western and northern parts of the country. The company has received inquiries from Argentina and Colombia, but, as Macías pointed out, they are exercising caution when making commitments. Expansion will depend on the development of each country’s regulations for airspace use.
For Ferreira, the advantages in Uruguay are evident: "This approach enables us to bridge the geographical gap, enhance healthcare accessibility, and reduce the time required for diagnosing and treating rural inhabitants, all without the necessity of them traveling to the hospital,” he says. "When it comes to using drones to save lives, for us, the sky is not the limit."