Send in the Robots: A Look into the Future of Firefighting
April in Paris stood still. Flames engulfed the beloved Notre Dame Cathedral as the world watched, horrified, in 2019. The worst looked inevitable when firefighters were forced to retreat from the out-of-control fire.
But the Paris Fire Brigade had an ace up their sleeve: Colossus, a firefighting robot. The seemingly indestructible tank-like machine ripped through the blaze with its motorized water cannon. It was able to put out flames in places that would have been deadly for firefighters.
Firefighting is entering a new era, driven by necessity. Conventional methods of managing fires have been no match for the fiercer, more expansive fires being triggered by climate change, urban sprawl, and susceptible wooded areas.
Robots have been a game-changer. Inspired by Paris, the Los Angeles Fire Department (LAFD) was the first in the U.S. to deploy a firefighting robot in 2021, the Thermite Robotics System 3 – RS3, for short.
RS3 is a 3,500-pound turbine on a crawler—the size of a Smart car—with a 36.8 horsepower engine that can go for 20 hours without refueling. It can plow through hazardous terrain, move cars from its path, and pull an 8,000-pound object from a fire.
All that while spurting 2,500 gallons of water per minute with a rear exhaust fan clearing the smoke. At a recent trade show, RS3 was billed as equivalent to 10 firefighters. The Los Angeles Times referred to it as “a droid on steroids.”
Robots such as the Thermite RS3 can plow through hazardous terrain and pull an 8,000-pound object from a fire.
Los Angeles Fire Department
The advantage of the robot is obvious. Operated remotely from a distance, it greatly reduces an emergency responder’s exposure to danger, says Wade White, assistant chief of the LAFD. The robot can be sent into airplane fires, nuclear reactors, hazardous areas with carcinogens (think East Palestine, Ohio), or buildings where a roof collapse is imminent.
Advances for firefighters are taking many other forms as well. Fibers have been developed that make the firefighter’s coat lighter and more protective from carcinogens. New wearable devices track firefighters’ biometrics in real time so commanders can monitor their heat stress and exertion levels. A sensor patch is in development which takes readings every four seconds to detect dangerous gases such as methane and carbon dioxide. A sonic fire extinguisher is being explored that uses low frequency soundwaves to remove oxygen from air molecules without unhealthy chemical compounds.
The demand for this technology is only increasing, especially with the recent rise in wildfires. In 2021, fires were responsible for 3,800 deaths and 14,700 injuries of civilians in this country. Last year, 68,988 wildfires burned down 7.6 million acres. Whether the next generation of firefighting can address these new challenges could depend on special cameras, robots of the aerial variety, AI and smart systems.
Fighting fire with cameras
Another key innovation for firefighters is a thermal imaging camera (TIC) that improves visibility through smoke. “At a fire, you might not see your hand in front of your face,” says White. “Using the TIC screen, you can find the door to get out safely or see a victim in the corner.” Since these cameras were introduced in the 1990s, the price has come down enough (from $10,000 or more to about $700) that every LAFD firefighter on duty has been carrying one since 2019, says White.
TICs are about the size of a cell phone. The camera can sense movement and body heat so it is ideal as a search tool for people trapped in buildings. If a firefighter has not moved in 30 seconds, the motion detector picks that up, too, and broadcasts a distress signal and directional information to others.
To enable firefighters to operate the camera hands-free, the newest TICs can attach inside a helmet. The firefighter sees the images inside their mask.
TICs also can be mounted on drones to get a bird’s-eye, 360 degree view of a disaster or scout for hot spots through the smoke. In addition, the camera can take photos to aid arson investigations or help determine the cause of a fire.
More help From above
Firefighters prefer the term “unmanned aerial systems” (UAS) to drones to differentiate them from military use.
A UAS carrying a camera can provide aerial scene monitoring and topography maps to help fire captains deploy resources more efficiently. At night, floodlights from the drone can illuminate the landscape for firefighters. They can drop off payloads of blankets, parachutes, life preservers or radio devices for stranded people to communicate, too. And like the robot, the UAS reduces risks for ground crews and helicopter pilots by limiting their contact with toxic fumes, hazardous chemicals, and explosive materials.
“The nice thing about drones is that they perform multiple missions at once,” says Sean Triplett, team lead of fire and aviation management, tools and technology at the Forest Service.
Experts predict we’ll see swarms of drones dropping water and fire retardant on burning buildings and forests in the near future.
The UAS is especially helpful during wildfires because it can track fires, get ahead of wind currents and warn firefighters of wind shifts in real time. The U.S. Forest Service also uses long endurance, solar-powered drones that can fly for up to 30 days at a time to detect early signs of wildfire. Wildfires are no longer seasonal in California – they are a year-long threat, notes Thanh Nguyen, fire captain at the Orange County Fire Authority.
In March, Nguyen’s crew deployed a drone to scope out a huge landslide following torrential rains in San Clemente, CA. Emergency responders used photos and videos from the drone to survey the evacuated area, enabling them to stay clear of ground on the hillside that was still sliding.
Improvements in drone batteries are enabling them to fly for longer with heavier payloads. Experts predict we’ll see swarms of drones dropping water and fire retardant on burning buildings and forests in the near future.
AI to the rescue
The biggest peril for a firefighter is often what they don’t see coming. Flashovers are a leading cause of firefighter deaths, for example. They occur when flammable materials in an enclosed area ignite almost instantaneously. Or dangerous backdrafts can happen when a firefighter opens a window or door; the air rushing in can ignite a fire without warning.
The Fire Fighting Technology Group at the National Institute of Standards and Technology (NIST) is developing tools and systems to predict these potentially lethal events with computer models and artificial intelligence.
Partnering with other institutions, NIST researchers developed the Flashover Prediction Neural Network (FlashNet) after looking at common house layouts and running sets of scenarios through a machine-learning model. In the lab, FlashNet was able to predict a flashover 30 seconds before it happened with 92.1% success. When ready for release, the technology will be bundled with sensors that are already installed in buildings, says Anthony Putorti, leader of the NIST group.
The NIST team also examined data from hundreds of backdrafts as a basis for a machine-learning model to predict them. In testing chambers the model predicted them correctly 70.8% of the time; accuracy increased to 82.4% when measures of backdrafts were taken in more positions at different heights in the chambers. Developers are working on how to integrate the AI into a small handheld device that can probe the air of a room through cracks around a door or through a created opening, Putorti says. This way, the air can be analyzed with the device to alert firefighters of any significant backdraft risk.
Early wildfire detection technologies based on AI are in the works, too. The Forest Service predicts the acreage burned each year during wildfires will more than triple in the next 80 years. By gathering information on historic fires, weather patterns, and topography, says White, AI can help firefighters manage wildfires before they grow out of control and create effective evacuation plans based on population data and fire patterns.
The future is connectivity
We are in our infancy with “smart firefighting,” says Casey Grant, executive director emeritus of the Fire Protection Research Foundation. Grant foresees a new era of cyber-physical systems for firefighters—a massive integration of wireless networks, advanced sensors, 3D simulations, and cloud services. To enhance teamwork, the system will connect all branches of emergency responders—fire, emergency medical services, law enforcement.
FirstNet (First Responder Network Authority) now provides a nationwide high-speed broadband network with 5G capabilities for first responders through a terrestrial cell network. Battling wildfires, however, the Forest Service needed an alternative because they don’t always have access to a power source. In 2022, they contracted with Aerostar for a high altitude balloon (60,000 feet up) that can extend cell phone power and LTE. “It puts a bubble of connectivity over the fire to hook in the internet,” Triplett explains.
A high altitude balloon, 60,000 feet high, can extend cell phone power and LTE, putting a "bubble" of internet connectivity over fires.
Courtesy of USDA Forest Service
Advances in harvesting, processing and delivering data will improve safety and decision-making for firefighters, Grant sums up. Smart systems may eventually calculate fire flow paths and make recommendations about the best ways to navigate specific fire conditions. NIST’s plan to combine FlashNet with sensors is one example.
The biggest challenge is developing firefighting technology that can work across multiple channels—federal, state, local and tribal systems as well as for fire, police and other emergency services— in any location, says Triplett. “When there’s a wildfire, there are no political boundaries,” he says. “All hands are on deck.”
New implants let paraplegics surf the web and play computer games
When I greeted Rodney Gorham, age 63, in an online chat session, he replied within seconds: “My pleasure.”
“Are you moving parts of your body as you type?” I asked.
This time, his response came about five minutes later: “I position the cursor with the eye tracking and select the same with moving my ankles.” Gorham, a former sales representative from Melbourne, Australia, living with amyotrophic lateral sclerosis, or ALS, a rare form of Lou Gehrig’s disease that impairs the brain’s nerve cells and the spinal cord, limiting the ability to move. ALS essentially “locks” a person inside their own body. Gorham is conversing with me by typing with his mind only–no fingers in between his brain and his computer.
The brain-computer interface enabling this feat is called the Stentrode. It's the brainchild of Synchron, a company backed by Amazon’s Jeff Bezos and Microsoft cofounder Bill Gates. After Gorham’s neurologist recommended that he try it, he became one of the first volunteers to have an 8mm stent, laced with small electrodes, implanted into his jugular vein and guided by a surgeon into a blood vessel near the part of his brain that controls movement.
After arriving at their destination, these tiny sensors can detect neural activity. They relay these messages through a small receiver implanted under the skin to a computer, which then translates the information into words. This minimally invasive surgery takes a day and is painless, according to Gorham. Recovery time is typically short, about two days.
When a paralyzed patient thinks about trying to move their arms or legs, the motor cortex will fire patterns that are specific to the patient’s thoughts.
When a paralyzed patient such as Gorham thinks about trying to move their arms or legs, the motor cortex will fire patterns that are specific to the patient’s thoughts. This pattern is detected by the Stentrode and relayed to a computer that learns to associate this pattern with the patient’s physical movements. The computer recognizes thoughts about kicking, making a fist and other movements as signals for clicking a mouse or pushing certain letters on a keyboard. An additional eye-tracking device controls the movement of the computer cursor.
The process works on a letter by letter basis. That’s why longer and more nuanced responses often involve some trial and error. “I have been using this for about two years, and I enjoy the sessions,” Gorham typed during our chat session. Zafar Faraz, field clinical engineer at Synchron, sat next to Gorham, providing help when required. Gorham had suffered without internet access, but now he looks forward to surfing the web and playing video games.
Gorham, age 63, has been enjoying Stentrode sessions for about two years.
Rodeny Dekker
The BCI revolution
In the summer of 2021, Synchron became the first company to receive the FDA’s Investigational Device Exemption, which allows research trials on the Stentrode in human patients. This past summer, the company, together with scientists from Icahn School of Medicine at Mount Sinai and the Neurology and Neurosurgery Department at Utrecht University, published a paper offering a framework for how to develop BCIs for patients with severe paralysis – those who can't use their upper limbs to type or use digital devices.
Three months ago, Synchron announced the enrollment of six patients in a study called COMMAND based in the U.S. The company will seek approval next year from the FDA to make the Stentrode available for sale commercially. Meanwhile, other companies are making progress in the field of BCIs. In August, Neuralink announced a $280 million financing round, the biggest fundraiser yet in the field. Last December, Synchron announced a $75 million financing round. “One thing I can promise you, in five years from now, we’re not going to be where we are today. We're going to be in a very different place,” says Elad I. Levy, professor of neurosurgery and radiology at State University of New York in Buffalo.
The risk of hacking exists, always. Cybercriminals, for example, might steal sensitive personal data for financial reasons, blackmailing, or to spread malware to other connected devices while extremist groups could potentially hack BCIs to manipulate individuals into supporting their causes or carrying out actions on their behalf.
“The prospect of bestowing individuals with paralysis a renewed avenue for communication and motor functionality is a step forward in neurotech,” says Hayley Nelson, a neuroscientist and founder of The Academy of Cognitive and Behavioral Neuroscience. “It is an exciting breakthrough in a world of devastating, scary diseases,” says Neil McArthur, a professor of philosophy and director of the Centre for Professional and Applied Ethics at the University of Manitoba. “To connect with the world when you are trapped inside your body is incredible.”
While the benefits for the paraplegic community are promising, the Stentrode’s long-term effectiveness and overall impact needs more research on safety. “Potential risks like inflammation, damage to neural tissue, or unexpected shifts in synaptic transmission due to the implant warrant thorough exploration,” Nelson says.
There are also concens about data privacy concerns and the policies of companies to safeguard information processed through BCIs. “Often, Big Tech is ahead of the regulators because the latter didn’t envisage such a turn of events...and companies take advantage of the lack of legal framework to push forward,” McArthur says. Hacking is another risk. Cybercriminals could steal sensitive personal data for financial reasons, blackmailing, or to spread malware to other connected devices. Extremist groups could potentially hack BCIs to manipulate individuals into supporting their causes or carrying out actions on their behalf.
“We have to protect patient identity, patient safety and patient integrity,” Levy says. “In the same way that we protect our phones or computers from hackers, we have to stay ahead with anti-hacking software.” Even so, Levy thinks the anticipated benefits for the quadriplegic community outweigh the potential risks. “We are on the precipice of an amazing technology. In the future, we would be able to connect patients to peripheral devices that enhance their quality of life.”
In the near future, the Stentrode could enable patients to use the Stentrode to activate their wheelchairs, iPods or voice modulators. Synchron's focus is on using its BCI to help patients with significant mobility restrictions—not to enhance the lives of healthy people without any illnesses. Levy says we are not prepared for the implications of endowing people with superpowers.
I wondered what Gorham thought about that. “Pardon my question, but do you feel like you have sort of transcended human nature, being the first in a big line of cybernetic people doing marvelous things with their mind only?” was my last question to Gorham.
A slight smile formed on his lips. In less than a minute, he typed: “I do a little.”
Leading XPRIZE Healthspan and Beating Negativity with Dr. Peter Diamandis
A new competition by the XPRIZE Foundation is offering $101 million to researchers who discover therapies that give a boost to people aged 65-80 so their bodies perform more like when they were middle-aged.
For today’s podcast episode, I talked with Dr. Peter Diamandis, XPRIZE’s founder and executive chairman. Under Peter’s leadership, XPRIZE has launched 27 previous competitions with over $300 million in prize purses. The latest contest aims to enhance healthspan, or the period of life when older people can play with their grandkids without any restriction, disability or disease. Such breakthroughs could help prevent chronic diseases that are closely linked to aging. These illnesses are costly to manage and threaten to overwhelm the healthcare system, as the number of Americans over age 65 is rising fast.
In this competition, called XPRIZE Healthspan, multiple awards are available, depending on what’s achieved, with support from the nonprofit Hevolution Foundation and Chip Wilson, the founder of Lululemon and nonprofit SOLVE FSHD. The biggest prize, $81 million, is for improvements in cognition, muscle and immunity by 20 years. An improvement of 15 years will net $71 million, and 10 years will net $61 million.
In our conversation for this episode, Peter talks about his plans for XPRIZE Healthspan and why exponential technologies make the current era - even with all of its challenges - the most exciting time in human history. We discuss the best mental outlook that supports a person in becoming truly innovative, as well as the downsides of too much risk aversion. We talk about how to overcome the negativity bias in ourselves and in mainstream media, how Peter has shifted his own mindset to become more positive over the years, how to inspire a culture of innovation, Peter’s personal recommendations for lifestyle strategies to live longer and healthier, the innovations we can expect in various fields by 2030, the future of education and the importance of democratizing tech and innovation.
In addition to Peter’s pioneering leadership of XPRIZE, he is also the Executive Founder of Singularity University. In 2014, he was named by Fortune as one of the “World’s 50 Greatest Leaders.” As an entrepreneur, he’s started over 25 companies in the areas of health-tech, space, venture capital and education. He’s Co-founder and Vice-Chairman of two public companies, Celularity and Vaxxinity, plus being Co-founder & Chairman of Fountain Life, a fully-integrated platform delivering predictive, preventative, personalized and data-driven health. He also serves as Co-founder of BOLD Capital Partners, a venture fund with a half-billion dollars under management being invested in exponential technologies and longevity companies. Peter is a New York Times Bestselling author of four books, noted during our conversation and in the show notes of this episode. He has degrees in molecular genetics and aerospace engineering from MIT and holds an M.D. from Harvard Medical School.
Show links
- Peter Diamandis bio
- New XPRIZE Healthspan
- Peter Diamandis books
- 27 XPRIZE competitions and counting
- Life Force by Peter Diamandis and Tony Robbins
- Peter Diamandis Twitter
- Longevity Insider newsletter – AI identifies the news
- Peter Diamandis Longevity Handbook
- Hevolution funding for longevity
XPRIZE Founder Peter Diamandis speaks with Mehmoud Khan, CEO of Hevolution Foundation, at the launch of XPRIZE Healthspan.
Hevolution Foundation