Send in the Robots: A Look into the Future of Firefighting
April in Paris stood still. Flames engulfed the beloved Notre Dame Cathedral as the world watched, horrified, in 2019. The worst looked inevitable when firefighters were forced to retreat from the out-of-control fire.
But the Paris Fire Brigade had an ace up their sleeve: Colossus, a firefighting robot. The seemingly indestructible tank-like machine ripped through the blaze with its motorized water cannon. It was able to put out flames in places that would have been deadly for firefighters.
Firefighting is entering a new era, driven by necessity. Conventional methods of managing fires have been no match for the fiercer, more expansive fires being triggered by climate change, urban sprawl, and susceptible wooded areas.
Robots have been a game-changer. Inspired by Paris, the Los Angeles Fire Department (LAFD) was the first in the U.S. to deploy a firefighting robot in 2021, the Thermite Robotics System 3 – RS3, for short.
RS3 is a 3,500-pound turbine on a crawler—the size of a Smart car—with a 36.8 horsepower engine that can go for 20 hours without refueling. It can plow through hazardous terrain, move cars from its path, and pull an 8,000-pound object from a fire.
All that while spurting 2,500 gallons of water per minute with a rear exhaust fan clearing the smoke. At a recent trade show, RS3 was billed as equivalent to 10 firefighters. The Los Angeles Times referred to it as “a droid on steroids.”
Robots such as the Thermite RS3 can plow through hazardous terrain and pull an 8,000-pound object from a fire.
Los Angeles Fire Department
The advantage of the robot is obvious. Operated remotely from a distance, it greatly reduces an emergency responder’s exposure to danger, says Wade White, assistant chief of the LAFD. The robot can be sent into airplane fires, nuclear reactors, hazardous areas with carcinogens (think East Palestine, Ohio), or buildings where a roof collapse is imminent.
Advances for firefighters are taking many other forms as well. Fibers have been developed that make the firefighter’s coat lighter and more protective from carcinogens. New wearable devices track firefighters’ biometrics in real time so commanders can monitor their heat stress and exertion levels. A sensor patch is in development which takes readings every four seconds to detect dangerous gases such as methane and carbon dioxide. A sonic fire extinguisher is being explored that uses low frequency soundwaves to remove oxygen from air molecules without unhealthy chemical compounds.
The demand for this technology is only increasing, especially with the recent rise in wildfires. In 2021, fires were responsible for 3,800 deaths and 14,700 injuries of civilians in this country. Last year, 68,988 wildfires burned down 7.6 million acres. Whether the next generation of firefighting can address these new challenges could depend on special cameras, robots of the aerial variety, AI and smart systems.
Fighting fire with cameras
Another key innovation for firefighters is a thermal imaging camera (TIC) that improves visibility through smoke. “At a fire, you might not see your hand in front of your face,” says White. “Using the TIC screen, you can find the door to get out safely or see a victim in the corner.” Since these cameras were introduced in the 1990s, the price has come down enough (from $10,000 or more to about $700) that every LAFD firefighter on duty has been carrying one since 2019, says White.
TICs are about the size of a cell phone. The camera can sense movement and body heat so it is ideal as a search tool for people trapped in buildings. If a firefighter has not moved in 30 seconds, the motion detector picks that up, too, and broadcasts a distress signal and directional information to others.
To enable firefighters to operate the camera hands-free, the newest TICs can attach inside a helmet. The firefighter sees the images inside their mask.
TICs also can be mounted on drones to get a bird’s-eye, 360 degree view of a disaster or scout for hot spots through the smoke. In addition, the camera can take photos to aid arson investigations or help determine the cause of a fire.
More help From above
Firefighters prefer the term “unmanned aerial systems” (UAS) to drones to differentiate them from military use.
A UAS carrying a camera can provide aerial scene monitoring and topography maps to help fire captains deploy resources more efficiently. At night, floodlights from the drone can illuminate the landscape for firefighters. They can drop off payloads of blankets, parachutes, life preservers or radio devices for stranded people to communicate, too. And like the robot, the UAS reduces risks for ground crews and helicopter pilots by limiting their contact with toxic fumes, hazardous chemicals, and explosive materials.
“The nice thing about drones is that they perform multiple missions at once,” says Sean Triplett, team lead of fire and aviation management, tools and technology at the Forest Service.
Experts predict we’ll see swarms of drones dropping water and fire retardant on burning buildings and forests in the near future.
The UAS is especially helpful during wildfires because it can track fires, get ahead of wind currents and warn firefighters of wind shifts in real time. The U.S. Forest Service also uses long endurance, solar-powered drones that can fly for up to 30 days at a time to detect early signs of wildfire. Wildfires are no longer seasonal in California – they are a year-long threat, notes Thanh Nguyen, fire captain at the Orange County Fire Authority.
In March, Nguyen’s crew deployed a drone to scope out a huge landslide following torrential rains in San Clemente, CA. Emergency responders used photos and videos from the drone to survey the evacuated area, enabling them to stay clear of ground on the hillside that was still sliding.
Improvements in drone batteries are enabling them to fly for longer with heavier payloads. Experts predict we’ll see swarms of drones dropping water and fire retardant on burning buildings and forests in the near future.
AI to the rescue
The biggest peril for a firefighter is often what they don’t see coming. Flashovers are a leading cause of firefighter deaths, for example. They occur when flammable materials in an enclosed area ignite almost instantaneously. Or dangerous backdrafts can happen when a firefighter opens a window or door; the air rushing in can ignite a fire without warning.
The Fire Fighting Technology Group at the National Institute of Standards and Technology (NIST) is developing tools and systems to predict these potentially lethal events with computer models and artificial intelligence.
Partnering with other institutions, NIST researchers developed the Flashover Prediction Neural Network (FlashNet) after looking at common house layouts and running sets of scenarios through a machine-learning model. In the lab, FlashNet was able to predict a flashover 30 seconds before it happened with 92.1% success. When ready for release, the technology will be bundled with sensors that are already installed in buildings, says Anthony Putorti, leader of the NIST group.
The NIST team also examined data from hundreds of backdrafts as a basis for a machine-learning model to predict them. In testing chambers the model predicted them correctly 70.8% of the time; accuracy increased to 82.4% when measures of backdrafts were taken in more positions at different heights in the chambers. Developers are working on how to integrate the AI into a small handheld device that can probe the air of a room through cracks around a door or through a created opening, Putorti says. This way, the air can be analyzed with the device to alert firefighters of any significant backdraft risk.
Early wildfire detection technologies based on AI are in the works, too. The Forest Service predicts the acreage burned each year during wildfires will more than triple in the next 80 years. By gathering information on historic fires, weather patterns, and topography, says White, AI can help firefighters manage wildfires before they grow out of control and create effective evacuation plans based on population data and fire patterns.
The future is connectivity
We are in our infancy with “smart firefighting,” says Casey Grant, executive director emeritus of the Fire Protection Research Foundation. Grant foresees a new era of cyber-physical systems for firefighters—a massive integration of wireless networks, advanced sensors, 3D simulations, and cloud services. To enhance teamwork, the system will connect all branches of emergency responders—fire, emergency medical services, law enforcement.
FirstNet (First Responder Network Authority) now provides a nationwide high-speed broadband network with 5G capabilities for first responders through a terrestrial cell network. Battling wildfires, however, the Forest Service needed an alternative because they don’t always have access to a power source. In 2022, they contracted with Aerostar for a high altitude balloon (60,000 feet up) that can extend cell phone power and LTE. “It puts a bubble of connectivity over the fire to hook in the internet,” Triplett explains.
A high altitude balloon, 60,000 feet high, can extend cell phone power and LTE, putting a "bubble" of internet connectivity over fires.
Courtesy of USDA Forest Service
Advances in harvesting, processing and delivering data will improve safety and decision-making for firefighters, Grant sums up. Smart systems may eventually calculate fire flow paths and make recommendations about the best ways to navigate specific fire conditions. NIST’s plan to combine FlashNet with sensors is one example.
The biggest challenge is developing firefighting technology that can work across multiple channels—federal, state, local and tribal systems as well as for fire, police and other emergency services— in any location, says Triplett. “When there’s a wildfire, there are no political boundaries,” he says. “All hands are on deck.”
Your phone could show if a bridge is about to collapse
In summer 2017, Thomas Matarazzo, then a postdoctoral researcher at the Massachusetts Institute of Technology, landed in San Francisco with a colleague. They rented two cars, drove up to the Golden Gate bridge, timing it to the city’s rush hour, and rode over to the other side in heavy traffic. Once they reached the other end, they turned around and did it again. And again. And again.
“I drove over that bridge 100 times over five days, back and forth,” says Matarazzo, now an associate director of High-Performance Computing in the Center for Innovation in Engineering at the United States Military Academy, West Point. “It was surprisingly stressful, I never anticipated that. I had to maintain the speed of about 30 miles an hour when the speed limit is 45. I felt bad for everybody behind me.”
Matarazzo had to drive slowly because the quality of data they were collecting depended on it. The pair was designing and testing a new smartphone app that could gather data about the bridge’s structural integrity—a low-cost citizen-scientist alternative to the current industrial methods, which aren’t always possible, partly because they’re expensive and complex. In the era of aging infrastructure, when some bridges in the United States and other countries are structurally unsound to the point of collapsing, such an app could inform authorities about the need for urgent repairs, or at least prompt closing the most dangerous structures.
There are 619,588 bridges in the U.S., and some of them are very old. For example, the Benjamin Franklin Bridge connecting Philadelphia to Camden, N.J., is 96-years-old while the Brooklyn Bridge is 153. So it’s hardly surprising that many could use some upgrades. “In the U.S., a lot of them were built in the post-World War II period to accommodate the surge of motorization,” says Carlo Ratti, architect and engineer who directs the Senseable City Lab at Massachusetts Institute of Technology. “They are beginning to reach the end of their life.”
According to the 2022 American Road & Transportation Builders Association’s report, one in three U.S. bridges needs repair or replacement. The Department of Transportation (DOT) National Bridge Inventory (NBI) database reveals concerning numbers. Thirty-six percent of U.S. bridges need repair work and over 78,000 bridges should be replaced. More than 43,500 bridges are rated in poor condition and classified as “structurally deficient” – an alarming description. Yet, people drive over them 167.5 million times a day. The Pittsburgh bridge which collapsed in January this year—only hours before President Biden arrived to discuss the new infrastructure law—was on the “poor” rating list.
Assessing the structural integrity of a bridge is not an easy endeavor. Most of the time, these are visual inspections, Matarazzo explains. Engineers check cracks, rust and other signs of wear and tear. They also check for wildlife—birds which may build nests or even small animals that make homes inside the bridge structures, which can slowly chip at the structure. However, visual inspections may not tell the whole story. A more sophisticated and significantly more expensive inspection requires placing special sensors on the bridge that essentially listen to how the bridge vibrates.
“Some bridges can afford expensive sensors to do the job, but that comes at a very high cost—hundreds of thousands of dollars per bridge per year,” Ratti says.
We may think of bridges as immovable steel and concrete monoliths, but they naturally vibrate, oscillating slightly. That movement can be influenced by the traffic that passes over them, and even by wind. Bridges of different types vibrate differently—some have longer vibrational frequencies and others shorter ones. A good way to visualize this phenomenon is to place a ruler over the edge of a desk and flick it slightly. If the ruler protrudes far off the desk, it will vibrate slowly. But if you shorten the end that hangs off, it will vibrate much faster. It works similarly with bridges, except there are more factors at play, including not only the length, but also the design and the materials used.
The long suspension bridges such as the Golden Gate or Verrazano Narrows, which hang on a series of cables, are more flexible, and their vibration amplitudes are longer. The Golden Gate Bridge can vibrate at 0.106 Hertz, where one Hertz is one oscillation per second. “Think about standing on the bridge for about 10 seconds—that's how long it takes for it to move all the way up and all the way down in one oscillation,” Matarazzo says.
On the contrary, the concrete span bridges that rest on multiple columns like Brooklyn Bridge or Manhattan Bridge, are “stiffer” and have greater vibrational frequencies. A concrete bridge can have a frequency of 10 Hertz, moving 10 times in one second—like that shorter stretch of a ruler.
The special devices that can pick up and record these vibrations over time are called accelerometers. A network of these devices for each bridge can cost $20,000 to $50,000, and more—and require trained personnel to place them. The sensors also must stay on the bridge for some time to establish what’s a healthy vibrational baseline for a given bridge. Maintaining them adds to the cost. “Some bridges can afford expensive sensors to do the job, but that comes at a very high cost—hundreds of thousands of dollars per bridge per year,” Ratti says.
Making sense of the readouts they gather is another challenge, which requires a high level of technical expertise. “You generally need somebody, some type of expert capable of doing the analysis to translate that data into information,” says Matarazzo, which ticks up the price, so doing visual inspections often proves to be a more economical choice for state-level DOTs with tight budgets. “The existing systems work well, but have downsides,” Ratti says. The team thought the old method could use some modernizing.
Smartphones, which are carried by millions of people, contain dozens of sensors, including the accelerometers capable of picking up the bridges’ vibrations. That’s why Matarazzo and his colleague drove over the bridge 100 times—they were trying to pick up enough data. Timing it to rush hour supported that goal because traffic caused more “excitation,” Matarazzo explains. “Excitation is a big word we use when we talk about what drives the vibration,” he says. “When there's a lot of traffic, there's more excitation and more vibration.” They also collaborated with Uber, whose drivers made 72 trips across the bridge to gather data in different cars.
The next step was to clean the data from “noise”—various vibrations that weren’t relevant to the bridge but came from the cars themselves. “It could be jumps in speed, it could be potholes, it could be a bunch of other things," Matarazzo says. But as the team gathered more data, it became easier to tell the bridge vibrational frequencies from all others because the noises generated by cars, traffic and other things tend to “cancel out.”
The team specifically picked the Golden Gate bridge because the civil structural engineering community had studied it extensively over the years and collected a host of vibrational data, using traditional sensors. When the researchers compared their app-collected frequencies with those gathered by 240 accelerometers formerly placed on the Golden Gate, the results were the same—the data from the phones converged with that from the bridge’s sensors. The smartphone-collected data were just as good as those from industry devices.
The study authors estimate that officials could use crowdsourced data to make key improvements that would help new bridges to last about 14 years longer.
The team also tested their method on a different type of bridge—not a suspension one like the Golden Gate, but a concrete span bridge in Ciampino, Italy. There they compared 280 car trips over the bridge to the six sensors that had been placed on the bridge for seven months. The results were slightly less matching, but a larger volume of trips would fix the divergence, the researchers wrote in their study, titled Crowdsourcing bridge dynamic monitoring with smartphone vehicle trips, published last month in Nature Communications Engineering.
Although the smartphones proved effective, the app is not quite ready to be rolled out commercially for people to start using. “It is still a pilot version,” so there’s room for improvement, says Ratti, who co-authored the study. “But on a more optimistic note, it has really low barriers to entry—all you need is smartphones on cars—so that makes the system easy to reach a global audience.” And the study authors estimate that the use of crowdsourced data would result in a new bridge lasting about 14 years longer.
Matarazzo hopes that the app could be eventually accessible for your average citizen scientist to collect the data and supply it to their local transportation authorities. “I hope that this idea can spark a different type of relationship with infrastructure where people think about the data they're collecting as some type of contribution or investment into their communities,” he says. “So that they can help their own department of transportation, their own municipality to support that bridge and keep it maintained better, longer and safer.”
Lina Zeldovich has written about science, medicine and technology for Popular Science, Smithsonian, National Geographic, Scientific American, Reader’s Digest, the New York Times and other major national and international publications. A Columbia J-School alumna, she has won several awards for her stories, including the ASJA Crisis Coverage Award for Covid reporting, and has been a contributing editor at Nautilus Magazine. In 2021, Zeldovich released her first book, The Other Dark Matter, published by the University of Chicago Press, about the science and business of turning waste into wealth and health. You can find her on http://linazeldovich.com/ and @linazeldovich.
The Friday Five: Sugar could help catch cancer early
The Friday Five covers five stories in research that you may have missed this week. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
Here are the promising studies covered in this week's Friday Five:
- Catching cancer early could depend on sugar
- How to boost memory in a flash
- This is your brain on books
- A tiny sandwich cake could help the heart
- Meet the top banana for fighting Covid variants