Drones

For the first time, AI dominates humanity's best in a real-world sport

For the first time, AI dominates humanity's best in a real-world sport
Now they're beating us in real-world sports: an AI has dominated world-champion drone racers head-to-head
Now they're beating us in real-world sports: an AI has dominated world-champion drone racers head-to-head
View 3 Images
Now they're beating us in real-world sports: an AI has dominated world-champion drone racers head-to-head
1/3
Now they're beating us in real-world sports: an AI has dominated world-champion drone racers head-to-head
Using only on-board camera vision and an inertial measurement unit, the Swift AI piloted a racing drone to repeated victories over the world's best human pilots in Switzerland
2/3
Using only on-board camera vision and an inertial measurement unit, the Swift AI piloted a racing drone to repeated victories over the world's best human pilots in Switzerland
A 25 x 25 m course was assembled in an aircraft hangar in Zurich
3/3
A 25 x 25 m course was assembled in an aircraft hangar in Zurich
View gallery - 3 images

High-speed drone racing has just had a shocking "Deep Blue" moment, as an autonomous AI designed by University of Zurich researchers repeatedly forced three world champion-level pilots to eat its dust, showing uncanny precision in dynamic flight.

If you've ever watched a high-level drone race from the FPV perspective, you'll know how much skill, speed, precision and dynamic control it takes. Like watching Formula One from the driver's perspective, or on-board footage from the Isle of Man TT, it's hard to imagine how a human brain can make calculations that quickly and respond to changing situations in real time. It's incredibly impressive.

When Deep Blue stamped silicon's dominance on the world of chess, and AlphaGo established AI's dominance in the game of Go, these were strategic situations, in which a computer's ability to analyze millions of past games and millions of potential moves and strategies gave them the edge.

But now, for the first time, AI has beaten some of the world's best in a real-world, physical sport. An AI system called Swift, developed by researchers from the University of Zurich and Intel, quickly learned a tight, technical 3D racetrack, and proceeded to dominate two human world champions and a three-time Swiss national champion in head-to-head racing, also setting the fastest race time.

A 25 x 25 m course was assembled in an aircraft hangar in Zurich
A 25 x 25 m course was assembled in an aircraft hangar in Zurich

The Swift system used the same single-camera vision setup as the human pilots to see its way around the course and through the gates, but had the advantage of also using real-time acceleration, speed and orientation data from an onboard inertial measurement unit.

It learned the fairly complex seven-gate track, complete with an acrobatic Split-S vertical hairpin turn, by running 100 drones through the track simultaneously in a virtual environment. The sim-drones began by exploring the racetrack environment, then started finding paths through it, and eventually optimized those paths to find the quickest way around. This process took less than an hour, but simulated the equivalent of an uninterrupted month's worth of real-time single-drone training.

Next, it fine-tuned its control policies using data gathered from real-world flight, to account for things like air turbulence, visual signal degradation, and other factors that create uncertainty between simulations and the real world.

Using only on-board camera vision and an inertial measurement unit, the Swift AI piloted a racing drone to repeated victories over the world's best human pilots in Switzerland
Using only on-board camera vision and an inertial measurement unit, the Swift AI piloted a racing drone to repeated victories over the world's best human pilots in Switzerland

And then, it laid the smackdown in the physical world, at a purpose-built 25 x 25-meter (82 x 82-ft) track in an airport hangar near Zurich.

"That was insane," gasped two-time MultiGP international World Cup champion Thomas Bitmatta as the Swift AI streaked away from him, taking tighter turns than any of the human racers and displaying inhuman precision between laps.

Its fastest lap was a full half-second quicker than the best lap a human laid down – an eternity in high-speed racing.

Having said that, the humans were better able to adapt to changing conditions; when bright sunlight lit the hangar up more than the drone was trained for, it failed. It's hard to see how further training couldn't eliminate that kind of blind spot, but the point remains: the human brain is almost endlessly adaptable. Unconventional tactics and surprise are our best bet against the robot uprising.

And there's a broader point here about the rise of AI systems; these machines can develop incredible speed and precision when given specific tasks, but the ol' necktop computer still reigns supreme when it comes to dealing with a broader range of tasks in dynamic and changing conditions. For now.

Watch the thing fly below; the video is fantastic.

Champion-level Drone Racing using Deep Reinforcement Learning (Nature, 2023)

Source: University of Zurich

View gallery - 3 images
4 comments
4 comments
kwalispecial
That is amazing to watch and was a cool demo, but I still wouldn't say the AI won, unless the humans were also given just as much prep time. When the humans walk into a room with their camera drone, and a computer with a camera (to simulate a drone pilot's natural perspective) can be turned on and control a drone to victory, then I'd say the humans have lost the competition.
rbolman
Now move one of the gates 2 feet to the right and launch again without the hour of CPU time to remap. Who wins then?
Nobody
Reminds me of flying my drone through the trees only to find out objects were much closer than they appeared on camera. I know I've seen a similar warning somewhere before.
Brian M
Absolutely no surprises there, no matter how good humans pilots are (and these guys are good!) they will be (and have now been) beaten by AI with direct interfaces to the controls with shorter response times, which will only get faster. Including quicker learning times.

Do wonder if the computer/AI system had to take into account the risk and expensive of crashing whether it would be a bit slower!