Vision-based system that imitates insects designed to improve navigation of UAVs

Vision-based system that imita...
Australian researchers have designed a vision-based system to provide real-time guidance for UAVs, such as the MQ-9 Reaper pictured
Australian researchers have designed a vision-based system to provide real-time guidance for UAVs, such as the MQ-9 Reaper pictured
View 1 Image
Australian researchers have designed a vision-based system to provide real-time guidance for UAVs, such as the MQ-9 Reaper pictured
Australian researchers have designed a vision-based system to provide real-time guidance for UAVs, such as the MQ-9 Reaper pictured

Along with the well known defense applications, unmanned aerial vehicles (UAVs) are also used for crop dusting, bushfire and environmental monitoring, and infrastructure inspection. Such applications can see them flying close to the ground and amongst obstacles meaning it is of the utmost importance for pilotless craft to be able to accurately determine their heading and orientation to the ground. By imitating the method insects employ, Australian researchers have designed a vision-based system to provide real-time guidance for these eyes in the skies.

While UAVs employ sensors such as magnetometers, gyroscopes, and accelerometers to help them determine their heading and orientation, Richard Moore, a researcher at The Vision Centre and The Queensland Brain Institute at the University of Queensland, says they can suffer from problems such as noise-induced drift, and can be adversely affected by the motions of the aircraft or materials in the environment.

"This means that UAVs can't perform significant maneuvers without losing their sense of direction for a while," says Moore.

To overcome these problems and provide real-time guidance for UAVs, the researchers designed a vision-based system that imitates the method used by insects to provide a fixed image of the sky and the horizon.

"If you watch a flying insect, you will see that their heads are upright when they turn their bodies," Moore says. "Keeping their heads still allows them to have a stabilized image of the horizon and the sky, which is crucial in determining their heading."

The new system sees the aircraft using two back-to-back fish-eye lenses to capture a wide-angle view of the environment that is then divided into sky and ground regions using information such as the brightness and color combinations. The orientation of the sky and ground regions allows the aircraft to determine its roll and pitch angles with respect to the horizon.

"Using its estimated orientation, the aircraft can then generate a panoramic image of the horizon, and use it as a reference," Moore explains. "The aircraft can then determine its heading direction continuously throughout the flight by producing an instantaneous horizon panorama and comparing it with the reference image."

Although similar vision-based systems have been proposed in the past, the researchers claim their new system improves visual performance by enabling the aircraft to learn directions by itself.

"This system doesn't need any programming before takeoff, unlike earlier ones that required lots of offline training: researchers had to manually compute the differences between the sky and the ground, then feed it into the system," says Moore. "With the new system, we only have to tell the aircraft that it's in the upright position when it starts flying. It will then use that as a starting point to work out which is sky and which is ground, and train itself to recognize the differences."

Moore says this is important because an aircraft that relies solely on prior training will run into trouble in unfamiliar environments. Conversely, its self-learning ability allows the new system to keep a record of what it "sees," update its reference base continuously, and adapt to changing environments.

In a closed-loop flight test with the new system where the aircraft was commanded to perform a series of 90-degree turns for four minutes, Moore says the aircraft was able to estimate its heading much more accurately with a visual compass, compared to relying on other navigation systems such as magnetic compasses and gyroscopes.

"The ability to estimate the precise roll and pitch angles and the heading direction instantaneously is crucial for UAVs, as small errors can lead to misalignments and crashes," he added.

Video of the flight tests carried out by the team from the Queensland Brain Institute at the University of Queensland can be seen below, while their paper, "A fast and adaptive method for estimating UAV attitude from the visual horizon," can be found here.

Autonomous Immelmann turns using visual attitude

Visually estimating 3-DOF attitude

I think it\'s been said before...but I reckon that this publication could do worse than to distance itself from articles ostensibly glorifying UAV\'s and other such machinery whose sole purpose is to continue the reckless slaughter of human beings. Yeah sure...they can be used for non military purposes, but.....c\'mon now, nobody is being fooled (actually, you know, they probably are...! ). These things are for raining death from above on whoever is \'flavor of the month\' adversary, and for all their technical sophistication, are responsible for many civilian deaths. It would be a responsible move to differentiate between \'technology for say.benefitting mankind, and technology that exists almost solely to further the war machines of stupid short sighted , tin pot military regimes.
Alan Belardinelli
I disagree Robalone. This could just as easily be used for crop dusting as it could for people dusting.
This tech looks very cool.
@Robalone If the subject matter of an article offends you, there is no need to read it. No site can be all things to all people.
Interesting tech, but only any good on a clear sunny day in flat country. Fine for Arizona, maybe... what about fog, mountainous, or night-time flight? Its a start, but some outside the box thinking still needed...
Matt Rings
@Robalone. We can sympathize with your feelings toward war, but this article is all about the science and biomimicry. Take a deep breath.... and understand that science and technology and war will always be unfortunate bed partners, until Utopia is realized (that\'s a whole \'nutha topic).
@robalone you need to broaden your view of this tech. i build multi copter drones and this tech will help me with the problem they describe in the article of noise induced drift on my drones. i use these drones for purposes like filming wildlife on the open planes and in forests as well as tracking birds in the mountains where you can not get to on foot or in a conventional aircraft, small unmanned drones are becoming more widely used for all types of things including drone journalism, and watching things like peaceful protests where the police might abuse people so we citizens can watch the watchers, there are plans to use drones to deliver medical supply\'s to remote villages in Africa and many other uses. people like yourself would ban this tech out of a blind intolerance that only sees the negitive uses that they can be put to. sadly many technologies will be used for war, but the peaceful and life saving uses far outnumber the evil ones if you will only take the time to look for them