New face detection algorithm registers even partially hidden faces

New face detection algorithm r...
Researchers have found a new way to spot faces at any angle (Photo: Shutterstock)
Researchers have found a new way to spot faces at any angle (Photo: Shutterstock)
View 2 Images
Researchers have found a new way to spot faces at any angle
Researchers have found a new way to spot faces at any angle
Researchers have found a new way to spot faces at any angle (Photo: Shutterstock)
Researchers have found a new way to spot faces at any angle (Photo: Shutterstock)

Face detection software has slowly crept into mainstream use, from Facebook photo tagging to Android phone unlocking, but new research looks set to move the technology on significantly. Scientists at Yahoo Labs and Stanford University have come up with a new approach that can register faces at any angle, even when partially hidden, making it easier than ever to be detected.

Sachin Farfade and Mohammad Saberian at Yahoo Labs in California, and Li-Jia Li at Stanford University, say their new algorithm is simpler and more accurate than many alternative methods. To understand how it works, we first need to take a quick historical detour to 2001 and the revolutionary breakthrough made by computer scientists Paul Viola and Michael Jones.

Viola and Jones overcame an impasse in face detection technology by ignoring the thornier issue of recognition and concentrating on spotting faces. Their algorithm looks for a light vertical line (the nose) crossed by a dark horizontal line (the eyes) in a "detection cascade." This has proved very effective at recognizing faces from head-on and is incorporated into many of the digital cameras currently on the market.

The technique isn't as good for spotting faces at an angle or those which are partially concealed though, which brings us back to Farfade, Saberian and Li. The team has taken a fundamentally different approach to its predecessors, employing an advanced type of machine learning known as a deep convolutional neural network. Essentially, a huge database of annotated images is used to teach the software what a face looks like.

Farfade and his colleagues have built a database containing 200,000 images of faces and 20 million images without faces. 50,000 different iterations of 128 images each were then used to train the neural network powering their detection engine. The result is a tool that can spot faces at many different angles (even upside down) and identify individual faces in a picture that contains a lot of them.

"We evaluated the proposed method with other deep learning based methods and showed that our method results in faster and more accurate results," say the team members, calling their creation the Deep Dense Face Detector. "We are planning to use better sampling strategies and more sophisticated data augmentation techniques to further improve performance of the proposed method for detecting occluded and rotated faces."

As the technology filters through into consumer and commercial products, it could mean that eventually your Kinect controller and the CCTV system on your local high street are going to be able to spot you more quickly than ever. It can even be used retrospectively to look through old photos and videos, according to the researchers.

Source: Cornell University Library via MIT Technology Review

1 comment
This is so strangely complex to do while we as humans do it without even thinking about it. Maybe they will eventually figure out the algorithm for beauty. This is the one that amazes me. I have seen many people with seemingly perfect features but they are not beautiful while others with some abnormal features are stunningly gorgeous. I even know one young lady who went from average looking to super model beautiful if she gained or lost just five pounds. Her face looked the same but the beauty came and went as her weight fluctuated up and down. At first I thought it was her makeup but when she gained five pounds no makeup could bring back the look but when she dropped the weight she was stunning with or without makeup. I also remember working with another young woman with very plain features who looked beautiful with make up but had the bizarre ability to look like a completely different person with any slight changes in her make up. Although she always looked nice, she looked like a totally different person each day when she came to work. People would often go over and ask who she was even though they had worked with her every day. I'd like to see them develop an equation for that.