Photography

Google team's clever tech eliminates face distortion in wide-angle photos

Google team's clever tech eliminates face distortion in wide-angle photos
Correcting wide-angle face distortion without ruining the rest of the picture is a tricky problem, but a Google team believes it has the answer
Correcting wide-angle face distortion without ruining the rest of the picture is a tricky problem, but a Google team believes it has the answer
View 7 Images
Correcting wide-angle face distortion without ruining the rest of the picture is a tricky problem, but a Google team believes it has the answer
1/7
Correcting wide-angle face distortion without ruining the rest of the picture is a tricky problem, but a Google team believes it has the answer
The algorithm corrects facial distortion without bending the perspective lines for background scenery
2/7
The algorithm corrects facial distortion without bending the perspective lines for background scenery
The corrected photos "feel" much better to look at than uncorrected or perspective-corrected shots
3/7
The corrected photos "feel" much better to look at than uncorrected or perspective-corrected shots
The algorithm identifies subjects, then applies a distortion correction filter only to the subject areas in the photo
4/7
The algorithm identifies subjects, then applies a distortion correction filter only to the subject areas in the photo
Stereographic projections correct facial distortion nicely, but tend to warp and bend the background in unsettling ways
5/7
Stereographic projections correct facial distortion nicely, but tend to warp and bend the background in unsettling ways
You can see the weird effects of perspective correction here
6/7
You can see the weird effects of perspective correction here
There's no word on whether this tech will roll out to Google's Pixel phones or other devices as yet
7/7
There's no word on whether this tech will roll out to Google's Pixel phones or other devices as yet
View gallery - 7 images

No, it's not just a simple distortion correction filter. A Google research team has been working on eliminating the face-stretching distortion you get from wide angle lenses, without the ugly bending of perspective lines you get by applying regular distortion filters. At SIGGRAPH 2019, the team has presented an algorithm that does just that.

Super wide angle lenses, like the ones that are starting to appear for things like "wide selfie" modes on smartphones, suck in an impressively wide view from such a small lens, but the tradeoff is that things get stretched out toward the edges. This isn't a dealbreaker for most background scenery, but it makes faces look plain weird. It's one of those things you've probably simply got used to and forgotten about.

Applying a simple perspective distortion correction filter can bring back a much more realistic shape to the faces at the edges of the shot, but to do so, it needs to bend the perspective lines of the entire photo. So the faces look better, but any straight lines in architecture or horizons in the background end up weirdly curved.

You can see the weird effects of perspective correction here
You can see the weird effects of perspective correction here

The team's solution here is to use a content-aware algorithm to work out which bits of the photo are faces or "subject" items, and which are not. The algorithm then creates a perspective correction map for the entire photo, but applies it only to the subject areas, keeping the background lines straight while perspective-shifting the faces.

The algorithm identifies subjects, then applies a distortion correction filter only to the subject areas in the photo
The algorithm identifies subjects, then applies a distortion correction filter only to the subject areas in the photo

The results look great, and the team says the system works fast enough to be "interactive." We're not sure if this means it's quick enough to use during video calling given a standard phone handset, or whether it'll correct the preview window as you're preparing to shoot a wide-angle photo. There's no news here about whether the Pixel team will roll this tech into its famously clever camera software in a future update. But if it does, now you know how it works.

The technology is demonstrated in the video below.

Source: Google/MIT

SIGGRAPH 2019: Distortion-Free Wide-Angle Portraits on Camera Phones

View gallery - 7 images
1 comment
1 comment
paul314
Goodbye to using photographs as visual evidence of what's where or what sizes things are in relation to one another...