Science

MIT researchers create camera that can see around corners

The experimental camera setup that is able to see around corners (Photo: Christopher Barsi and Andreas Velten)
The experimental camera setup that is able to see around corners (Photo: Christopher Barsi and Andreas Velten)
View 3 Images
The experimental camera setup that is able to see around corners (Photo: Christopher Barsi and Andreas Velten)
1/3
The experimental camera setup that is able to see around corners (Photo: Christopher Barsi and Andreas Velten)
The hidden wooden mannequin (a) and a heat map image (d) and 3D images (g/h) produced using the MIT system
2/3
The hidden wooden mannequin (a) and a heat map image (d) and 3D images (g/h) produced using the MIT system
The system developed at MIT can capture images of objects hidden from the camera's direct line of sight (Image: Tiago Allen)
3/3
The system developed at MIT can capture images of objects hidden from the camera's direct line of sight (Image: Tiago Allen)

Fans of the classic 1982 science fiction movie Blade Runner will remember the ESPER machine that allows Deckard to zoom in and see around corners in a two-dimensional photograph. While such technology is still some way off, researchers in MIT’s Media Lab have developed a system using a femtosecond laser that can reproduce low-resolution 3D images of objects that lie outside a camera’s line of sight.

The experimental setup designed by the MIT researchers gained attention last December when video of it capturing a burst of light traveling through a plastic bottle was released. But as amazing as that capability is, it was for the even more amazing ability to literally see around corners that the team says the system was developed.

It works by emitting a burst of light from a femtosecond laser that reflects off visible surfaces – such as an opaque wall - onto objects that are hidden from the camera’s direct view. The light then bounces off the object before ultimately making its way back to a detector. This process is repeated a number of times with the laser targeted at different areas of the reflecting surface.

The system developed at MIT can capture images of objects hidden from the camera's direct line of sight (Image: Tiago Allen)
The system developed at MIT can capture images of objects hidden from the camera's direct line of sight (Image: Tiago Allen)

The duration of the bursts of light from the femtosecond laser are so short they are measured in quadrillionths of a second, while the detector can take measurements every few picoseconds – or trillionths of a second. It is the extremely short duration of the light bursts that allows the system to calculate how far they’ve traveled by measuring the time it takes them to reach the detector.

The detector also measures the returning light at different angles and by comparing the times the returning light hits different parts of the detector, the system constructs an image of what lies around the corner.

The hidden wooden mannequin (a) and a heat map image (d) and 3D images (g/h) produced using the MIT system
The hidden wooden mannequin (a) and a heat map image (d) and 3D images (g/h) produced using the MIT system

While the resultant 3D images are on the blurry side, the objects they portray are easily identifiable. And the team is hoping to improve the quality of the images as well as enabling it to deal with more cluttered visual scenes.

While the system won’t be put to use hunting down rogue replicants, the MIT researchers say it could lead to imaging systems that allow emergency responders to check out potentially dangerous environments, vehicle navigation systems that can negotiate blind turns, or endoscopes that can see around obstacles within the body, amongst other applications.

The team’s research is detailed in the journal Nature Communications. Nature also has a video explaining the system, which can be viewed below.

Source: MIT

How to see around corners

5 comments
Matt Rings
Incredible... mind-blowing research. No reason that data couldn't be encoded into a regular color photo, and the "hidden" data extracted from the digital code later for viewing. Wow!
warren52nz
That's pretty cool. And what a great video explaining it. Well done guys!!!
Tim Snaith
That is so clever and such a thorough application of light theory I'm surprised it's not classified. Do the detectors in the LHC perform at this temporal-spatial resolution?
owndao
Almost like LIDAR. Hmmm. I wonder if it is possible to use a blocking wall as part of a diffraction grating, taking advantage of particle/wave nature to give a reflected view from one of the synthetic grating's fringe interference illumination peaks?
windykites
Alternatively, you could use a mirror