Stereolabs' ZED camera delivers long range 3D vision
San Francisco-based Stereolabs has launched a new 3D camera that promises to deliver high quality 3D image capture at a less than astronomical price. The compact, lightweight ZED 3D vision sensor can measure distances out to 20 meters (65 feet) and work indoors and out, making it a strong candidate for applications such as large-scale architectural scanning and obstacle detection for self-driving cars and unmanned drones.
Stereo cameras are passive devices that work by comparing two images taken by cameras several inches apart. Computer software looks at the distance in pixels between similar features in each image and use that to estimate the depth or distance from the camera to objects in the scene. These algorithms require precise calibration of the cameras in order to work.
Stereolabs was founded by Cecile Schmollgruber, Edwin Azzamand Olivier Braun back in 2010. Their original customers were movie studiosdoing special effects. Stereolabs would come in and capture a movie set in 3Dusing scanners and 3D cameras so that the computer animators could come inlater and add the dinosaurs, rampaging green superheroes, or legions of zombies to the scene.This experience led them to conclude that there was a need in the market for good quality stereo camerasat a reasonable price – there are some low cost 3D sensors with poorsensors, and some high end, expensive laboratory cameras, but nothing at areasonable price with good quality optics and video.
As a result Stereolabs spent years developing its 3D camera software, and the past 12 months working on the ZED hardware.
Based-on smart phone camera technology, the ZED camera was designed to be small, lightweight, low cost, and still have high quality output. Thetwo cameras each have 4,416 x 1,242 pixel sensors in a 16 x 9 wide screen format. Theoptics allow 110 degrees field of view. The cameras are spaced 120mm (4.7inches) apart, which with the dense pixel video gives usable stereo depthinformation from 1.5 to 20 m (5-65 ft). The unit itself measures 175 x 30 x 33 mm (6.89 x 1.18 x 1.3’’) and weighs 159 g (0.35 lb).
Gizmagtalked to Cecile Schmollgruber, the CEO of Stereolabs, who explained that allof the calibration for the ZED camera is done within the device, and itautomatically calibrates itself for quality depth sensing.
The ZED camera does not do all of the work by itself, though. The 3Dcamera sends side-by-side video images to a host computer that processes thedata. For full capability, Stereolabs recommends having a CUDA-capable computerwith an NVIDA graphics card.
Specifically, Schmollgruber recommends the NVIDIA Jetson TK1embedded processing board, a single-board computer with a small form factor anda CPU-GPU combined chip. This board would allow 3D stereo processing on vehicles and other mobileapplications of the ZED camera.
The potential applications for the ZED camera are numerous. It can be a long range 3D sensor for unmanned vehicles, self driving cars or small-scale mobile robots, it can capture 3D scenes and buildings to incorporate into computer animation and rendering, and collect detailed images of objects in three dimensions so they can be replicated with a 3D printer. It could also be part of a 3D video conferencing system where the participants wear HMD (Head Mounted Displays) like the Oculus Rift, or used for various types of recognition and tracking systems or tasks such as counting crowds at football stadiums.
The ZED camera is now available for US$449, with delivery times of two to threeweeks expected.
Check out Stereolabs' ZED promo video below.