Virtual Reality

Lytro brings Light Field tech to virtual reality

Lytro brings Light Field tech to virtual reality
Lytro promises content creators stitch-free capture and depth information in each frame
Lytro promises content creators stitch-free capture and depth information in each frame
View 7 Images
Light field explained: how we see the world (top), a conventional camera system (middle), the Lytro camera system (bottom)
1/7
Light field explained: how we see the world (top), a conventional camera system (middle), the Lytro camera system (bottom)
The spherical light field camera array that's reported capable of capturing "all the data from all directions at any location within a given volume"
2/7
The spherical light field camera array that's reported capable of capturing "all the data from all directions at any location within a given volume"
Concept rendering of the Lytro Immerge light field camera rig
3/7
Concept rendering of the Lytro Immerge light field camera rig
The Immerge rig is the culmination of 8 years of research into light field technology
4/7
The Immerge rig is the culmination of 8 years of research into light field technology
Lytro promises content creators stitch-free capture and depth information in each frame
5/7
Lytro promises content creators stitch-free capture and depth information in each frame
Concept rendering of the Lytro Immerge light field camera rig
6/7
Concept rendering of the Lytro Immerge light field camera rig
The Lytro Immerge platform is made up of four components: a spherical light field camera array (bottom left), a storage and processing server (bottom right), a suite of light field editing tools (top left) and a video playback engine for VR headsets (top right)
7/7
The Lytro Immerge platform is made up of four components: a spherical light field camera array (bottom left), a storage and processing server (bottom right), a suite of light field editing tools (top left) and a video playback engine for VR headsets (top right)
View gallery - 7 images

When camera maker Lytro launched in 2011, it offered snappers something a little different – the ability to shift focus after a photo has been taken. If you wanted light field video, however, you were out of luck. The company has now rectified that with the Immerge system, a four component platform that's billed as the industry's first end-to end hardware, software and related services solution for the production of professional-grade cinematic VR content.

The Immerge rig is the culmination of 8 years of research into light field technology, and has been developed to bring some photorealistic goodness to a combined real world/computer-generated virtual reality experience. It's built on a modular capture and processing architecture, benefits from a new light field processing engine and comprises four main components.

First and foremost is a spherical light field camera array that's reported capable of capturing "all the data from all directions at any location within a given volume" (meaning that views can be generated from anywhere within that captured volume, and from any direction or field of view). Since any videographer or crew would be "in shot" for a 360 video panorama, the rig will be operated remotely using a tablet.

Lytro promises content creators stitch-free capture, the ability to blend live action and computer-generated graphics seamlessly, depth information in each frame and accurate horizontal and vertical parallax. Where interocular baselines (the distance between human eyes) are usually set at the time of capture, light field technology makes the Immerge system capable of supporting baseline adjustment after capture.

The Immerge rig is the culmination of 8 years of research into light field technology
The Immerge rig is the culmination of 8 years of research into light field technology

The next part of the Immerge equation is a high bandwidth direct-to-disk storage and processing server to deal with the huge amount of data flowing from the camera over fiber cable. Lytro has developed a suite of light field editing tools that integrate with already-available visual effects tools to help with VR content creation, and there's a video playback engine for current and upcoming high-end headsets (though the tech is also reported compatible with mobile solutions).

The Immerge system is not ready for release just yet though, Lytro is currently asking for development partners to register for early access to the prototype. Eventual pricing has not yet been announced, but we suspect the technology will be very costly indeed. Availability has been penciled in for early next year.

In the meantime, the team explains the Immerge technology in the video below.

Source: Lytro

View gallery - 7 images
1 comment
1 comment
Bob Flint
Without knowing the details of the expected resolution of all the data points coming together, and being able to be translated from what every raw format into real images we perceive even what Google's mobile force does daily is amazing and within a few years will only get better.
I don't think it will progress to 8k or even 4k resolution any time soon, but till then the human eye and mind still reins supreme for true 3 dimensional interpretation. Especially when you add the other senses together then that's reality..