Virtual Reality

Microsoft's "holoportation" lets you augment someone else's reality

Microsoft's "holoportation" le...
A person on the left wearing a HoloLens interacts with a 3D rendering of another person via holoportation on the right
A person on the left wearing a HoloLens interacts with a 3D rendering of another person via holoportation on the right
View 4 Images
A person on the left wearing a HoloLens interacts with a 3D rendering of another person via holoportation on the right
1/4
A person on the left wearing a HoloLens interacts with a 3D rendering of another person via holoportation on the right
A person on the right wearing a HoloLens interacts with a 3D rendering of another person via holoportation on the left
2/4
A person on the right wearing a HoloLens interacts with a 3D rendering of another person via holoportation on the left
Holoportation uses a room of camera to capture and render 3D models
3/4
Holoportation uses a room of camera to capture and render 3D models
Holoportation uses a room of camera to capture and render 3D models
4/4
Holoportation uses a room of camera to capture and render 3D models

Microsoft's research division has developed a new kind of 3D video capture system called "holoportation" that allows for 3D renderings of people to be virtually transported to any environment in real-time. For Star Trek fans, think of it as the inverse of the "holodeck" featured in the franchise that renders virtual environments around a real person.

The system uses a series of 3D video cameras that capture images of a person from all angles and then seamlessly stitches together a 3D model of the person that can be reconstructed, compressed and transmitted anywhere instantly.

A person wearing an augmented reality headset like Microsoft's HoloLens can see, hear and interact with someone who is being "holoported" from anywhere in the world. To the person wearing the HoloLens, the remote participant would appear as a hologram, giving the illusion of being actually present in the same physical space.

This may seem very similar to hologram technologies that we've seen for years, and it is, but the interesting part here is the ability to interact virtually in real-time and integrate the experience with existing platforms like HoloLens.

Holoportation uses a room of camera to capture and render 3D models
Holoportation uses a room of camera to capture and render 3D models

Interactions that take place using the holoportation system can also be recorded and played back, either with HoloLens or any other display technology.

In the demonstration video below, research manager Shahram Izadi describes the experience as "almost like walking into a living memory that I can see through another pair of eyes."

In another cool trick, the 3D recording can also be shrunk to a smaller size to become a tabletop hologram of sorts. Check out the full demo below to see how it works.

holoportation: virtual 3D teleportation in real-time (Microsoft Research)

Source: Microsoft Research

3 comments
John Banister
It seems like something similar to this could also be done for people wearing a VR set using an avatar. I wonder how long until the computers can use recorded 3D capture information to make an avatar indistinguishable from this sort of transmission, allowing people online to visually impersonate others, even as people have impersonated others online using text.
Oun Kwon
Wow. Mr. Bakula should be proud of this, making hologram technique is now here Quantum leaped to the present. Oh how I love to leap home!
Stephen N Russell
Apps for: Education, Tourism, Training, Orientation, Sales, Realty, Games, Planning, Marketing, Policy, Meetings. Be huge, dump the old style Teleconference style for this. Mass produce & expand