Electronics

The light stuff: High speed projection mapping taken to the next mind-blowing level

The light stuff: High speed pr...
This new projection mapping system can track movements and give the impression of an object reflecting light
This new projection mapping system can track movements and give the impression of an object reflecting light
View 4 Images
The motion-tracking software creating the projected image in real-time to respond to a person's movements
1/4
The motion-tracking software creating the projected image in real-time to respond to a person's movements
A display projected onto a subject's chest
2/4
A display projected onto a subject's chest
The complex projector and motion-tracking system
3/4
The complex projector and motion-tracking system
This new projection mapping system can track movements and give the impression of an object reflecting light
4/4
This new projection mapping system can track movements and give the impression of an object reflecting light

Researchers from the University of Tokyo have made an incredible advance in the field of real-time projection mapping, creating a new system that can simulate the way light reflects off a nonexistent three-dimensional structure. The result is stunningly realistic dynamic projection that heralds a new generation of trippy performance art.

The team, from the Ishikawa Watanabe Laboratory, has been slowly working for several years to develop all the independent components that make up this remarkably advanced system. First, a high-speed projector needed to be created allowing for 8-bit level images to be projected at up to 1,000 frames per second.

The complex projector and motion-tracking system
The complex projector and motion-tracking system

A 3D motion-tracking system was also developed, utilizing 10 cameras able to map the movement of objects at high speed and recognize a degree of granular deformation in the mapped objects. An early example of the system was used to project an image onto a t-shirt. The projection recognized when the fabric was being stretched and could mirror its output in realtime so it appeared as if the projected image was actually printed onto the clothing.

Dynamic projection mapping onto deforming non-rigid surface

The latest iteration of this technology takes the illusion even further, adding a three-dimensional light mapping element to make the projection seem like a real 3D object reflecting light. The demonstration video (seen below) shows a variety of textures responding to movement in real-time, from metal that reflects a light source as if a spotlight is being shined on it, to a weird, uneven organic pattern that looks like it is an alien snake wrapped around a moving human body.

DynaFlash v2 and Post Reality

Just one year ago, the Ishikawa Watanabe Laboratory team collaborated with Japanese artist Nobumichi Asai on a mind-bending facial projection installation called INORI. This was a demonstration of the first iteration of this high-speed projection mapping technology, and now the team has taken it even further with this new development that incorporates small dynamic light reflections that begin to fundamentally blur the boundary between the real and the unreal.

Source: Ishikawa Watanabe Laboratory

2 comments
guzmanchinky
That is so coooool
ChairmanLMAO
WOW - I totally didn't understand what was happening until I saw that video. Now I GOT to see more videos!