Good Thinking

NTT's new projection mapping technique brings paintings to life

NTT's new projection mapping t...
HenGenTou applied to a painting
HenGenTou applied to a painting
View 4 Images
How the HenGenTou technique works
1/4
How the HenGenTou technique works
3D projects movement illusions are possible but only if viewed directly in front of the object
2/4
3D projects movement illusions are possible but only if viewed directly in front of the object
HenGenTou takes advantage of the way the brain perceives color and motion to create an illusory effect
3/4
HenGenTou takes advantage of the way the brain perceives color and motion to create an illusory effect
HenGenTou applied to a painting
4/4
HenGenTou applied to a painting
View gallery - 4 images

If a hanging portrait suddenly smiles back at you, it might be something you've eaten, but it might also be HenGenTou – a new light projection technique developed by NTT Communication Science Laboratories that magically brings static objects like paintings to life.

Projection mapping (known as Shader Lamps), where a real object is overlaid with a projected image, is both costly and technically difficult to achieve, according to NTT Communication Science Laboratories. For this reason, the lab developed what they call HenGenTou, which means "Deformation Lamps" in Japanese.

How the HenGenTou technique works
How the HenGenTou technique works

HenGenTou works by projecting a grey-scale pattern onto a static picture in the general shape of the part of the image that is required to be seen to change or move. Movement is added to this light, which the human brain then interprets as a movement of the image underneath. This illusory approach which preserves the real or existing image (as opposed to physically changing the appearance of the target), adds up to a system that requires less computation than standard projection mapping techniques and is therefore much cheaper.

HenGenTou takes advantage of the way the brain perceives color and motion to create an illusory effect
HenGenTou takes advantage of the way the brain perceives color and motion to create an illusory effect

The human brain interprets this trick of a light as movement of the real image underneath because color and form information are received on a different path to motion information. So when the human brain makes a coherent visual picture of a scene by combining color and form together with motion, it automatically corrects the small amounts of misalignment and anomalies among its sources. The result is that we perceive the pattern produced by HenGenTou as changes in the color and form in the static picture we are looking at.

HenGenTou can be used in under bright ambient lighting conditions and the researchers say that the technique can also be applied to 3D objects, though it is a lot more difficult to achieve and there are restrictions on the viewing conditions under which it will be effective (i.e. you need to stand directly in front).

NTT sees practical applications for HenGenTou in areas such as advertising, where a smiling face or fluttering text on a static sign would certainly be eye-catching event, and interior design

, where the illusion of an undulating flow of water or rising heat waves could be created on floors and walls.

3D projects movement illusions are possible but only if viewed directly in front of the object
3D projects movement illusions are possible but only if viewed directly in front of the object

Gizmag recently checked out the new technique at the annual NTT R&D forum and there is promise of a public demonstration of the art of HenGenTou later in 2015. The overall aim is to have this technology fully developed for the 2020 Olympics in Tokyo, after which it will become commercially available.

In the meantime, you can see the magical HenGenTou effect in the video below.

Source NTT

変幻灯 || Hengentou || Deformation Lamps

View gallery - 4 images
1 comment
Bob Ehresman
We grew up watching the deployment of "Star Trek" tech. Looks like we can now look forward to "Harry Potter" magic.