Computers

Face hacking: The creepy cool art of facial projection mapping

Face hacking: The creepy cool ...
In a few short years, the art and technology of facial projection mapping has evolved sustantially
In a few short years, the art and technology of facial projection mapping has evolved sustantially
View 13 Images
Nobumichi Asai's latest project, INORI (prayer)
1/13
Nobumichi Asai's latest project, INORI (prayer)
Omote was one of Asai's early facial projection mapping projects
2/13
Omote was one of Asai's early facial projection mapping projects
Darius Rucker, from Hootie & the Blowfish, coming face to face with his wax counterpart, complete with facial projection
3/13
Darius Rucker, from Hootie & the Blowfish, coming face to face with his wax counterpart, complete with facial projection
Rucker and his artificial counterpart
4/13
Rucker and his artificial counterpart
The second iteration of Asai's Omote project contained even more sophisticated mapping techniques
5/13
The second iteration of Asai's Omote project contained even more sophisticated mapping techniques
The second iteration of Asai's Omote project contained even more sophisticated mapping techniques
6/13
The second iteration of Asai's Omote project contained even more sophisticated mapping techniques
The second iteration of Asai's Omote project contained even more sophisticated mapping techniques
7/13
The second iteration of Asai's Omote project contained even more sophisticated mapping techniques
In a few short years, the art and technology of facial projection mapping has evolved sustantially
8/13
In a few short years, the art and technology of facial projection mapping has evolved sustantially
The Golem project from BK
9/13
The Golem project from BK
The second Golem project from BK
10/13
The second Golem project from BK
The second Golem project from BK
11/13
The second Golem project from BK
Asai's real time face generator project
12/13
Asai's real time face generator project
Asai's real time face generator project
13/13
Asai's real time face generator project

Innovations in the fields of projection mapping and facial tracking are allowing artists to do some amazing, and creepy, things with digital images projected onto both inanimate and animate objects. In just a few years the technology has advanced from still images being projected onto static surfaces, such as buildings, to animations being projected onto moving faces.

Madame Tussauds in Nashville is soon to launch a new interactive experience where a digital animation of a face will be projected onto the wax figure of Hootie & the Blowfish frontman Darius Rucker. The facial projection technology will bring the wax figure to life – its face, at least – as the intricately projected image makes it look like the still waxwork is talking to you.

While this is the first time Madame Tussauds has integrated this kind of facial mapping projection technology into its exhibitions, this is not the first time artists have played around with this fascinating, and fast-evolving, technique.

Darius Rucker Meets His High Tech Figure for Madame Tussauds Nashville

Rucker and his artificial counterpart
Rucker and his artificial counterpart

In 2015, French digital art company BK embarked upon a series of projection mapped works it called "augmented uncanny sculptures" under the project banner of Golem. The concept projected moving faces onto classic sculptures in a gallery setting. The result was a weirdly unsettling but exciting mesh of old and new art, bringing to life these still figures through subtle projected movements.

GOLEM // Augmented uncanny sculpture - Teaser

The team's second realization of the concept, at the Lyon Fine Art Museum, brought three more classic sculptures to life, including one chillingly creepy projection on a statue of Medusa.

In a few short years, the art and technology of facial projection mapping has evolved sustantially
In a few short years, the art and technology of facial projection mapping has evolved sustantially

However, the most innovative, and technologically advanced practitioner in the field of facial projection mapping is undoubtedly Nobumichi Asai, a Tokyo-based artist. Asai has been refining the technology over several years, with his work now able to track facial movements in real time and adjust the projections accordingly.

His early work, under the banner of Omote, created mind-blowingly effective images akin to live projection make-up. We saw faces morph into lions or slowly deconstructed to reveal robotic circuits underneath.

The second iteration of Asai's Omote project contained even more sophisticated mapping techniques
The second iteration of Asai's Omote project contained even more sophisticated mapping techniques

The work was so influential that it wasn't long before he was enlisted by Lady Gaga to help create a stunning tribute to David Bowie at the 2016 Grammy Awards. The performance included various iconic Bowie looks being projected onto Gaga's face, all while a spider constantly crawled around.

The second iteration of Asai's Omote project contained even more sophisticated mapping techniques
The second iteration of Asai's Omote project contained even more sophisticated mapping techniques

Another innovative work from Asai was kagami / Real-Time Face Generator, an installation that acted like a 3D mirror where the participant would have their face scanned by a 3D scanner only to have a 3D replica appear in real time constructed by 5000 small motor-driven rods. The three dimensional face would then have a series of images projected onto it.

real-time face generator / kagami

The most recent piece by Asai shows the rapid, and impressive, development of the technology. In INORI (prayer), Asai joined forces with researchers at the University of Tokyo to create a system that can map fast-moving faces in real-time. The university team designed a projector that could project images at 1000 frames per second and combined it with Asai's face-tracking technology to create a performance where dancer's faces could be altered in real-time at amazing speeds.

Nobumichi Asai's latest project, INORI (prayer)
Nobumichi Asai's latest project, INORI (prayer)

The final product is a stunning leap forward in the field of facial projection mapping, for the first time allowing for accurate mapped projections onto figures moving at fast speeds. With this kind of innovation across just a few short years one can only wonder at what these technologically influenced artists will be creating a few years from now.

INORI (Prayer)

2 comments
FollowTheFacts
...but, this type of "technology" goes back to at least the early seventies....
socalboomer
So very cool. Now, someone take and make a hollow 3d print of one of those busts, and figure a way, with mirrors or fiber optics or something, to project from the INSIDE . . . would that be cool, or what! :)