Robotics

Art in the age of ones and zeros: Robot art

View 53 Images
CloudPainter creating the work Hunter 2017
CloudPainter
A work from PIX18 created by using a B&W source photo as inspiration
PIX18 / Creative Machines lab
An original composition created from scratch simply using the PIX18 machine algorithms
PIX18 / Creative Machines lab
An original composition created from scratch simply using the PIX18 machine algorithms
PIX18 / Creative Machines lab
An original composition created from scratch simply using the PIX18 machine algorithms
PIX18 / Creative Machines lab
A work by PIX18 based on a color photograph from Woodstock
PIX18 / Creative Machines lab
From CMIT, the ReART project uses haptic recording to copy an artist's movements and reperforms the process using a robot
CMIT ReART
The ReART robot in action
CMIT ReART
The CMIT ReART robot reproducing an artist's copy of the classic van Gogh work Starry Night
CMIT ReART
CMIT ReART
CloudPainter creating the work Hunter 2017
CloudPainter
One of the Hunter 2017 works from CloudPainter demonstrating the system's ability to create intricate and abstract brush strokes
CloudPainter
One of the Hunter 2017 works from CloudPainter demonstrating the system's ability to create intricate and abstract brush strokes
CloudPainter
A look at three different iterative stages for three different artworks from CloudPainter
CloudPainter
A work from CloudPainter called Corinne displaying the system's ability to create original abstract portraiture 
CloudPainter
A Jackson Pollock inspired artwork from e-David
e-David
A Jackson Pollock inspired artwork from e-David
e-David
A self portrait by e-David
e-David
e-David creating the self-portrait
e-David
Preliminary sketches created by a human artist used to develop the data for e-David to create its self-portrait
e-David
Pointer by JACKbDU
JACKbDU
Pointer being created
JACKbDU
Self-Portrait by JACKbDU
JACKbDU
Self-Portrait being created
JACKbDU
Black to White by JACKbDU
JACKbDU
Black to White being created
JACKbDU
a portrait of Steve Jobs by JACKbDU
JACKbDU
The WWF panda logo by JACKbDU
JACKbDU
The HEARTalion system visually interprets the emotional state of its "muse" gleaned from their brain waves
HEARTalion
HEARTalion's depiction of the emotion 'Pleased'
HEARTalion
HEARTalion's depiction of the emotion 'Angry'
HEARTalion
HEARTalion's depiction of the emotion 'Dynamically Miserable'
HEARTalion
HEARTalion's depiction of the emotion 'Misery'
HEARTalion
A close-up of the water color technique from the Late Night Projects robot
Late Night Projects
A piece called 'Eye' from Late Night Projects
Late Night Projects
Koi by Late Night Projects
Late Night Projects
A close-up of the water color technique from the Late Night Projects robot
Late Night Projects
Water Lily by Late Night Projects
Late Night Projects
Profile from the Wentworth Institute of Technology 
Wentworth Institute of Technology 
Profile from the Wentworth Institute of Technology 
Wentworth Institute of Technology 
Gradient from the Wentworth Institute of Technology 
Wentworth Institute of Technology 
Profile from the Wentworth Institute of Technology 
Wentworth Institute of Technology 
An image of Audrey Hepburn reinterpreted by the brush stroke bot of the Wentworth Institute of Technology 
Wentworth Institute of Technology 
Andy Warhol's Marilyn Monroe image reinterpreted by the brush stroke bot from the Wentworth Institute of Technology 
Wentworth Institute of Technology 
Death of a Bachelor by CARP in which the system created its own visual interpretation of the song 'Death' by Panic at the Disco
CARP
Geometry by CARP
CARP
CARP's interpretation of the song 'Fractions' by Through Juniper Vaile
CARP
BABOT
BABOT
BABOT in action
BABOT
BABOT
BABOT
BABOT
BABOT
The Manibus Project straps a control to a ballet dancer's ankle. The control directs the movement of a robotic painting device that visual interprets the dance performance through paint on a canvas
Ballet Des Moines / Manibus Project
The Manibus Project straps a control to a ballet dancer's ankle. The control directs the movement of a robotic painting device that visual interprets the dance performance through paint on a canvas
Ballet Des Moines / Manibus Project
The Manibus Project straps a control to a ballet dancer's ankle. The control directs the movement of a robotic painting device that visual interprets the dance performance through paint on a canvas
Ballet Des Moines / Manibus Project
View gallery - 53 images

Art has always been fundamentally intertwined with technology. New techniques and materials have constantly allowed artists to innovate and create new types of works. In this series we look at the impact of digital technologies on art and how artists are creating entirely novel forms of art using these modern tools. We've previously examined the fields of "datamoshing", ASCII art, BioArt, Minecraft Art and Internet Art. In this instalment we examine a fascinating world where scientists are teaching robots how to paint works of art.

Artificial intelligence systems are currently excelling at producing elaborate digitally generated works of art. Every other week we seem to see a new neural network developed to mimic a famous artists' aesthetic or convert a photograph into a painterly image. But what about machines actually mimicking the process a human artist uses to paint on a canvas? That particularly human skill seems to be a lot harder for machines to replicate.

In 2016, the RobotArt competition was founded by Stanford educated mechanical engineer Andrew Conru. The competition was designed to stimulate robotic engineers to create new mechanical painting devices. In setting up the competition Conru noted that many of the initial entries were expected to be variations of a simple mechanism where a robotic arm mimics the movements of a human artist, but many teams took the challenge a step further.

The competition saw a variety of different entries, from a team using an eye-tracking system to control a robot's movement, to a system that had users remotely control a robot via internet-directed brush stroke commands. All the weird and wonderful results reinforced the question of how truly creative a robotically generated work of art could really be.

Below are the recently announced winners of the 2017 RobotArt competition. Be sure to click through to our gallery to get a broader look at each winner's work.

Winner - PIX18 / Creative Machines lab

An original composition created from scratch simply using the PIX18 machine algorithms
PIX18 / Creative Machines lab

From a mechanical engineering team at Colombia University we get the winner of RobotArt 2017, a bot by the name of PIX18. Apparently this is the third generation of a system developed with the goal of creating a robot capable of creating original artwork using the classic medium of oil on canvas.

Judging comments applauded this robot's ability to produce "some lovely paintings from sources or scratch" and noted that the work had "brush strokes evocative of Van Gogh".

2nd Place - CMIT ReART

The ReART robot in action
CMIT ReART

The ReART system uses a haptic recording system to record artists painting a work. The system tracks the position of the brush, the force being exerted and a variety of other data points. A robot then "plays back" the recording, creating a perfectly mimicked ink brush drawing.

The project is from the Department of Electrical Engineering at Kasetsart University in Thailand and looks to develop motion control robotics for a variety of industrial and creative uses.

3rd Place - CloudPainter

One of the Hunter 2017 works from CloudPainter demonstrating the system's ability to create intricate and abstract brush strokes
CloudPainter

CloudPainter is one of the most technically sophisticated projects in the RobotArt competition. Utilizing AI and deep learning systems, the project aims to get the machine to make as many individual creative decisions as possible. According to the creators, currently "the only decision made by a human is the decision to start a painting."

More info on their process can be found on their website.

One of the judges said of the machine's work, "Spontaneous paint, "mosaicing" of adjacent tones, layering effects and the graphical interplay between paint strokes of varying textures, are all hand/eye, deeply neurally sophisticated aspects of oil painting..."

4th Place - e-David

A Jackson Pollock inspired artwork from e-David
e-David

e-David is an evolving robotic painting system that uses a visual feedback loop to constantly record and re-process how the machine is interpreting its recreation of an input image. Using an ordinary industrial welding robot combined with cameras, sensors and a control computer, the system can correct errors as it paints, while also understanding what the makers call "human optimization processes".

5th Place - JACKbDU

Self-Portrait by JACKbDU
JACKbDU

This is one of our favorite works from the competition. From a student at New York University Shanghai, this project is inspired by the aesthetic of American artist Chuck Close. The system starts with an input image that is converted to a low resolution and painted pixel by pixel using a mobile robot with omni wheels.

Each oversized, low-res pixel that is cribbled by the robot is roughly the size of a human hand and each entire artwork is 176 X 176 cm (5.7 x 5.7 ft), or just about as tall as a human being.

6th Place - HEARTalion

HEARTalion's depiction of the emotion 'Pleased'
HEARTalion

HEARTalion is a project from Halmstad University in Sweden that attempts to develop a system that can recognize and subsequently depict a person's emotional state. The system captures emotional signals using a Brain-Machine Interface (BCI) and a robot then attempts to convey the emotions visually based on a model that was developed with advice from two local painters in Halmstead, Peter Wahlbeck and Dan Koon.

One of the impressed RobotArt judges remarked in reference to HEARTalion, "If this body of work was exhibited at a gallery and I was told that the artist aimed to capture emotion through color, composition, and textures — I would buy."

7th Place - Late Night Projects

A piece called 'Eye' from Late Night Projects
Late Night Projects

This independent entry from an electronic engineer who put in most of the work after his wife and kids had gone to bed uses a simple XYZ axis painter bot guided by two basic behavioral rules. All of this project's work is from reinterpretations of input images, but because the robot receives no feedback from sensors or cameras, the mixing of colors isn't faithful to the source. However, the novel strength of this project comes from its gorgeous use of watercolor paint.

8th Place - Wentworth Institute of Technology

Profile from the Wentworth Institute of Technology 
Wentworth Institute of Technology 

Using the precision of a robotic artist to its advantage, this project created a system that minutely controls the pressure and movement of single brush strokes to create stunning images that a human would struggle to accurately produce. The members of the team describe their process in greater detail here and have also publicly offered up their source code in the hope others will build upon their work.

9th Place - CARP

Geometry by CARP
CARP

CARP, or Custom Autonomous Robotic Painter, comes from a team at the Worcester Polytechnic Institute in Massachusetts. The system uses image decomposition techniques to dissemble input images, which are then reconstructed by a robot. Visual feedback systems are also incorporated into the process allowing for dynamic corrections to be applied to the work as it is being created.

10th Place - BABOT

The Manibus Project straps a control to a ballet dancer's ankle. The control directs the movement of a robotic painting device that visual interprets the dance performance through paint on a canvas
Ballet Des Moines / Manibus Project

An experimental project from a team at MIT. This is an evolving robot arm that was saved from an existence as a decorative coat rack and has slowly been given more peripherals, such as an auto-brush cleaner and wireless control via a video game controller. Equipped with machine learning abilities, the robot can grow its skill set from project to project.

Take a closer look through some more of the amazing and varied robot painted artworks in our gallery.

View gallery - 53 images
  • Facebook
  • Twitter
  • Flipboard
  • LinkedIn
0 comments
There are no comments. Be the first!