Computers

Fun machine learning experiment creates a vocal opera in your browser

Fun machine learning experimen...
The Blog Opera is trained on recordings of actual opera singers, and then produces sounds based on its understanding of what opera should sound like
The Blog Opera is trained on recordings of actual opera singers, and then produces sounds based on its understanding of what opera should sound like
View 3 Images
Pitch and vowel sounds are controlled by dragging a blob up or down, forward or back
1/3
Pitch and vowel sounds are controlled by dragging a blob up or down, forward or back
The Blob Opera will offer its take on popular Carols like Jingle Bells and Joy to the World
2/3
The Blob Opera will offer its take on popular Carols like Jingle Bells and Joy to the World
The Blog Opera is trained on recordings of actual opera singers, and then produces sounds based on its understanding of what opera should sound like
3/3
The Blog Opera is trained on recordings of actual opera singers, and then produces sounds based on its understanding of what opera should sound like
View gallery - 3 images

Google's Arts and Culture lab has launched a clever browser experiment in collaboration with David Li. The Blob Opera puts four operatic voices at your disposal to create glorious AI-driven performances.

The machine learning model used in the experiment was trained on the real voices of four opera singers. Christian Joel (tenor), Frederick Tong (bass), Joanna Gamble (mezzo soprano) and Olivia Doutney (soprano) recorded 16 hours of audio for the experiment. Ingunn Gyda Hrafnkelsdottir and John Holland-Avery provided additional vocals.

But what you hear when you create your very own mini opera using a mouse cursor is actually what the AI determines opera should sound like based on what it's learned from those recordings.

Google says that the Blob Opera will only work in browsers and on machines that rock the latest web technology, and may not work on mobile devices. But if you do get it to work, the results are impressive.

The Blob Opera will offer its take on popular Carols like Jingle Bells and Joy to the World
The Blob Opera will offer its take on popular Carols like Jingle Bells and Joy to the World

To get the blobs blobbing and the gorgeous harmonies sounding, you click on one of the characters and drag it up or down to alter pitch and forward or back to change mouth shape for different vowel sounds. Individual or multiple blobs can be silenced by muting the audio icon, and the eyes follow the mouse cursor around the screen.

Performances can be recorded for playback and sharing, and clicking on the tree icon plops some festive hats on the heads of the blobs and offers their takes on popular Carols. The blobs don't manage to sing actual words, but the vowel sounds will still have you humming along. You can check it out yourself via the project link below. Great fun.

Project page: Blob Opera

View gallery - 3 images
4 comments
4 comments
Spud Murphy
Ha, the blobs are just what we needed after this year.
andrewct
An absolute scream.... great fun! The children are going to go wild with this.
KeithW
What fun ! Wasn't sure if my lowly 2017 machine would run it but it does.
Terry Pardy
Works great on my iPad Pro with Pencil.