Music

Apple Vision Pro is about to enable fully immersive 3D music production

Apple Vision Pro is about to enable fully immersive 3D music production
The upcoming version of RipX is being designed to work with Apple's Vision Pro headset, and is pitched as the world's first spatial/3D AI DAW
The upcoming version of RipX is being designed to work with Apple's Vision Pro headset, and is pitched as the world's first spatial/3D AI DAW
View 5 Images
The upcoming version of RipX is being designed to work with Apple's Vision Pro headset, and is pitched as the world's first spatial/3D AI DAW
1/5
The upcoming version of RipX is being designed to work with Apple's Vision Pro headset, and is pitched as the world's first spatial/3D AI DAW
Floating toolbars, layered tracks, editable instruments/notes and more within a virtual space
2/5
Floating toolbars, layered tracks, editable instruments/notes and more within a virtual space
Users will be able to "explode the music to fill your room. Walk around and interact with melody while it plays through you, just like it’s really there. This is a new way to create and enjoy sound that needs to be experienced to be believed"
3/5
Users will be able to "explode the music to fill your room. Walk around and interact with melody while it plays through you, just like it’s really there. This is a new way to create and enjoy sound that needs to be experienced to be believed"
"Create and edit in your own, color-coded 3D space, and literally work outside of the box like never before," said Hit'n'Mix
4/5
"Create and edit in your own, color-coded 3D space, and literally work outside of the box like never before," said Hit'n'Mix
The Apple Vision Pro was launched in June 2023, but only made available for sale earlier this month
5/5
The Apple Vision Pro was launched in June 2023, but only made available for sale earlier this month
View gallery - 5 images

Producing music these days can be something of a flat experience, undertaken using powerful software running on a computer. With the sales launch of the Apple Vision Pro, DAW maker Hit'n'Mix is planning to immerse musicians in their creations.

Apple wasn't first to the mobile music game, but the iPod supercharged the market. Likewise with smartphones and tablets. With players like Meta and HTC already well established in the VR/AR headset space, Apple finally revealed its challenger in June of last year in the shape of the US$3,499 Vision Pro "spatial computer."

It only actually went on sale earlier this month though, and launched with hundreds of apps to immerse users in digitally augmented or virtual worlds – but there were a few notable omissions, including Netflix and YouTube. Reviews from users and tech mags have been mostly positive – though Mark Zuckerberg cheekily took to Insta last week with an unsurprising recommendation for folks to use the latest Quest instead.

Of course the headset can also be used as a virtual computer monitor, and some creators and musicians have started to serve up digital audio workstations (DAW) through the Vision Pro. But at the moment that essentially just replicates the kind of two-dimensional views you'd see on a laptop or computer screen. UK software company Hit'n'Mix has more immersive plans for its AI-powered RipX DAW.

Users will be able to "explode the music to fill your room. Walk around and interact with melody while it plays through you, just like it’s really there. This is a new way to create and enjoy sound that needs to be experienced to be believed"
Users will be able to "explode the music to fill your room. Walk around and interact with melody while it plays through you, just like it’s really there. This is a new way to create and enjoy sound that needs to be experienced to be believed"

"One of our aims in recent years has been to not only create an AI DAW that simplifies and de-clutters the music-making experience, but to also innovate within the fledgling virtual music-making space," said CEO Martin Dawe. "So, whilst we are delighted that RipX DAW is gaining recognition as the best and only AI DAW of its kind, we are excited to announce that soon, with Apple Vision Pro, RipX DAW will also offer a completely new, interactive, compositional experience, giving users much more freedom to view and create music in their chosen surroundings – all utilising our unique, note-based Rip audio format."

Details are pretty light, but the plan is to present MIDI and audio as editable notes, chords and unpitched sounds instead of waveforms – all accessible via hand gestures. Instruments are placed at different distances from the headset-wearing creator, with notes and layers color coded for clarity and ease of use. The tracks can be laid out in front, or exploded to fill the space so users can walk inside the melody as it plays, tweaking as they go.

The suite will reportedly include the world's first audio separation sampler, which will allow users to rip songs into layers, make modifications and "re-perform with a controller into a new or existing layer." Single-click effects are available, there's support for importing VST instruments, it will be able to import ideas from AI music generators for manipulation, note/chord recognition is cooked in to help musicians learn song parts, and a user's preferred background images can be loaded in "to set the mood."

As with any DAW, there's a lot to get your head around, but as you can see from the teaser video below, the possibilities look pretty wild. The availability window is currently given as "coming soon." Whether it's enough to tempt music pros away from Ableton, Cubase, PreSonus or Logic Pro remains to be seen.

Apple Vision Pro: MUSIC PRODUCTION

Source: Hit'n'Mix

View gallery - 5 images
2 comments
2 comments
warmer
1000% no. As a producer of 25+ years. The further we get from touching the control services we use the less human things feel. There is no way VR can replace music production, ESPECIALLY when the audio you are hearing isn't of studio quality. Whomever wrote this article is not a producer and doesn't understand why this is such a poor use of this tech.
dave be
The DAW part already exists as its own product. Ive used it and it definitely has some great uses. The AVP part is silly an gimmicky. Its a decent bet the Apple ditches this tech as a costly boondoggle and theres very little excuse for an otherwise serious music software production company to invest development time in such a side project.