The main problem I have with generative AI tools in an artistic sense is when they lack the ability to convey specificity of intent, word prompts alone aren't good enough.
I think this might be a good research paper proof of concept for a model, and a lack of explanation of how it works is disappointing but expected. I think as a product, the target audience for this thing isn't people who want to make art, but people who like the idea of generative AI per se. Maybe it'll go more toward being a tool artists can use in the future, but I don't think that's what gets you funded in this environment, and it seems much harder to make things that work that way. The coolest uses of and tooling for generative image models have been created by the open-source communities around them, and I think the same will be true of audio
Yes! While technically impressive, these "text prompt to finished song" AI tools currently only solve low-value problems for already over-saturated markets. I just don't see a good path to a real business from "finished song" as the use case.
* Music consumers already have access to more new, human-created songs than they can possibly listen to via Spotify, Soundcloud, etc at historically low cost.
* Buyers of custom created music such as video makers and game studios already have more stock music library choices and custom creation options (from Fivr etc) than ever - also at historically low costs.
These are already low-value, commoditized markets and, once the novelty wears off, I can't see how deploying expensive, cutting-edge AI generates VC-level returns. And, no, I don't think AI is going to take a meaningful part of the high-end music market from the likes of Taylor Swift. It's not that I doubt AI will eventually make music that good - it's that high-earning pop stars like Taylor Swift, Beyonce, etc are much more than their songs. They are brand businesses that generate more revenue from touring, merch and product tie-ins than the music itself.
However, there is a potentially quite profitable market need AI music could meet that no one's targeting yet. It's a smaller market but it's accessible, scalable and even viable for beta-level, "research-to-product" solutions. Make an interactive tool that works with human music makers in a much more granular fashion. Generating entire finished songs is saturated and low-margin. Instead, collaboratively generate the elements and components of music (called stems) as well as the underlying MIDI data. There's already a good business in selling human-created element libraries consisting of stems, loops, backing tracks, samples and even song construction kits. These are already used in a lot of the human-created music we hear.
I'm just a long-time music making hobbyist and I consistently spend several hundred dollars a year buying such libraries, stems, loops and samples. It's far more than I pay for all my subscriptions to 'finished music' combined. And I have no aspirations to even make money with my music. It's just super fun to do. An AI which would take text prompts along with some midi chords and phrases I provide and then generate a variety of suggestions in the form of separate stem tracks with MIDI which I can further mix and modify would be an 'instant buy' for me. And the output doesn't even need to be 'top human' quality to be extremely valuable as an interactive creative tool. Pop stars like Taylor Swift etc can afford to hire the best, proven, human-producers, studio musicians and mixing engineers to collaborate with but there's a significant market of people, from students to hobbyists to indies and semi-pros who can't afford top-notch proven collaborators.
AI music entrepreneurs: This is an economically viable use case serving an addressable and accessible market that's already spending money on non-interactive, non-customized stems, loops, tracks and libraries. AI can provide a superior interactive solution right now - and you can make money with an imperfect, evolving solution. You also won't have to out-market Taylor Swift or outspend FAANG. To me it looks like a rare thing. A classic "three guys in a garage"-accessible AI startup opportunity where a modest seed round get to real cash flow.
The day we get a similar level of control with AI music will be a dream come true for me. We really need stems or at least MIDI files for these tools to be more than just soulless jingle generators imo.
What I'd love is Suno/Udio as a VST plugin. Being able to supply MIDI or audio samples to pull melodies from, to generate from arbitrary audio on a timeline.
Machines for those tasks are already commonplace. Is loading/unloading them really that much effort?
- Is it as good as N targeted music tracks that fit together to match my game? No.
- Is it better than something I can create myself? By far.
- Is it better than a random few open-source or cheap tracks that you can buy on any random storefront? Sometimes.
So at the very least it has a foot in the door as far as I'm concerned.