News for hackers. Stuff that matters.

A comment on Show HN: Open-source macOS AI copilot (using vision and voice). Parent comment

Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Tuesday December 12, 2023 @01:00PM (#38615837)
So glad when I saw this, thanks for sharing this! It was exactly music production in Ableton was the spark that lit this idea in my head the other week. I tried to explain to a friend that don't use GPT much that with Vision, you can speed up your music production and learn how to use advanced tools like Ableton more quickly. He didn't believe me. So I grabbed a Ableton screenshot off Google and used ChatGPT -- then I felt there had to be a better way, I realized that I have my own use-cases, and it all evolved into this.

I sent him your video, hopefully he'll believe me now :)

[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by thomashop on Tuesday December 12, 2023 @01:42PM (#38616434)
You may be interested in two proof of concepts I've been working on. I work with generative AI and music at a company.

MidiJourney: ChatGPT integrated into Ableton Live to create MIDI clips from prompts. https://github.com/korus-labs/MIDIjourney

I have some work on a branch that makes ChatGPT a lot better at generating symbolic music (a better prompt and music notation).

LayerMosaic allows you to allow MusicGen text-to-music loops with the music library of our company. https://layermosaic.pixelynx-ai.com/

[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Tuesday December 12, 2023 @02:00PM (#38616703)
Oooh. Yes, very interested in MusicGen. I played with MusicGen for the first time the other week and created a little script that uses GPT to create the prompt and params which is stored to a text file along with the output. Let it loop for a few hours to get a few 100 output files that allowed me to learn a bit more about what kind of prompts that gave reasonable output (it was all bad, lol!)
[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Tuesday December 12, 2023 @02:09PM (#38616821)
Oh LayerMosaic is dope. I'm not entirely sure how it works, but the sounds coming out of it is good -- so you have me intrigued! Can I read more about it somewhere, I might have a crazy idea I'd like to use this for.
[ Parent | on HN ]
Re:Show HN: Open-source macOS AI copilot (using vision and v... by ralfelfving on Tuesday December 12, 2023 @02:01PM (#38616721)
My brain read midjourney until I clicked on the GH link. What a great name, MIDIjourney!
[ Parent | on HN ]