natecodes

I saw the need for this because existing DAWs have lots of limitations from an agent perspective. Agents can't hear so they need to be able to inspect music in just text.

A major known limitation is that it can't do voices, and if you try to get it to recreate a song, it can get stuck in a render->check loop where it starts flip-flopping on details but never gets the score to 100%. I'm guessing that there are some shallow valleys in the score landscape for trying to match the exact sound of a full song.

I put up a showcase page where you can hear some stuff I already made here: https://newsbubbles.github.io/ismail/ to get a feel for some range. I just happen to like brostep so I went that direction immediately.

> This is not a call to action for experts to rally behind a sophisticated plan. Like so many things about the AI revolution, it’s just occurring to me that we’re on a long greasy slide to a place that will look different than where we are today.

heh. long greasy slide. It really does feel like that.

Time to get the forks out! I mean, there is no stopping anyone from forking everything and just iterating off of that. But I dunno, look at zig. They tried to pull the whole "humans don't write slop, AI does, so ... humans only" thing, and it was so wrong that Bun got rewrote into rust. People who believe that bad code didn't exist before AI are not remembering the world before AI properly.

the only pushback I have for this summary is on point #2. If by local models you mean Kimi K3. Only the likes of fireworks can run that beast. Even the quantized versions are massive and require a cluster of high performance GPUs to run. It's going to be awhile before Local (ie: people with consumer GPUs) models will rival frontier at the level everyone is imagining.

There's also this gap between what you need a large model to be. Large frontier models are generalists and stuck into harnesses that allow general interaction. Only now are they starting to differentiate the harnesses, and as a rule of thumb, narrower use cases don't need as massive/general of models. So that acts as a pressure, but it's not a linear pressure and based on many factors about consumer harness based apps that become popular.

Could there one day be something as versatile as claude code running locally? Sure, but we need hardware and software breakthroughs to get there, and they are pretty big breakthroughs... hardware breakthroughs have happened, but for instance optical chips are starting to ship, though there will be no optical consumer level chips for years, not because of scaling issues, but because the datacenters have reserved those chips for themselves over the next couple of years.

It literally turns into a race between them trying to make datacenters acceptable to the general public hoarding all the hardware that could be used to run local models and, what... people and companies that want to run locally?

I agree though that something has got to give.

In any society where automation is on tap and "work" is done by robots for the most part, looking past the inequality points you guys made (and still watching the video), but I think that, as a programmer of 30 years, what will still be left for us is creativity and relationships. I think in a technological society like Jacques Ellul wrote, desire may be shaped, but cannot be automated, and desire is the driving force behind all our behavior (Bertrand Russel).