It's kinda like commuting in the autobahn with a Porsche.
Some agentic madness is like doing donuts in the parking lot drinking beer impressing the local baddies.
So, so much fun. But at the end of the day we used to get so much more done with much, much less computer power, energy, mental drain.
It's always more software tooling, more moving parts, more apps, more more more. Fun. Looks neat. Used sooo much energy, I feel so drained. It was fun.
But at the end of the day, for the long run what I want in my life is to win at rally on a dependable machine with a nice navigator I'm friends with. Or have a shed full of tractors making money for my family on the farm everyday.
LLMs are fun. But I want to use my mind to write great software that adds value in as little lines of code as possible designing systems that people can understand readily and maintain well 2 or 3 handovers from me.
Yes. The frontier models are good, indeed, but they are just far too expensive to use much. Recently I was showing my executive leader that we could simply run a certain set of tasks on the top frontier model and we'd be good to go. Oh but it would cost over 15M/year. We're a relatively small company, that's over two magnitudes more than what makes sense for us. So, never going to happen.
What remains then is an optimization exercise to bring the cost down. For months now we've been optimizing usage so we can run nearly all tasks on very cheap models to good success. It's fun to optimize and keeps the CFO from having a heart attack.
But not good news for the AI companies relying in a firehose of cash coming in from their frontier models.