7thpower
Making terrible decisions, such as investing in distractions for your company and consumers, and then letting your workforce pay the tab.. is the thing that is not great for society.
Was this comment created using quantized llama 3?
I love Groq, but across every single line break in your post there is a glaring issue that is easy to refute with in 15 seconds, even without 300t/s of throughput.
But also, trust me bro.
The frontier labs have fantastic margin on inference. You do not understand how fantastic. And they have license to change inputs at will based on profitability.
They are not only innovating on models and tooling, they are innovating on cogs (I wrote this btw, and I’m not going to stop writing this way because Claude discovered it’s brilliant).
Speaking of models, the cost of training is not scaling nearly as fast as demand for inference. Training used to be the biggest cost by far, now it’s not.
So margin is increasing, and guess what else is happening? Customers are finding value. And the customers that are finding value are also the ones who happen to have huge enterprise budgets.
And while this is happening, so is implicit collusion (and lock in, and hype, and all that). And so prices are going up.
They’re going to be just fine man, there is no inference bubble.
They can modulate supply. It’s all going to be fine. You should invest.
This was after around 700 hours, which isn’t terrible, but working with their support is exhausting. I don’t think I’m going to touch it again until winter, unfortunately.
Thank you, my friend.
And also fuck scrum and purist agile too.
I was blessed to have a leader who wanted us to spend a lot of time on the field, working turnarounds doing, whatever I could to be helpful, etc. to learn the business and build relationships.
Working around the refineries, especially during turnaround, was a crash course in constraint theory and economics.
Good times.
At any rate, all of that was to qualify that most people would not believe how much time and money has been wasted trying to find innovative new ways to serve and capitalize on the CA biodiesel market.
This one sided type of embedded insurance is not unique to Anthropic, but sharply increasing cost, layered on top of the self righteousness, seems to be making the stench unbearable over the past year.
I used to think of Anthropic as the good guys, and I don’t doubt they still sincerely hold that view of themselves, but I think I prefer Sam Altman’s version.
His brand of self righteousness was convincing at first but eventually he started to turn to the camera and wink, like in House of Cards, to let us know.. he knew that we knew. And then, for me anyway, it became more mundane and less offensive.
When Dario and crew go out and profess, as they have for years now, that if we could only see the thing that’s a few months away, we would all realize how doomed knowledge work and national security are…
..and then continue to release software so buggy and shitty that they have to do biweekly HN apology tours, I begin to miss the wink at the camera.
It was also very clear the OAI and MS teams held each other in contempt (not relevant, but was interesting and grew in the immediate aftermath of the Altman drama).
So why were we using it? OpenAI don’t really have an enterprise go to market, bedrock still relied on Claude 2, and we weren’t willing to YOLO on clickthroughs.
Once Claude 3 came out, we jumped ship. That sucked too, although I hear it’s gotten better though.