wolttam
Maybe it’s also folks adapting to the new landscape ahead of them, not desperately holding on to the old norm.
The real issue of our media landscape (information feeds controlled by the elite), probably could have been nipped in the bud some years ago but it may be a little too late for that.
curl > some_file
bash some_file
(Also, how in the world would a server be able to tell where you’re piping the response?)Edit: thanks for the replies, that makes perfect sense
The fear you're sharing has been shared since day 1 of open-weight models and it has yet to come to fruition.
Further, regardless of what any of these labs license their model as, the end user who has downloaded the weights can still use them for virtually any purpose (synthetic data, classification, etc) as much as they want and there is no way to reasonably enforce a license on those outputs.
So even if you can't run a service using this model's weights (without a license), the weights still do provide utility for training new models with any other license.
Real nice prompting there, Google. It also still looks like a video game rendering.
- the utility of the models is not that great (see almost every company outside of tech and even many within tech reporting “no measurable increased revenue or productivity as a result of adopting the technology”.
- China has been undercutting them hard with open-weight models that are “good enough” for 95%+ of use-cases, leaving only the hardest problems for OpenAI and Anthropic’s models, which it turns out isn’t where there is a ton of money to made (curing various forms of cancer is valuable but not “let’s dump trillions on these companies” valuable - and once their models can solve it, it probably won’t be long before others do too).
People want these models on their own hardware. People will (eventually) want these models running on robots that can do real work for them, and they won’t want those things tethered to an insecure and privacy eviscerating cloud subscription.
The money to be made is in selling hardware, as it should be.
Anthropic’s S1 still shows them not even breaking even on revenue/expenses during what was probably their biggest year of adoption, right before people started going “oh, I can do this with an open model”
I’m not saying anything new here. What are we missing?
Perhaps the post title could use a tweak
We might not quite be there but we’re trucking towards that point at full speed.
I wonder how much the industry will centralize around a few key patterns, and if we'll start to see some RL framework projects gain traction and be used by the bigger labs
P.S. weights by November 4th
Not anymore, they switched to runc (but it can use any OCI compliant runtime)
Just whether those parts of the network see activations during trivial coding tasks (I’d have to assume they actually do sometimes, depending on the input prompt)
The really expensive part of inference - the compute and memory traffic required to perform prompt processing and decode - is paid for roughly once per token in a multi-turn session when prompt caching is working properly.
The difference to the provider's costs between:
- Submitting 100 back-to-back requests, each adding 1k tokens to the context
- Submitting 1 100k token context request
Is negligible. Yet the consumer is going to pay a lot more in the former case for all those repeatedly submitted input tokens that you get charged the cached rate for (but which required no additional compute on the provider side).
DeepSeek V4.1 has an insanely optimized KV-cache that takes around 900MB per million tokens, making it feasible to move to disk between requests. Makes sense they're cheap
I’ve already seen that trick snuck in by newer models. “I won’t use em-dashes; I’ll use semi-colons!”
I’ll absolutely be giving this a go once weights land (a QAT FP4 experts release would be most appreciated)
This is still a welcome model, even if I won't be running it at home
It's unsurprising and perhaps even desirable that different LLMs return similar results to an identical prompt.
If you want variation, prompt for it.
Using the output of a “decision” model without insight into the reasoning for a given decision seems very trusting.