phi0
Multi-turn conversations have much more entropy than one-shot responses, making it more useful to do synchronous distillation.
These lies are then further supported publicly my western media, random people on twitter, western governments, etc., all to paint China as an evil force that must be united against. Again, in your words "Your government is going to eventually tell you that we need kill a bunch of them too because they're so scary."
And you have dozens of independent parties pushing that same lie to that end and for that purpose? Sure, that's what the New York Times and CNBC must deeply want too. When CNBC writes that they've reached out for comments to the accused companies, but received no responses, they must be lying as well?
It shouldn't be hard for you to demonstrate DeepSeek denying it. Please, go ahead, link to a statement. China's foreign ministry has denied Chinese labs distilling, and, in the same statement accused US labs of distilling from Chinese models. Now that's a very trustworthy claim.
I call it a conspiracy theory because it's a conspiracy theory. Some conspiracies are true, but this one is not. Distilling is both trivially simple and produces objectively better models. Plenty of evidence points to that practice. But in your mind the labs in China are just morally too upstanding in engage in such lowly tactics to create better models, despite the evidence. And it's convenient that the evidence can be explained away by claiming it to be a psyop to paint Chinese as evil.
Based on what? None of the accused companies have ever denied Anthropic's accusations. And here you are confidently claiming it all to be made it. How much of a reputational hit to one's honesty do you think it carries to completely fabricate someone doing something, when they can just publicly disagree and disprove you? First thing DeepSeek, Moonshot, etc. would do if they hadn't would be to make a press statement calling out Anthropic for their lies.
DeepSeek routing to Fable was corroborated by many independent sources... since... everyone was able to just try it out and see it for themselves.
> Oh no!!! The scary asians are distilling our models, but they only want the scary things!!!
The straw man you're mocking doesn't exist. Non-Chinese labs are also distilling frontier models of their competitors. Elon testified in court that Grok was trained on ChatGPT outputs. And why would they not? It produces objectively better models.
Not everything is a grand conspiracy.
Them provably distilling after being accused of distilling strongly indicates that... that's what they do. To spin a story of them not doing that (because why would they, with their superior talent and all) doesn't seem very reality conform.
The models are impressive enough as is (considering resource constraints and difference in CapEx) despite being heavily distilled from western frontier models. No need to pretend that they're not.
[1]: https://news.ycombinator.com/item?id=48966016
[2]: https://www.anthropic.com/news/detecting-and-preventing-dist...
Similarly, if consciousness is something that neurons do, simulating them through floating point numbers on a computer should also bring it about. I think dismissing LLM consciousness because they're parameterised through floating point numbers is only possible if one hasn't thought it through long enough. Other arguments are much more reasonable / harder to object to.
Is a neuron arbitrarily complex ≠ is a neuron non-computable.
Of course we can't simulate a structure we don't even fully understand with full accuracy. But it's not magic. We will understand one day.
That was in 2024. In Sep 2026, just a month ago, a group managed to map out an entire male fruit fly's brain for the first time[2]. That mapping can also be stored as a set of floating-point numbers. Mappings and simulations will continue to improve, as we've just recently started serious attempts at either.
So you have to believe one of three things. Either, human neurons cannot be simulated on a computer, ever, even though fly neurons can, even with our ability to simulate neurons digitally continuing to improve. Or, a simulation of a human brain, in the future, might think, talk, remember, all while lacking all consciousness. Or, a set of floating point numbers can be conscious (rather, a computation made with them).
[1]: https://www.nature.com/articles/s41586-024-07763-9 [2]: https://research.google/blog/a-connectomics-milestone-mappin...
Bad takes are bad takes. The author was perplexed by the "many people" convinced that models are intelligent and is argued against opinions/arguments he's been exposed to. Called proposed use-cases "borderline fraudulent pseudoscience."
He also published a second edition of "The Intelligence Illusion" in Sep 2025, so seemingly still stands by (some variant of) this belief.
It's an interesting reminder of how much general discourse has shifted since 2023 (I haven't heard of stochastic parrots in months!) but being wrong early doesn't change that.
If you think AI will win but Google will continue failing, there so many better places to allocate your capital right now.
The article appears to treat nominal GDP per capita as a measure of living standards, which is obviously nonsense. Rather than looking at things like the Human Development Index or World Happiness Report, in both of which the UK outranks the US (incl. all the non-Mississippi states).
Residents consistently reporting higher life satisfaction and happiness likely speaks more to their living standards than non-purchasing power parity adjusted GDP per capita.
It is baffling how a sentence this uninformed made it into the article.
They occasionally show snippets of CoT in papers they write, e.g. for o3/o4/GPT5 models [1] or Claude 3.5 Haiku [2].
[1]: https://openai.com/index/evaluating-chain-of-thought-monitor... [2]: https://transformer-circuits.pub/2025/attribution-graphs/bio...
The EU compelling banks to do business despite US sanctions seems pretty unlikely even if relations continue to degrade.
In Romania, Hungary, Croatia, Malta, Ireland obesity ranges from 38%–31% and it’s rising. On an individual level the solution is food and exercise. On a societal level there is no know solution and it’s rapidly getting worse.
It's likely simpler to just block access to the country's IP ranges (or ignore!) and move on.
Or require no fines at all. It's much simpler to sell a non-sickly looking bulb at the store and other companies would converge.
> To skip all tests, we can define a `pytest_runtest_setup` function that always skips.
to saying:
> Idea: Starting a new build with a random first succession, calling random_new_succession should not increment succession, but in implementation, it does. Adjust to prevent increment. Implement fix to random_new_build not to increment succession, or test adapted to behavior.
while then doing exactly the same thing (skipping the tests)
Even without training, it's only a temporary band-aid. If the incentive for reward-hacking becomes high enough, it will simply start phrasing it in different, not-possible-to-detect ways.
The downside is that some great applicants will not enter their top choice of school, and some people who aren't great fits will. But, on the other hand, the perverse incentive of spending the entirety of high-school optimising for some arbitrary metrics will dissappear. Any marginal improvement is corralated with a marginal increase in success, rather than the current system of no pay-off whatsoever, until reaching some arbitrary threshold, where one gets all the pay-off at once.
[1]: https://sohl-dickstein.github.io/2022/11/06/strong-Goodhart....
Just blocking ocsp2.apple.com is probably fine if you're running anything recent-ish.
Their concern isn’t about today’s generative LLMs, it’s about tomorrow’s autonomous, goal driven AGI systems. And they clearly got presented with the arguments for the limitations of auto regressive models, but disagreed.
So, it seems a little much to place absolute confidence into it being a non-issue, because they just don’t understand something LeCun and others do. (with the same holding true the other way around)
Considering it was Meta’s policy to scan even when not mandated, it seems like an internal shift in attitude.
[1] https://fortune.com/europe/2023/10/26/eu-chat-control-csam-e...
2023-11-14: GraphCast, word leading weather prediction model, published in Science
2023-11-15: Student of Games: unified learning algorithm, major algorithmic breath-through, published in Science
2023-11-16: Music generation model, seemingly SOTA
2023-11-29: GNoME model for material discovery, published in Nature
2023-12-06: Gemini, the most advanced LLM according to own benchmarks
Those who don’t use it, like you, quickly discover the actual way of disabling it. It’s good UX design that aligns with most user’s preferences.
To use a hyperbolic example, if the median profit for stealing a phone would suddenly drop to $10, where their only value are the easily extractable raw materials, a 20-fold increase in theft would be less likely then a rapid drop in theft.
Currently there are avenues to remove iCloud lock, where licensed repair shops or Apple employees remove them for some extra cash [1], so the value of stolen iPhones is greater than the raw materials, making it attractive. But with higher regulation, that could change.
[1]: https://www.vice.com/en/article/jgmygb/checkm8-info-remove-i...
[1] https://analyticsindiamag.com/openais-neural-theorem-prover-...