News for hackers. Stuff that matters.
Re:Two things LLM coding agents are still bad at by IanCal on Thursday October 09, 2025 @11:23AM (#45528980)
Intelligence isn't the same as "can exactly replicate text". I'm hopefully smarter than a calculator but it's more reliable at maths than me.

Also there's a huge gulf between "some people claim it can do X" and "it's useful". Altman promising something new doesn't decrease the usefulness of a model.

Re:Two things LLM coding agents are still bad at by mbesto on Thursday October 09, 2025 @11:33AM (#45529152)
What you are describing is "dead reasoning zones".[0]

    "This isn't how humans work. Einstein never saw ARC grids, but he'd solve them instantly. Not because of prior knowledge, but because humans have consistent reasoning that transfers across domains. A logical economist becomes a logical programmer when they learn to code. They don't suddenly forget how to be consistent or deduce.

    But LLMs have "dead reasoning zones" — areas in their weights where logic doesn't work. Humans have dead knowledge zones (things we don't know), but not dead reasoning zones. Asking questions outside the training distribution is almost like an adversarial attack on the model."

https://jeremyberman.substack.com/p/how-i-got-the-highest-sc...
Re:Two things LLM coding agents are still bad at by hitarpetar on Thursday October 09, 2025 @11:39AM (#45529239)
saddest goalpost ever