News for hackers. Stuff that matters.
Re:Hyperscalers have already outspent most famous US megapro... by jiggawatts on Friday April 17, 2026 @11:11PM (#47812846)
> retain that capbibilty forever

Not really. The base training data cutoff will quickly render models useless as they fail to keep up with developments.

Translating some Farsi news articles about the war was hilarious, Gemini Pro got into a panic. ChatGPT either accused me of spreading fake news, or assumed this was some sort of fantasy scenario.

Re:Hyperscalers have already outspent most famous US megapro... by nl on Saturday April 18, 2026 @12:51AM (#47813233)
Not really.

For coding I care mostly about reasoning ability which is uncorrelated with cut off

Re:Hyperscalers have already outspent most famous US megapro... by m00x on Saturday April 18, 2026 @02:58AM (#47813740)
That's GPT4 thinking. New models use tools to look at current events or latest versions, and rely very little on weight knowledge.
Re:Hyperscalers have already outspent most famous US megapro... by zozbot234 on Saturday April 18, 2026 @03:06AM (#47813785)
You can pull new information into the context via RAG, but that is expensive and only gives very shallow understanding compared to retraining.
Re:Hyperscalers have already outspent most famous US megapro... by jeremyjh on Saturday April 18, 2026 @12:09PM (#47816996)
Karpathy - and others - consider the pre-training knowledge as much a liability as an asset. If we could just retain the emergent reasoning and language capability without the hazy recollections the models would likely be stronger.