News for hackers. Stuff that matters.
Re:Mistral Large 4 by scotty79 on Tuesday October 06, 2026 @11:47AM (#49980259)
I'm afraid it might be the other way around. RSI might pick all of the low hanging fruit soon. There must be a physical limit of how much intelligence you can squeeze out of some amount of parameters and compute.

There are going to still be worthwhile improvements but they are going to be more like not how to make transformers 10x cheaper but how to make next training run cost 9 trillions instead of 10 with a very particular optimization designed at the cost of hundreds of millions for this one specific run.

Re:Mistral Large 4 by LPisGood on Tuesday October 06, 2026 @12:01PM (#49980450)
I think we’re no where near a physical information theoretic limit.
Re:Mistral Large 4 by thfuran on Tuesday October 06, 2026 @12:52PM (#49981066)
The hardware also is, so there ought to be a whole lot more room for improvement.
Re:Mistral Large 4 by ejeje12a on Tuesday October 06, 2026 @12:02PM (#49980467)
“ RSI might pick all of the low hanging fruit soon”

Scam Altman is that you?

Re:Mistral Large 4 by bee_rider on Tuesday October 06, 2026 @01:41PM (#49981696)
It is just occurring to me that “RSI” expands to recursive self improvement. Thought people were talking about repetitive stress injuries; either in regards to programmers writing too much code/not having to write code anymore, or the frontier AI companies and their tendency to applaud themselves.