News for hackers. Stuff that matters.
Re:Three Observations by bambax on Sunday February 09, 2025 @04:47PM (#42994398)
The only true part is 2.

1 is plainly false. Enormous ressources have been poured into models since the end 2023 and the "intelligence" (for lack of a better term) has stayed roughly the same, around the level of GPT-4. Nothing has happened since then.

3 is a philosophical opinion, not based on any falsifiable evidence.

All in all: mostly FUD, as per the usual MO.

Re:Three Observations by uluyol on Sunday February 09, 2025 @05:04PM (#42994549)
How is 1 false? Log improvement means for 10x the cost the model is 2x as good. For 100x the cost, the model is 3x as good.

Not a curve to be happy about TBH. You need to simultaneously find big efficiency wins and drive up costs substantially to get 4-5x improvements, and it is probably impossible to maintain good year on year improvements after the first 2-3 years when you get all the low hanging fruit.

Re:Three Observations by CamperBob2 on Sunday February 09, 2025 @09:35PM (#42996340)
1 is plainly false. Enormous ressources have been poured into models since the end 2023 and the "intelligence" (for lack of a better term) has stayed roughly the same, around the level of GPT-4. Nothing has happened since then.

You need to spend some quality time with o1-pro and/or Gemini Pro 2.0 Experimental. It is not the case that there has been no progress since GPT4. CoT reasoning is a BFD.

Re:Three Observations by bdangubic on Sunday February 09, 2025 @09:39PM (#42996365)
1 is plainly false. Enormous ressources have been poured into models since the end 2023 and the "intelligence" (for lack of a better term) has stayed roughly the same, around the level of GPT-4. Nothing has happened since then.

this would be true only for people who have used the same model since 2023 :) Jesus!