News for hackers. Stuff that matters.
Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by sgt101 on Friday April 14, 2023 @12:44PM (#35571593)
10^16 -> 10^24 flops isn't 100x, it's 100,000,000x

This happened in 10 years (training cost of largest model according to the batshit crazy god AI article in the FT).

On the one hand compute power increased by about 100x and then some lunatics came and spent 10000x on it...

Re:Choose Your Weapon: Survival Strategies for Depressed AI ... by jimsimmons on Friday April 14, 2023 @04:58PM (#35574662)
A lot of it is also backlog: modern GPUs are optimised for these workloads in a way old models weren’t