News for hackers. Stuff that matters.
Re:OpenAI's Stargate project struggling to get off the groun... by saubeidl on Tuesday May 13, 2025 @12:55PM (#43975039)
I think it's often been shown that constraints are what brings out true breakthroughs, so I'm skeptical of scaling up throw brute force - to me it seems like a lazy way out that will prevent you from challenging your base assumptions and figuring out better ways of doing things.
Re:OpenAI's Stargate project struggling to get off the groun... by Closi on Wednesday May 14, 2025 @07:56AM (#43983426)
I think there is a world where you have both - a portion of research sitting under constraints, and also massive computing capability to help build the next big model.

Put another way - I doubt OpenAI would have built GPT-3 faster if they had less compute.