News for hackers. Stuff that matters.
Re:New LLM optimization technique slashes memory costs up to... by mvkel on Monday December 16, 2024 @11:28PM (#42438341)
You have it flipped. But it's both.

AI compute is measured in gigawatts, not gigaflops.

It's "how any gigawatts of compute can we get allocated?"

Not

"How much compute can we fit inside of a gigawatt?"

There's no such thing as "enough"

There are no comments on this comment yet.