News for hackers. Stuff that matters.
Re:Microsoft introduces its own chips for AI, with eye on cost by nl on Wednesday November 15, 2023 @10:32PM (#38285583)
Yeah no one really cares about this for large models. Iteration speed matters, and no one is waiting 50 times as long to train a LLM.

Intel has always published the "training per dollar" because no one else competes.

Even for fine tuning you are almost always better off getting smaller GPU cloud instances.

There are no comments on this comment yet.