News for hackers. Stuff that matters.
Re:Understanding LLM Compute Requirements by brucethemoose2 on Sunday May 28, 2023 @08:37PM (#36109283)
Inference is not that flop intense for modern IGPs... the bigger issue is the sheer memory requirements.

Training requires a ridiculous amount of both, but again the raw compute requirements would be much lower with huge memory pools.

There are no comments on this comment yet.