News for hackers. Stuff that matters.

A comment on How Is LLaMa.cpp Possible?. Parent comment

Re:How Is LLaMa.cpp Possible? by brucethemoose2 on Tuesday August 15, 2023 @10:54PM (#37142341)
8xA100 is technically a single server, but I think OP is talking about affordable and plentiful CPU hosts, or even relatively modest single GPU instances.

DGX boxes do not grow on trees, especially these days

[ Parent | on HN ]

There are no comments on this comment yet.