News for hackers. Stuff that matters.

A comment on Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousands. Parent comment

Re:Benchmarks show even an old Nvidia RTX 3090 is enough to ... by kristoo on Monday August 26, 2024 @05:46AM (#41355513)
The benchmark result is for 100 concurrent users
[ Parent | on HN ]

There are no comments on this comment yet.