News for hackers. Stuff that matters.

A comment on Benchmarks show even an old Nvidia RTX 3090 is enough to serve LLMs to thousands. Parent comment

Re:Benchmarks show even an old Nvidia RTX 3090 is enough to ... by atherton33 on Friday August 23, 2024 @08:03PM (#41334271)
From the article, it's not 12 total, but 12 per user for 100 concurrent generations.
[ Parent | on HN ]
Re:Benchmarks show even an old Nvidia RTX 3090 is enough to ... by metadat on Friday August 23, 2024 @08:05PM (#41334275)
Thank you atherton friend.
[ Parent | on HN ]