News for hackers. Stuff that matters.

A comment on Deploying Llama3 70B on AWS – GPU Requirement, Cost and Step-by-Step Guide. Parent comment

Re:Deploying Llama3 70B on AWS – GPU Requirement, Cost and S... by JJneid on Thursday June 13, 2024 @09:05PM (#40676565)
usually performance takes a hit with quantization. are you getting quality responses?
[ Parent | on HN ]
Re:Deploying Llama3 70B on AWS – GPU Requirement, Cost and S... by rini17 on Friday June 14, 2024 @04:04AM (#40678682)
Since llama3, yes, quite satisfying.
[ Parent | on HN ]