News for hackers. Stuff that matters.

A comment on Deploying Llama3 70B on AWS – GPU Requirement, Cost and Step-by-Step Guide. Parent comment

Re:Deploying Llama3 70B on AWS – GPU Requirement, Cost and S... by JJneid on Thursday June 13, 2024 @09:02PM (#40676549)
Is inference speed an issue for you?
[ Parent | on HN ]
Re:Deploying Llama3 70B on AWS – GPU Requirement, Cost and S... by rini17 on Friday June 14, 2024 @04:05AM (#40678689)
Sufficient for fluent conversation.
[ Parent | on HN ]