News for hackers. Stuff that matters.

A comment on Llama 3.1 Official Launch. Parent comment

Re:Llama 3.1 Official Launch by loudmax on Tuesday July 23, 2024 @11:46AM (#41047283)
If you want to run the 405B model without spending thousands of dollars on dedicated hardware, you rent compute from a datacenter. Meta lists AWS, Google and Microsoft among others as cloud partners.

But also check out the 8B and 70B Llama-3.1 models which show improved benchmarks over the Llama-3 models released in April.

[ Parent | on HN ]
Re:Llama 3.1 Official Launch by TechDebtDevin on Tuesday July 23, 2024 @03:42PM (#41049973)
For sure, I don't really have a need to self host the 405b anyways. But if I did want to rent that compute we're talking $5+ /hr so you'd need to have a really good reason.
[ Parent | on HN ]