News for hackers. Stuff that matters.

A comment on Facebook LLAMA is being openly distributed via torrents. Parent comment

Re:Facebook LLAMA is being openly distributed via torrents by nodja on Friday March 03, 2023 @08:27AM (#35009279)
15k is the price to buy a GPU, not to run it, you'd have to account for electricity costs which isn't so straight forward.
[ Parent | on HN ]
Re:Facebook LLAMA is being openly distributed via torrents by ithkuil on Friday March 03, 2023 @08:32AM (#35009339)
The point was that if you only need to train once, then it's cheaper to rent the GPUs than to buy them. If you need to train it multiple times, then the cost of buying the GPUs is amortized among runs.

In any case the cost per run is going to be lower than 30m

[ Parent | on HN ]
Re:Facebook LLAMA is being openly distributed via torrents by iszomer on Friday March 03, 2023 @08:42AM (#35009486)
I'm sure that's the case. The latest sku I'm responsible for QC testing now contains 4x A100's in a 2U chassis. And oh man the number of QSFP ports it utilizes..
[ Parent | on HN ]