News for hackers. Stuff that matters.
Re:Meta Llama 3 by llm_trw on Friday April 19, 2024 @07:42AM (#40085566)
Yes, but the amount they have invested into training llama3 even if you include all the hardware is in the low tens of millions. There are a _lot_ of companies who can afford that.

Hell there are not for profits that can afford that.

Re:Meta Llama 3 by sebzim4500 on Friday April 19, 2024 @12:05PM (#40088517)
Where are you getting that number? I find it hard to believe that can be true, especially if you include the cost of training the 400B model and the salaries of the engineers writing/maintaining the training code.