News for hackers. Stuff that matters.
Re:Running a 180B parameter LLM on a single Apple M2 Ultra by lambda_garden on Thursday September 07, 2023 @04:00PM (#37424763)
> LLaMA, with up to 65B params, opened against Meta's wishes

They sure didn't try very hard to secure it. I wonder if it was their strategy all along.

Re:Running a 180B parameter LLM on a single Apple M2 Ultra by AnthonyMouse on Thursday September 07, 2023 @06:21PM (#37426416)
I suspect this was the goal of some of the people inside the company but imposing some nominal terms on it was the price of getting it through the bureaucracy, or maybe required by some agreement related to some mostly irrelevant but actually present subset of the original model.

Then the inevitable occurred and made it obvious that the restrictions were both impractical to enforce and counterproductive, so they released a new one with less of them.