News for hackers. Stuff that matters.
Re:Running a 180B parameter LLM on a single Apple M2 Ultra by AnthonyMouse on Thursday September 07, 2023 @06:21PM (#37426416)
I suspect this was the goal of some of the people inside the company but imposing some nominal terms on it was the price of getting it through the bureaucracy, or maybe required by some agreement related to some mostly irrelevant but actually present subset of the original model.

Then the inevitable occurred and made it obvious that the restrictions were both impractical to enforce and counterproductive, so they released a new one with less of them.

There are no comments on this comment yet.