News for hackers. Stuff that matters.
Re:The LLama Effect: Leak Sparked a Series of Open Source Al... by muyuu on Monday April 10, 2023 @09:42AM (#35512171)
You cannot heavily quantise models and assume they didn't degrade significantly.

To run it properly you need a lot more than a Mac Studio, and then comparisons need to be done more or less seriously, not just a few random prompts, because anything in a black box will "cheat" and will be fine tuned to do well at popular benchmarks.

There are no comments on this comment yet.