News for hackers. Stuff that matters.
Re:I Run LLMs Locally by natch on Saturday January 11, 2025 @01:08PM (#42667724)
Thanks for the reply. Is that quantized? And what's the bit size of the floating point values in that model (apologies if I'm not asking the question correctly).

There are no comments on this comment yet.