News for hackers. Stuff that matters.
Re:Meta Llama 3 by reactordev on Thursday April 18, 2024 @06:12PM (#40081310)
Divide not multiply. If a size is estimated in 8-bit, reducing to 4-bit halves the size (and entropy of each value). Difference between INT_MAX and SHORT_MAX (assuming you have such defs).

I could be wrong too but that’s my understanding. Like float vs half-float.

There are no comments on this comment yet.