Llama 3.1 in C - Hackdot

Re:Llama 3.1 in C by AMICABoard on Wednesday July 24, 2024 @04:07AM (#41054675)

Maybe we should make "Brain Damage Factor" a official term to denote how much types of quantizations degrade output compared to unquantized.:)

[ Parent | on HN ]

Re:Llama 3.1 in C by Y_Y on Wednesday July 24, 2024 @04:55AM (#41054977)

I think that's known as degradation, but I think the brain damage metric could be usefully applies to the poor sods who try to get the quantization to work in the first place.

[ Parent | on HN ]

Re:Llama 3.1 in C by AMICABoard on Wednesday July 24, 2024 @06:27AM (#41055493)

Lol :)

[ Parent | on HN ]