News for hackers. Stuff that matters.
Re:Intel announces Arc B-series "Battlemage" discrete graphi... by ryao on Tuesday December 03, 2024 @11:14PM (#42314443)
No. I still have a long list of things to try doing with llama 3 (and possibly later llama 3.1) on more normal formats like fp32 and in the future, fp16. When I get things running on a GPU, I plan to try using bf16 and maybe fp8 if I get hardware that supports it. Low bit quantizations hurt model quality, so I am not very interested in them. Maybe that will change if good quality models trained to use them become available.

There are no comments on this comment yet.