News for hackers. Stuff that matters.

A comment on Nvidia Nemotron 3 Family of Models. Parent comment

Re:Nvidia Nemotron 3 Family of Models by genpfault on Thursday December 18, 2025 @12:56AM (#46309334)
Getting ~150 tok/s on an empty context with a 24 GB 7900XTX via llama.cpp's Vukan backend.
[ Parent | on HN ]
Re:Nvidia Nemotron 3 Family of Models by Tepix on Saturday December 20, 2025 @04:29AM (#46334777)
Again, you're using some 3rd party quantisations, not the weights supplied by Nvidia (which don't fit in 24GB).
[ Parent | on HN ]