Re:Nvidia Nemotron 3 Family of Models
by agentastic on Tuesday December 16, 2025 @07:49PM
(#46296851)
They need to compile the model for their chips. Standard transformers are easier, so GPT-OSS, Qwen, GLM, etc if there is demand, they will deploy it.
Nemotron on the other hand is a hybrid (Transformer + Mamba-2) so it will be more challenging to compile it on Cerebras/Groq chips.
(Me thinks Nvidia is purposefully picking architecture+FP4 that is easy to ship on Nvidia chips, but harder for TPU or Cerebras/Groq to deploy)
[1] https://inference-docs.cerebras.ai/models/overview