Re:AMD acquires Taalas to boost inference performance by etc...
by logicallee on Friday August 07, 2026 @06:48AM
(#49208432)
Could the model or algorithm be changed to make it deterministic somehow? It could help a lot if there were reproduceable outputs from deterministic baked-in silicon.
[ Parent
| on HN ]
Re:AMD acquires Taalas to boost inference performance by etc...
by Tuna-Fish on Friday August 07, 2026 @09:03AM
(#49209791)
You can make any LLM deterministic by dropping the temperature hyperparameter to zero.
This will generally make them suck, though, a little bit of randomness is necessary for proper function.