News for hackers. Stuff that matters.

A comment on The art of programming and why I won't use LLM. Parent comment

Re:The art of programming and why I won't use LLM by marcinzm on Sunday August 25, 2024 @02:39PM (#41349980)
LLMs are deterministic if you force a seed or disable sampling. They however do not guarantee that small input changes will cause small output changes.
[ Parent | on HN ]
Re:The art of programming and why I won't use LLM by Jensson on Sunday August 25, 2024 @04:01PM (#41350780)
> LLMs are deterministic if you force a seed or disable sampling

Not with todays GPU's, you would need to run it locally with special GPU settings or run it on your CPU to ensure it is deterministic.

[ Parent | on HN ]