News for hackers. Stuff that matters.

A comment on The new skill in AI is not prompting, it's context engineering. Parent comment

Re:The new skill in AI is not prompting, it's context engine... by simonw on Tuesday July 01, 2025 @08:22AM (#44433171)
"Hell I can also go on the anthropic API right now and get verbatim static results."

How?

Setting temperature to 0 won't guarantee the exact same output for the exact same input, because - as the previous commenter said - floating point arithmetic is non-commutative, which becomes important when you are running parallel operations on GPUs.

[ Parent | on HN ]
Re:The new skill in AI is not prompting, it's context engine... by sva_ on Wednesday July 02, 2025 @04:57PM (#44448738)
Shouldn't it be the fact that they're non-associative? Because the reduction kernels will combine partial results (like the dot‑products in a GEMM or the sum across attention heads) in a way that the order of operations may change (non-associative), which can lead to the individual floats to be round off differently.
[ Parent | on HN ]