Re:Remote Prompt Injection in Gitlab Duo Leads to Source Cod...
by 33hsiidhkl on Monday May 26, 2025 @09:58AM
(#44097476)
It absolutely is deterministic, for any given seed value. Same seed = same output, every time, which is by definition deterministic.
[ Parent
| on HN ]
Re:Remote Prompt Injection in Gitlab Duo Leads to Source Cod...
by tough on Monday May 26, 2025 @04:49PM
(#44101545)
only if temperature is 0, but are they truly determinstic? I thought transformer based llm's where not
Re:Remote Prompt Injection in Gitlab Duo Leads to Source Cod...
by 33hsiidhkl on Monday May 26, 2025 @06:05PM
(#44102113)
temperature does not affect token prediction in the way you think. The seed value is still the seed value, before temperature calculations are performed. The randomness of an LLM is not related to its temperature. The seed value is what determines the output. For a specific seed value, say 42069, the LLM will always generate the same output, given the same input, given the same temperature.