News for hackers. Stuff that matters.

A comment on After 118 days, GPT Unicorn has produced a unicorn. Parent comment

Re:After 118 days, GPT Unicorn has produced a unicorn by noduerme on Thursday August 10, 2023 @09:10AM (#37075702)
>> if we control the seed we can 100% reproduce the same result

No, that's the problem. You can't. You should be able to, but you can't. If you could, they wouldn't be scary. But we have Temperature Zero, different results. Because no one gave enough of a shit when coding them, and no one gives enough of a shit to try to fix the issue.

This is what in any other industry would be called gross negligence.

[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by jquery on Thursday August 10, 2023 @09:35AM (#37075978)
* * *
[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by noduerme on Saturday August 12, 2023 @05:47AM (#37098575)
Interesting article. I can see how it makes sense for OpenAI or someone with a LLM to take advantage of any entropy that presented itself, as a shortcut to non-repetitive answers. I'm not sure if you're saying that these LLMs take on new characteristics as they get more randomized? Or just that it would be hard to get your hands on a fresh one to test the determinism of?
[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by olabyne on Friday August 11, 2023 @06:47AM (#37087196)
That's a OpenAi problem, not a LLM problem
[ Parent | on HN ]