News for hackers. Stuff that matters.

A comment on After 118 days, GPT Unicorn has produced a unicorn. Parent comment

Re:After 118 days, GPT Unicorn has produced a unicorn by calderknight on Thursday August 10, 2023 @06:42AM (#37074358)
It takes a picture from GPT every day, so we'll be able to see if this was a fluke by looking at future days' outputs. I think it will work to track changes in the model.
[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by bhouston on Thursday August 10, 2023 @06:59AM (#37074465)
Yes, this makes sense. You are agreeing with me. In order to see if it is just a fluke or not, you need a lot of samples so you can characterize the distribution yourself and try to see if it changed.
[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by calderknight on Thursday August 10, 2023 @08:25AM (#37075305)
OK but I'm still not seeing any logic error.
[ Parent | on HN ]
Re:After 118 days, GPT Unicorn has produced a unicorn by bhouston on Thursday August 10, 2023 @08:53AM (#37075536)
That a single sample per day can track changes meaningfully when the noise floor is above the signal strength. And also the fact that today's unicorn-ish sample is meaningful at all.

It is a fun experiment though.

[ Parent | on HN ]