News for hackers. Stuff that matters.
Re:After 118 days, GPT Unicorn has produced a unicorn by bhouston on Thursday August 10, 2023 @08:23AM (#37075290)
I agree that trying to determine the distribution of these drawings is hard because it isn't a simple floating point number in its current form.

But maybe you could covert it to a linear monotonic measure?

You could pass it to an image recognition model and see record the degree to which it thinks it is an:

animal horse unicorn

Basically if it fails to be a unicorn, see if it is a horse and if it fails to be a horse check if it is an animal. This gives you some type of linear measure if you place these three measures along the same axis adjacently. Then you can transform each image to a floating point number and then characterize the distribution.

Re:After 118 days, GPT Unicorn has produced a unicorn by itsoktocry on Thursday August 10, 2023 @08:59AM (#37075595)
>You could pass it to an image recognition model and see record the degree to which it thinks it is...

We don't care what another algorithm "thinks". We want to see if what it draws is humanly interpretable as a unicorn.

Re:After 118 days, GPT Unicorn has produced a unicorn by bhouston on Thursday August 10, 2023 @09:14AM (#37075738)
Then you could use mechanical turk to have them rate each image to figure out how close it is to a Unicorn...
Re:After 118 days, GPT Unicorn has produced a unicorn by butler14 on Thursday August 10, 2023 @09:59AM (#37076250)
Mechanical turk 'workers' use ChatGPT
Re:After 118 days, GPT Unicorn has produced a unicorn by imdsm on Thursday August 10, 2023 @10:02AM (#37076280)
We could but this is also a fun project, which is why when I checked it today I was surprised that what I saw was not a turd with eyes (2023-05-18) nor a strange sea creature (2023-07-08) but something which, for the first time I think, actually resembled a unicorn.

I appreciate all the comments around determinism, sampling, scientific method, but as I said when I posted this just after building, it really is just for fun and to see, over time, if the general mish mash of outputs become more refined without any changes to the prompt (which doesn't aid it through CoT/ToT or improving on previous attempts etc.)

Re:After 118 days, GPT Unicorn has produced a unicorn by civilitty on Thursday August 10, 2023 @10:56AM (#37076952)
You don’t have to justify yourself to the HN peanut gallery :-)
Re:After 118 days, GPT Unicorn has produced a unicorn by ActivePattern on Thursday August 10, 2023 @09:59AM (#37076247)
Then simply train the model to predict whether a human can interpret it as a unicorn.