[Me] I want to make a bouquet to honor the home country of the first person to isolate Molybdenum. Be brief.

[ChatGPT-4] To honor Peter Jacob Hjelm, the Swedish chemist who first isolated Molybdenum in 1781, create a bouquet using blue and yellow flowers, representing the colors of the Swedish flag. Some suggestions are blue irises, yellow tulips, and blue delphiniums, arranged with green foliage for contrast.

I didn’t know the answer to that before asking. I also checked that it’s right. Soemtimes it’s right, sometimes it’s wrong. But if I walk up to a horse and ask it to stamp eight times, that’s going to happen approximately never. If I get it stamping at all, then maybe 1/20. This is much better than that.

Even a child raised by wolves gets training.

Meanwhile, the creators at OpenAI claims that it is not.

How do we test your claim? What are the logical reasoning questions we can ask GPT-4 that it shouldn't be able to answer if it's just a stochastic parrot?

I keep asking people this, but so far no one has answered. Is the claim a personal belief that you don't want to discuss, similar to your religious beliefs?

If so, fine, but please make it clear that you're not making a scientific claim.

There is a difference between solving and problem and presenting a solution, and that difference doesn't hinge on whether the solution is correct.

Ask it to write the same program in some little known programming language. A human who knows how to code could do that by studying a small amount of reference material.

That depends on the language, the human, and their state of mind.

I have a python script that's maybe 200 lines long, calling out to OpenAI using gpt3.5 turbo. I can give it commands like "search for the news today, summarize then save into news.txt" -> and it emits the DSL I asked it to use in the 1 shot prompt.

You can give it complex word problems and it'll write python programs to solve them. You can ask it to get top hacker news stories, and it'll find creative ways to fetch them.