Interesting that it contradicted itself by saying bats have paws and don’t have paws, but arrived at the correct conclusion anyway.

"A broken clock is right twice per day" as the saying goes.

That aphorism doesn’t apply here.

What is meant by that saying is, “well the first time we ran the machine it worked just fine, so we got all excited, but then it consistently failed after that”, with the lesson being, increase your sample size before you pass judgement.

LLMs almost suffer from the opposite. Because they are correct so often the danger is in assuming the response is always correct.

Maybe, “even a Swiss made watch needs to be checked against the town bells”?

Ya, it doesn't really struggle with the examples in this article to the point it feels like it invalidates the article.