I believe GPT-4 is able to perform some level of logical reasoning.

Simpler models look very good on the surface, but there are some examples where this starts to break own. Example:

"Is it legal for a man to marry his widow's sister?"

The catch here is the man is dead, which is the reason he can't marry. GPT-4 gets this right. Simpler models however can be prompted to perform step-by-step reasoning where they figure out that dead men can't marry, and that a "man's widow" means he's dead, but the model still can't be coaxed into figuring out that he can't marry in the scenario above.

I'm guessing GPT-4 still has similar hangups where it gets stuck and can't get out no matter the coaxing, although I don't have any examples handy. Anyone?

This doesn't mean GPT-4 is a stochastic parrot, just that there are still flaws in its reasoning abilities.