My point is that there are already mathematical proofs in the literature that show that LLMs literally are doing algorithmic reasoning.
This has been proven by category theory, in the area of GNNs (for which transformers are a trivial subset).
Sorry if I'm going over too much basics, as this is obvious and well understood by anyone actually in the field, to the point of being excessively boring.
What does that possibly have to do with GPT-4 shitting the bed if you draw the logic puzzle out of a deck of cards instead of cherry-picking and hinting it?