Funny one of the very first things I tried when I got my hands on chatgpt was to play the game "zork" with me. I was initially floored by the fact it could recreate the game on the fly, seemingly accurate, but it fell off the rails relatively quickly.

I'm totally green when it comes to nlp,transformers, LLM training, etc, but I staunchly believe you can't produce real "reasoning" or consistent logic based on the predictions of byte pair encodings.