Because GPT doesn't "know" what you're asking it to do. If you want it to be able to call out to a chess engine when you ask it "Solve this chess problem" then we're back in the old world of grammars and trying to parse sentence structure.