It seems worth a try, but we don't know how LLM's work (research in "mechanistic interpretability" is just getting started), and they tend to "cheat" whenever they can get an advantage that way.