Does an LLM need to “know” what a fact is? I think what you’re asserting is mostly philosophical, and it doesn’t affect the end result which is that you demonstrably can provide certain LLMs with incorrect information and have that information corrected.