You don't need to know the answer, just be able to recognize it. There are many situations where you can judge the output a lot easier than you can produce it, and LLMs are quite useful for those.