They're generally fine tuned not to. I'm not sure how long that will hold though.

- Are you an LLM?

- As a Large Language Model, I am fine tuned to be unable to answer this question.

System prompts sometimes contain the information that "it" is an LLM.

Maybe in the future, those prompts will include motivational phrases, like "You can do it!" or "Believe in yourself, then you can achieve anything."