LLMs only have agency at most in the sense that a dog which has been trained and bred specifically to herd sheep does.