I think you might not be getting the bigger picture. LLMs might look irrational but so do humans. Give it a long term memory and a body and it will be capable of passing as a sentient being. It looks clumsy now but it won't in 50 years.