There is a huge difference between a human saying they like ice cream and an LLM saying they like ice cream, but that seems to get completely disregarded in these types of discussions. Which leads to people making very wild declarations that we are close to AGI or solving consciousness.