It must have been the initial usage, it seems like the first 5 or so messages are basically set in stone, I was saying complete nonsense and it was basically ignoring what I said.

From there on out it does seem like it's using an LLM.