> Basically, the system will start convincingly BSing at any point and as a user, you're never sure if any particular detail it outputs is actually correct.

That almost sounds like it was trained on first level customer support chats/calls.