So should journalists simply never agree to have conversations off the record?

I think there are big problems with the way access and coverage are mixed up together and traded on, but I'm pretty comfortable with a journalist agreeing not to publish remarks made during a conversation and then later asking to publish some of them.