My camera isn't pocketable, but if I'm doing photography such that I really care about the result, I bring it. If I'm not, I usually use the phone camera to document things I want to remember or show other people, and doing that slightly better is not very valuable to me.

I'll admit to occasionally contemplating a Ricoh GR III, which is quite pocketable.