Part of our checklist for new features/services is enumerating what needs to be monitored and how, what instrumentation we should care about, etc.

That may well change during development, but new work doesn't get approved without at least a first stab at how we're going to monitor it.