This is exactly the problem/solution we're working on at https://www.sharehold.com :)

You're quite right that it is about striking that balance. We do it by keeping the app focused on recovery codes. From there, users can optionally assemble their own personal recovery team of trusted contacts.

Either way, users get the same universal account recovery experience for every one of their accounts on every service.