Using email login links instead of passwords doesn't seem especially worse wrt. security than "industry standards".
As for the other stuff (DNS, outage), it is a much bigger deal to loose these than an account at a 'nice to have' social website.
But this coupled with two factor authentication to recognise new computers is a nice idea.
If my webserver or worse, my domain, ends up on a spam blacklist, either due to moronic/malicious users flagging my mails as spam or due to automatic triggering running amok, then I have no way of ever getting my sign-in working again except of praying that the blacklist manager(s) will unblock me. Which rarely happens.
This is the perspective of the service provider. From the user POV, if their domain gets blacklisted, they can still receive emails, and therefore can still login as usual.
Imagine e.g. problems with your DNS (self-hosted and you forgot to renew the domain), outages of your mail provider, or the worst case (for the service provider): your outbound mail server is placed on a blacklist.
This way your entire user management system goes up in smoke without ANY way for you to fix it!