Sounds good in theory, but login-links are a security issue, because they:

  show up in browser history
  can be pasted accidentally somewhere
  are send usually unencrypted via email

You'll need one-time login links, which is partly okay, partly inconvenient.

Don't get me wrong, I play with the idea of login-links as well, but they have some drawbacks that one should at least be aware of.