I think it depends entirely on your use case. If the user isn't storing a lot of info in your app then passwordless is the way to go.

Also, important to recognise that replacing a password with a different single factor does not enable passwordless as used by most enterprise companies. Passwordless implies two factor, with both factors not including a password.