Even with all those points, you would in most cases end up with more assets renting something equivalent and dumping your down payment and mortgage in the SP500.

Again, the main advantage of a mortgage is that it forces you to save. If you are disciplined enough to save and invest in the SP500, you are way better off doing that.