The main difference is your mortgage was likely acquired long before the value reached that level.

The choice was never between renting and buying a $1m home for a $500/mo difference.