The buyers go away, as do the sellers. The housing market is essentially on chemotherapy at the moment. Higher rates will decrease investor participation on the buy-side, though, and that's good for middle-class homebuyers.