Contrary to some other advice here, I switched to a new window manager first (xmonad, FWIW), but kept running a bunch of GNOME stuff too. Gradually, I have phased out most of GNOME and my computing life is simpler and more stable as a result.