How can Doom get in your way, when you can simply remove entire modules and/or specific packages with ease? And even if I keep those packages, I can simply change anything I want by just putting the setting in my init with "use-package!"?

I never had this problem, I have been using Doom for two years, and Emacs without Doom for years before that.