That's worked pretty well e.g. for OpenBSD. Their code isn't perfect, but they've evaded lots of bullets simply by removing things they don't deem necessary.

I think I've evaded many bullets exactly the same way.

More code and more complexity -> more bugs, more holes. It's pretty simple.