Maybe for the next community, instead of making it public - potential users will instead have to find the site by solving a bunch of hidden puzzles. Think secret club.
Jokes aside: a major part of why HN works is that the community here self selects for several traits which ensure healthier communication.
As a forum becomes more mainstream, many things happen to attenuate the signal to noise ratio. (Pg had an excellent essay on the mid brow argument effect, which for many other forums is a problem they wish they had)
Eventually part of the crowd who came first realize it's not as useful anymore and decide to go somewhere else. The question is where.
We've seen eternal September come to almost every place and there's only a few traits which can help protect against it.
From my experience with many forums/modding, demographics are 80% of the issue, the remainder is topic of discussion, goal orientedness in discussion and moderator quality.
So the best solution is to create the forum and never advertise it. Let potential users figure out how to find it and how to get in.
Shrug, that just depends on where people choose to set their standards; there are much worse fora and much better ones. As I said, I still clearly find HN comments at least worth reading, but the distinction isn't as binary as you seem to think it is.
Funnily enough, right around the time I made an acct here (4+ years ago, after ~1 year of lurking), I saw an internal post by a well-known Googler talking about the recent drastic decline of HN comment quality and looking for a replacement. I still get value out of HN comments (clearly), but it's definitely changed substantially in the last few years, and not really for the better. I've resigned myself to every high-quality Internet community without heavy, opinionated moderation being a slow treadmill towards popularity and then mediocrity, or worse. Though this is of course something of a "you're not in traffic, you are traffic" problem.