Does HN really drive enough traffic to a (relatively recently submitted) site to bring it down? Or is this a sign of poor scaling?

It drives enough traffic to kill a general web app. If you've just launched and have something like Rails / Django running on a single app server, it really doesn't that much to overload it. Wordpress seems to not handle it well either (unless you're caching).