Maybe we shouldn't penalize articles that don't gain attention, but it should have a determined negative score in the back end, while displaying 0 or 1 to users on the front end. The initial score could be calculated somehow through the karma (or possibly comment karma average) of the submitter and length of time the submitter has been a member of HN.
When a newer, but established, user submits an article, it could need up to 15 upvotes before it actually starts gaining the user karma/points, for example. The score could then start to adjust to it's actual total as it becomes more active.
My only issue with actually penalizing articles that don't get attention is because some articles may be submitted a few times over the course of a day from different sources, yet the later submitted ones in what I have unscientifically observed seem to be the most active. The actual information in the article is completely relevant, but due to whatever probabilistic cause, they just don't get noticed. I don't think it's "right" to penalize a submitter because no one else was on the ball, so to speak.
Most people submit articles in some part because they receive karma points for interesting submissions. It's not just by magic that good articles "tend to find their way here."