I think the simple approach of raising the threshold works pretty well. Spend time improving the metric used by the threshold -- make that part smart. Think about how the reddit home page works, where there's a similar problem: too many good links.