Idiocracy ignores what happens at the other end of the intelligence scale. Being 4 standard deviations above the norm may be detrimental, but being 4 standard deviations below the norm is a much larger hindrance.

On top of this the ratios change as the environment changes. Studies after WWII found a positive correlation between reproduction and intelligence though that seems to have swapped more recently.