I think this was tried somewhat recently. The counter-argument was "actually let's not impeach. Let's just wait for the next election and see what the voters think. Voting is the real impeachment."