Because most people have no idea what covers are, and unless you collect postage stamps the difference means nothing to you. If you'd asked me before I met a friend who collects, I would have assumed that using a stamp would render it worthless.

The article's talk page actually has a similar discussion over whether to call them stamps or covers in the title, so although they come down on your side its hardly a given.