It doesn't have to be that way. Its entirely feasible to make a microsd card with a better controller and some ram buffer for fast wear leveling. The best we see today is some mild tuning for IO in A1 and A2 cards.

You have to remember that a current microsd cards is just a general purpose micro-controller and some (probably SPI) flash in a plastic case.