Getting a faster CPU is about as difficult as getting more memory for almost everybody, because people need to buy new machines to do so. Either because they own a machine that can't be upgraded (hello soldered ram), or because they don't have the technical skills to do so.

Personally I'd rather wait longer for things to complete than have my whole system grind to a halt because it starts swapping like crazy.