If you know about how much memory you'll need and don't care about I/O cycles there are a lot of low-end VPS for only a few bucks (<$10/month). Low end box features a lot of them and specials. Of course there are also monthly posts about which providers went under, so keep a backup.