This is not accurate. There are many VPS's which are cheaper, many of which have much greater capacity for the money. Some are fly-by-night scams. Others have several years of stability with good support. Check forums and VPS review sites to find the best match.
That said, I have nothing against prgmr or linode and would use them if I needed a super-reliable VPS. (My main VPS is Linode, my secondary is with Kerplunc Hosting)
I'm more concerned about bandwidth. prgmr is close, but not quite as cheap as linode when it comes to bandwidth.
Depends what your needs are though.
Linode is something like $55/GB RAM per month, while prgmr.com is $14.
I remember a post on here saying how hackernews was running on a new 8GB server or something. There's no reason it couldn't run on a 200MB server easily.
(Related: Is HN really sluggish for everyone else as well? Like 3-4 seconds per page load)
Using even 1GB of RAM for something like HN is just crazy.