I should have mentioned in the post that I do have an iPhone 4 (with Retina). I regularly switch between that, an iPod touch, an iPad Mini, and 1st gen iPad.
For me Retina feels "brighter and more crisp", but it does feel like "it's nice, but not a game changer."
For me the form factor and weight of the iPad Mini wins over the higher resolution display.
For example, I'd love an iPad Mini but I just can't wrap my head around going back to a non-retina display. I know many people feel the same.
I felt the same way as Justin when I bought my first retina iPhone, curious to hear his thoughts once he gets one.