Same here; coffee has never made me feel generally "bad" in any way that I can detect. I drink several cups a day - sometimes (not usually) as late as 5 or 6pm - and sleep like a baby anyway. I haven't ever given it up completely, but I did cut down to a single (8oz) cup first thing in the morning for a little while. The only noticeable effect was - as you said - the coffee I did drink had more of a punch than before. I didn't feel like I had more or less energy overall; I certainly didn't notice anything like "skin greasiness" before or after.

It's interesting that it affects people so differently. It takes a whole lot of coffee for me to even feel jittery; most of the time it's just a pleasant boost of emotional energy. Like an anti-depressant. I feel excited about life and ready to go dive into it. That's the main reason I drink it most days; not to keep myself awake. It just feels good, seemingly without downsides.