EDIT: Thought I should add something of value to the conversation... That is unless you are prone to spurts of procrastination. For me it's good to have things like this on my to-do list to keep me from doing something completely unproductive when I feel like procrastinating.
The real answer is that not every trade-off will be right for every person. Someone mentioned brewing your own coffee: that's probably smart. I'd get a Chemex and be done with it. Someone else mentioned having multiple people at the same desk. That would make me crazy: if I leave a paper or book or whatever on the desk, I want it exactly where I left. That seems like a false optimization to me.
Another example is office equipment. Getting reasonably good stuff is probably smart -- but buying new probably isn't. A lot of places have office liquidators; in Tucson, there's one named Andersen's that regularly advertises $500 Aerons on Craigslist. If you need a chair or desk, they're probably a good place to go.
This list can go on and on and on... the answer to the OP's question is just too often, "It depends."
(Thomas nearly had to smack me silly the other day when I was thinking "Hmm, I think I'll spend some time optimizing my use of Redis so that I still fit in a 1.5GB VPS." I was using 100MB for Redis and it was threatening to push me over the limit... but the next stage is only $ULTIMATELY_SMALL_NUMBER more per month.)