If you don't like the taste of that (decaf tastes bad to me) or just want more control over your intake, caffeine pills aren't a terrible way to go as a temporary solution.
Figure out how much caffeine you usually drink, and take that much with no liquid caffeine for a couple of days and make sure you're ok with that. Then slowly lower your dose until skipping only leaves you with a mild headache or none at all.
Me on the other hand for whatever reason don't feel like that when I drink coffee. I'm almost doing it purely for the caffeine dose. Energy drinks, 5 hour energy shots, pills, whatever just to get some more caffeine.
I should probably lower my caffeine intake though.. I like the 1/2 coffee 1/2 decaf suggestion above. I'll try that tomorrow!