Yeah, I'm drinking some tea, I know that has caffeine too, but tea doesn't make me feel like "Ohhh I need some more of this!" like coffee.
Like alcohol, caffeine is dehydrating. So you may need less to drink if you give it up.
(My ex was career military. When he was a trainer at NTC, the part-timers would show up and drink soda all day and alcohol at night, which didn't help their bodies adjust to/cope with being 3000 feet above see level in a hot, dry climate. Lots of folks ended up in the ER for dehydration and heat exhaustion.)
For me, when I've quit in the past, I tried variously ginger squash, herbal teas and just water (hot or cold).
I tend to drink more caffeine drinks when I'm bored as a break from work and because they are available.