I do that too. I use the caps lock for control when I have my left hand on the keyboard and my right hand on the mouse, e.g. selecting with the mouse, then C-c to copy etc.
But when I have both hands on the keyboard, it feels better to use the left control key, maybe because it's more symmetric with my right hand.
For me, using left-Ctrl hurts so much after using Caps as Ctrl I never ever use it, except for the Ctrl-Alt chord for releasing the mouse pointer in VMware.
If you're a Vim user, you might want to make your caps lock an additional escape instead. It works like a charm and I've never looked back. Although sometimes I accidentally write in ALL CAPS when I'm on someone else's keyboard.
I find backspace works just as well and can be remapped in Vim itself (unlike caps lock which must be remapped in the driver, affecting all apps.)
The downside is that I'm always frustrated when I have to use someone else's computer and I'm toggle caps all the time.