Hmm, perhaps it's because I learned to cycle later than most people (at 18), but this phenomenon was always very apparent to me. When I first started, whenever I tried to steer I'd always end up going the wrong way.