Thats not just you. A skilled joystick player will be easily beaten by a mediocre player with a keyboard/mouse if all the other conditions are the same.

Infact, most games have aim assist if you use a controller as means of input.