It sounds like you have a "fixed mindset" as opposed to a "growth mindset". You worry that you are not as skilled at X as you might like to be, but your focus should simply be consistently improving at X.

The y-offset at t=0 matters a little, but the magnitude of the slope dominates in the long run.