I stopped and started a handful of times, but I would always get so frustrated that I quit after a few weeks or months each time.
The most recent time, I realized that a lot of my issues were more logistical in nature. I didn't adequately understand how to use the command line, or where my packages were being installed, or how the files interacted with each other, or how to create and delete a development environment, or how to get an IDE configured.
All these things are things that felt like "not programming" to me, and indeed, when you Google "learning programming" you almost entirely get posts and articles about syntax and most of them gloss over setting up an environment.
Now that I've figured out how to get an environment set up and torn down and I can spend more time building things, I'm finding that it's nowhere near as complicated as I thought originally.
1. Minmaxing life and taking the shortest path to a degree
2. More interested in CS theory
3. Just plain unlucky in that everyone teaching their elective courses went out of their way to provide a sanitized environment
can end up mildly screwed.
However, programming really is easy, in that its learning curve is very shallow. It might be a long way, and you might become afflicted with the "C language brainwash", where you fail to distinguish between algorithmic and engineering details, which will further impede progress, but the learning curve is shallow, which means that overall it feels easy.