"reason you had fun doing GPU programming is because you already knew about the interface of vectors so you had no problems working with them"
Actually no.
I had to relearn them pretty much completely, as I forgot all the abstract lessons before. But I had fun doing so. Because my brain saw real world use.
Not without adding a lot of complexity. What I meant is that the concepts taught in maths very rarely map directly to any real world problems. GPU programming is a good example, it uses a lot of vector related maths but the leap from not knowing about vectors to GPU programming is huge and not a good way to learn the subject, since you would have to think both about the complexity of GPU's and graphics and about the vector abstraction at the same time. The reason you had fun doing GPU programming is because you already knew about the interface of vectors so you had no problems working with them.