I also worked as a computer programmer for a few years without having a CS degree. I decided to work part time while pursuing a Bachelors in Computer Information Systems (less math than CS, more business, most of the same CS courses). It was totally worth it. Not only did I learn about some really useful/interesting stuff (search+sort algorithms, data structures, etc), my pay has significantly increased. I admit that it wasn’t always easy or fun, but it was highly rewarding.