Well in my case when choosing a college degree: do I study CS that I know I would be very comfortable with or do I study Computer Engineering which would be much more challenging since it requires EE classes? I chose Computer Engineering and I don't regret it one bit. Even though I still ended up in software, I feel like I have useful foundational knowledge about lower-level operation of computers that a lot of my peers don't have.