I was a physicist, with a Ph.D. in condensed matter. Industry is more fun, at least you have more options to experience different things. And you can still read physics books for fun, if you like, at your free time.