I guess we'll have to disagree, but I think artificial intelligence, machine learning, complexity theory (PCP theorem, zero knowledge proofs, etc), and algorithmic information theory (Chatin's number, etc.) are as interesting and profound as anything in the basic sciences. CS also has the advantage that much of the field is still in development, unlike almost every other field of science.
I'm really more of a scientist by training.
No offense, but completing most of an undergrad physics degree doesn't make you a "scientist by training". To be a properly trained scientist, I think you need to have done multiple pieces of significant, original research, and more than likely have a PhD.
And if math is your thing, that's fine. Study what you like. Although I'll admit I'm more than a little confused by your assertion that basic science is no longer "in development"...
But that said, the practice of science, at a day to day level, doesn't even remotely approach the level of satisfaction you get from a good hack.