Since I've read several of Shannon's papers and other mathematical treatments of information theory (e.g. Kullback), I suspect this book will not shed additional technical light for me. However I can't deny that Gleick's writing has an inspirational quality to it that is engaging, as long as you are not reading it as a scientific treatment. I also read Genius and I understand why Gleick is considered almost along the lines of nonfiction fanfic.
Strogatz's Nonlinear Dynamics and Chaos might be a good place to start. It's not mathematically sophisticated at all, e.g. there are few proofs and topological methods are at best implicitly present; but it still has some real mathematical meat on it.
As someone woefully unqualified to critique either, I'd be interested in the opinion of someone closer to the subject matter.