The book Numbers [1] by Ebbinghaus et. al. is a comprehensive treatment, starting from natural numbers up to complex numbers (and quaternions iirc). It also has lots of historic context, how our number systems evolved.

[1] https://www.amazon.com/Numbers-Graduate-Mathematics-Heinz-Di...