....just mine around your base? Create tunnels that span the entire planet if you must? How is all of this not easier than something as exotic as asteroid mining?

Even if the entire surface is irradiated(somehow) you can still launch things into space with underground railguns. It's not what we currently use, but it's easier to imagine this than building a base on Mars with current(or near future) technology.