It's not even just about habitability. There are many remote places on Earth that we consider a waste of time and effort to inhabit, which are themselves 100X more habitable than Mars. There's a reason we don't have large, thriving settlements on inland Greenland, deep in the Sahara Desert, and Antarctica, even though they are way more habitable than Mars. There's no reason to inhabit them.