So if many mathematicians can go without fixed definitions, then they can certainly go without fixed foundations, and try to 'fix everything up' if something ever goes wrong.
But the key is that proponents of both definitions can convert freely between the two in their understandings.
[0]: https://plato.stanford.edu/entries/structuralism-mathematics...
The thing is, the foundations negating axiom of choice are just as consistent as those with. So, how do mathematicians justify their faith in AC?
Same with law of the excluded middle. Tossing it out we can assume all functions are computable and all total functions in the real are continuous. Seems nice and convenient too!
You say you have a foundation where that is in fact what I am doing? Great, if that floats your boat. I don't care. That's several layers of abstraction away from what I'm doing. I pretty much only care about stuff at my layer, and maybe one layer above or below.
Or what of commutative algebra and their beloved existence of maximal ideals!
I would say the most common counter argument is cultural: Classical mathematics is the norm in the field, hence one must use it to participate in research in this field.
But that seems to me a rather intellectually unsatisfying argument, if one cares about the meaning of the work.
I mean, mathematicians do care about the part of the foundations that affect what they do! Classical vs constructive matters, yes. But material vs structural is not something most mathematicians think about. (They don't think about classical vs constructive either, but that's because they don't really know about constructive and it's not what they're trying to do, rather than because it's irrelevant to them like material vs structural.)
I know TFA says that the purpose of foundations is to find a happy home (frame) for the mathematicians intuition. But choosing foundation has real implications on the mathematics. You can have a foundation where every total function on the real numbers is continuous. Or one where Banach–Tarski is just false. So, unless they are just playing a game, the mathematicians should care!