This is why Hilbert's program to finitely axiomatize mathematics can't be completed. The "escape hatch" here is simply that not all propositions are actually interesting, so finite axiomatizations are still very useful, and we can extend the axiomatic basis as needed given satisfactory justification. This last part is the only place where social consensus sometimes comes into play (continuum hypothesis, etc).
Edit: there is another possible escape hatch that hasn't been fully explored IMO, and that's some variant of finitism. All these impossibility proofs depend on infinite structures to derive incompleteness or contradiction, but if infinite structures are not expressible...
This is different what I would understand under an Ur-Logic: Just a logical system that can express anything you want, given you are free to add axioms. Obviously there are a few choices for that.
Could you elaborate on what such a formalism where infinite structures are not expressible might look like? It sounds an intriguing notion, though I'm unable to quite get at it.
A Defense of Strict Finitism, http://www.jeanpaulvanbendegem.be/strict%20finitism.pdf
Could you elaborate on that? Any references?