Ergo all defined axiomatic systems have sentences about the far past and future that cannot be defined with certainty; most do not make the connection to physics. Gödel did and would 100% aware the limits exist and will always exist
Scaling laws aren't just for computers; humans lived experience does not scale infinitely through time, just approximately 2-3 generations
As I understand immutable physical truth like this played a huge role in his early research and ultimately were the forcing function that led him to incompleteness
This is often misunderstood or misstated to mean that there are some things that are unknowable or unable to be solved. (I'm not saying that's what you were implying, I am referring to the common way I see his theorem being represented)
But what he really proved is that no single sufficiently powerful, consistent, effectively specified formal system can prove every arithmetic truth.
He didn't prove that there are mathematical truths that are unsolvable through any possible extension or alternative framework. It's just that one framework isn't enough to solve all problems.
Scaling issues do not just matter when making bridges and when hosting LLMs.