The problem isn't that it requires infinite growth, the problem is that as the scale increases the drag effect of those who consume more resources than they contribute grows faster than resource availability grows. There's a maximum size limit that's based on things like cultural sense of responsibility.