What's stopping every major site from going "oh, our randomly generated tracking and ads are critical path", while they serve multi-megabyte heavily obfuscated JS from random URLs to prevent being blocked.
This already happens, unfortunately.
That would get picked up as an enormous increase in Speed Index & TTI, and their Google ranks would fall accordingly.
When I’m at home with fibre I am happy with the idea of going ape and downloading all the things I might touch.
When I’m at the cottage, mobile, etc. I would be irritated if your website did all that.
I’d even love a way to decide just how much of a JPEG to download (that kind that LODs itself as you wait).