Modern JVM GCs have pause times below 1msec. That's a new capability though so most people aren't yet aware of it.
And Google's ads backend are hardly the definition of server. Their ads front-end for example always used to be in Java. Not sure what it is these days
Therr are many tasks where what you suggests is just too slow and unpredictable.
Don't get me wrong, I think JVM is great, it's just not systems level programming.