This is true for PC's and servers. However, Java startup time on the Raspberry Pi is horrific.
I recently saw a small server go from 3 seconds startup on my PC to 4 minutes on a Raspberry.
That's pretty much because the CPU on the Pi is awful. I mean really bad. The CPU came with the SoC they could get their hands on rather than was selected as being optimal for a desktop/server role.
Quite fast if you use an AOT compiler.
On the server side, it is usually doesn't matter that much. And when it does, there are JVMs that cache JITed code.