The early media can still be generated at any point of the calling chain. It doesn't have to correspond to actual ringing, if ringing does happen on the POTS side.
(For a test, you can call someone in the UK and check if you hear Pink Floyd style beeps)
In my experience this depends on the network in question: SIP supports "early media" and I've seen it in action a few times. You can tell by the fact that phone UIs usually don't count connection time in that state, yet you can hear a prerecorded announcement, music mixed with the dialing tone etc.
I remember some creative uses of this as well: If you controlled the signalling stack, it was possible to keep a connection open in this state indefinitely without either end getting charged.
Here's a relevant RFC: https://tools.ietf.org/html/rfc3960