You're not mistaken. I'd classify that under "3rd party apps have permission to do things other apps cannot." Yet another example would be how Apple Pay comes up automatically near payment terminals. Or how most of the default actions in the Share Sheet—all of which are for Apple Apps—cannot be turned off.