Kind of. Admins can see all channels, and can forcibly insert themselves into any voice channel (even if it's full). But you're right in that their domain only extends to the _server_ and not your user account which is not tied to the server and they have no ownership over.