Satellites are limited and impossible to hide. The carrier strike force knows exactly when they are in view of an adversary's reconnaissance satellite. In any future major conflict the satellites will be the first casualties. There is a very active arms race in anti-satellite weapons.
That swarm of drones will almost certainly be spotted by the AEGIS air defense network (the cruisers and destroyers that escort the carrier), and shot down. Cruisers and Destroyers serve as the "screening" role for the Carrier, you will always see the cruiser/destroyers first in the Carrier Strike Group no matter what angle you approach from (and vice versa, they will see you first before you get to the Carrier).
This gives the cruisers/destroyers a chance to shoot down the drone swarm (or whatever air platform you're using). If its too much for the sea-based air defense systems to handle, they'll radio for assistance from the Carrier and F18 / F35 jets will be dispatched, beyond the horizon, before the swarm even sees the Carrier or pinpoints its location.
That's the difficulty of fighting a Carrier. Not the Carrier itself per se, but the entire team that works together. AEGIS cruisers have the best radar systems the US Navy can offer, and their large power plants can make their RADAR systems more sensitive / higher power than anything you can possibly hope to put into a drone.
If it's traveling more-or-less in a straight line, you can predict where it will be to within a couple of miles. If not...
First, you need accurate, current location info on the carrier. That's not easy.
Second, you need something that can launch your cannonball. That's not easy, either, because if you're within cannonball range of a carrier, then you are within range of an enormous amount of return fire from the carrier strike group, and you're dead long before you get a chance to fire your cannonball.
The problem is getting current targeting information to a launcher that's 1000 miles away from the carrier, and then the carrier still moves enough to really matter during the time that your missile travels that 1000 miles.