> Be aware that you'll be forced to share your GPS location with Google during the set-up

I think you're misinterpreting the meaning of the location permission: it's probably requesting that to connect to the Chromecast via WiFi Direct or Bluetooth. Android buckets that into location because you can figure out a user's location by looking at nearby WiFi networks/Bluetooth beacons.