giga- (along with kilo-, mega-, peta- and every other prefix we've ever used with bytes) in any other context is based on powers of 10.

Just because computers are based on binary doesn't mean it was ever a good idea to redefine the meaning of those prefixes.