That might be true, but you don't usually care about that for ML workloads running on GPU. Bottlenecks are typically elsewhere.