And even for games, the only reason it's not a difference is because game developers target less bandwidth between CPU and GPU so they don't use it all.

If we move to a future where every GPU has a lot more bandwidth then games would most likely start taking advantage of it.