Tell me about it. I had cudatoolkit installed, and then followed every single PyTorch installation instructions, and then still it insisted that I should get the CPU version, not the GPU one.

I ultimately fixed this with going to the conda files list, and choosing exactly what I needed. Not straightforward at all.