I read Linus's point as saying that the desktop/developer experience is what drives the adoptions, not the other way around. You want to be able to run similar stacks on both. So server can't happen unless desktop/laptop gets adoption first.

I for one would love to see an ARM desktop; I'm already a Linux user and I've largely stopped gaming so there's no reason for me to stick around x86 except that that's basically all I can get. Architecturally I find ARM much cleaner and nice to use, without all of the crufty 8-bit/16-bit/32-bit compatibility shims that we're stuck with because of the evolution of the x86-64 [ed: was IA64] architecture.