I think that Unix-alikes are going to dominate any sort of high-performance computing; and I think it's more than just the network effects of the current user base. The scriptability and composability that permeates Unix-alikes is essential for automating tasks across thousands of nodes. That's not to say that it's impossible in Windows, but it's not as much in Windows' culture. Being able to ssh to any node, occasionally draw graphics remotely, all these things are hugely important. The main advantage of Windows, point-and-click administration and lots of existing software, are not advantages when you can't point-and-click thousands of machines and you have to write all your software anyway.
"Tools are tools. Whether its a hammer or a Scientific Linux Cluster the significant factor is the user, the carpenter or the physicist"
I agree with you that tools are a means to an end and that obviously the LHC is a lot more important that the choice of OS. I just think you were a bit too dismissive of tools in your post, though perhaps that wasn't your intent. If someone is going to rah-rah a tool, in this case Linux, they should be pointing out what role it played and what about its use was essential, not just that it was used.
The scientist in the linked story comes out and says that he is not sure about the differences between BSD and linux and that windows could have filled the gap in principle.
Tools are tools. Whether its a hammer or a Scientific Linux Cluster the significant factor is the user, the carpenter or the physicist. The search for the theory of everything is not a logistics/supply-chain-management problem it is a question of physics.