A lot more people use swap files than Linus seems to think. Those people are likely not using rc builds of the kernel though.