vegabook comments below that swaps are much more like 24-hour loans than the underlying 10-year loans, so it makes sense that they should trade at a discount due to risk differentials.

I don't know the mechanics of swap settlement well enough to understand if that is correct, but it seems plausible.