Shipping something demonstrates you're able to do all the required aspects and are not just an armchair philosopher.
Previous code is the best indicator of future code. The CV is the least usable.
Suppose you can buy one of two used cars. One is a nice Lexus and one is a nicer Ferrari. They both cost the same, but the Lexus has a detailed maintenance report and a clean Carfax. The Ferrari has no records (because it is under a mythical car NDA).
It would be perfectly logical to buy the Lexus, even though the Ferrari on average would a better car for the same money, as long as we assume non risk neutral actors. Information risk goes up, value goes down. Arguably, it's a great reason to contribute to open source, if you're a programmer, to reduce the information asymmetry in future hiring processes and thereby increase your perceived value.
Edit: I just reread. He sort of contradicts what he said in the keynote he links to.
Also to write free software that is recognized as useful, is a major hint of a possibly good programmer: it means that he is passionate, and is able to identify a problem an write and design a good solution. And there is a meritocratic salt in this soup, as open source can be considered, in some way, a way to show that you as a programmer are worth of consideration.
So I admire github for this hiring strategy.
Edit: is just my feeling or I'm feeling some open source hostility in this thread?