I think his position isn't "If you don't like it, get out", I think his position is much better summarized by the quintessential hacker ideology: "lead, follow, or get out of the way".

Linus is leading. So challenge his leadership, follow the man, or get out of his way.