Like I said, it's like the Bible. Most people don't cover-to-cover the Bible. But the Bible also isn't the "encyclopedia of Catholicism". People have favorite passages. There are books in it people do read end to end. There are places, like Psalms, where you open to an arbitrary page and read either direction.
TAOCP is like that.
--Knuth, in Coders at Work