It also matches what we know: the less "uncertain" some amount of the information the less it is compressible.
However he does mention "chaotic" in one sentence, in evaluating the "constraints" imposed by the language when making the crossword puzzles:
"If the redundancy is too high the language imposes too many constraints for large
crossword puzzles to be possible. A more detailed analysis shows that if we assume the constraints imposed
by the language are of a rather chaotic and random nature, large crossword puzzles are just possible when
the redundancy is 50%."
Shannon didn't define it as "chaos" rather as a:
"measure of information, choice and uncertainty."
http://math.harvard.edu/~ctm/home/text/others/shannon/entrop...
It also matches what we know: the less "uncertain" some amount of the information the less it is compressible.
However he does mention "chaotic" in one sentence, in evaluating the "constraints" imposed by the language when making the crossword puzzles:
"If the redundancy is too high the language imposes too many constraints for large crossword puzzles to be possible. A more detailed analysis shows that if we assume the constraints imposed by the language are of a rather chaotic and random nature, large crossword puzzles are just possible when the redundancy is 50%."