News for hackers. Stuff that matters.
Re:Understanding "randomness" by danger on Monday October 18, 2010 @05:35PM (#1805263)
If we are interested in a _sequence_ of pseudorandom numbers, then we should be talking about the _joint_ entropy of the sequence. But information theory is plenty capable of describing "how random" a sequence is.

The generator you are talking about is far from producing a uniform distribution (which would have maximum entropy) jointly over the n-dimensional hypercube that would represent a sequence of n draws from your generator, so it has less entropy and is thus "less random" than the distribution you'd get from n independent draws from a perfect rand().

Re:Understanding "randomness" by pjscott on Monday October 18, 2010 @08:23PM (#1805699)
You're right (have an upvote); I was warning more against rash misuse of the concept of entropy, which I see quite a bit.