It's much easier than that. Hardware random number generators are often based on something like a reverse-biased diode. Electrons migrate across and it's entirely random when it happens. Amplify and count them and you get a great source of entropy.