Re:File Content Histograms
by jannes on Thursday July 07, 2011 @02:33AM
(#2737473)
When I wrote that previous comment I assumed that most binary data would probably use an encoding that is longer/shorter than 8 bit (that's what was examined here). But thinking about it, that might not be true. I don't know.
Why would that be the case?
- Executables: some opcodes are more common than other, and usually contain text/messages
- Zip files / compressed images / mp3s: compression might have a distinct "signature" that has peaks, for example block headers
- Database files: not all values are equally common in records (probably peaks around zero, because of fixed-size integers and string padding)
And so on...