News for hackers. Stuff that matters.
Re:Visualizing Entropy in Binary Files by cortesi on Saturday November 08, 2014 @02:34PM (#8577912)
Author of the post here. I'm working on a browser-based interactive analysis tool based on these visualizations. It's nowhere near ready for release, but those who are interested can find a demo here:

http://binvis.io

This is not even an alpha yet - I plan to announce the initial release in the next month or so. Eventually, I would like to add the ability to upload, share and annotate files for analysis. Comments and criticisms welcome!

Re:Visualizing Entropy in Binary Files by 13 on Saturday November 08, 2014 @02:54PM (#8577961)
The level of detail and structure you can pick out with this tool is amazing.

https://i.imgur.com/lsRA1RN.png

Re:Visualizing Entropy in Binary Files by muyuu on Sunday November 09, 2014 @08:41AM (#8579875)
Removed?
Re:Visualizing Entropy in Binary Files by scentoni on Saturday November 08, 2014 @04:31PM (#8578211)
That's excellent! Would be very cool to also have frequency digraphs for the current segment.
Re:Visualizing Entropy in Binary Files by cortesi on Saturday November 08, 2014 @04:48PM (#8578246)
Frequency analysis and byte dot plots are definitely on the way. Do you have a concrete example of the digraph frequency feature you can link me to? Any other feature suggestions are welcome too.
Re:Visualizing Entropy in Binary Files by scentoni on Saturday November 08, 2014 @05:01PM (#8578282)
The link below to the Cantor Dust presentation shows 2d and 3d examples. I wonder if there are advantages of other space-filling curves, like http://en.wikipedia.org/wiki/Sierpi%C5%84ski_curve and http://en.wikipedia.org/wiki/Peano_curve
Re:Visualizing Entropy in Binary Files by cortesi on Saturday November 08, 2014 @05:15PM (#8578309)
Right - these are the frequency dot plots I first saw in Greg Conti's work (some examples here: http://sebug.net/paper/Meeting-Documents/BlackHat-USA2008/BH...). They're definitely on the way.

Regarding other space-filling curves - I'm in two minds about this. I've implemented z-order and the H-curve for binvis, but for different reasons neither of these are as useful as the Hilbert curve, so they're not exposed in the interface. My feeling now is that I should pick one locality preserving layout and one intuitive layout to keep things simple and usable. I want binvis to be a workaday tool, so I'm keeping my space-filling curve geekery to another project (https://github.com/cortesi/scurve).