News for hackers. Stuff that matters.
Re:Structureshrink: Structured shrinking of unknown file for... by bazzargh on Sunday June 12, 2016 @09:43PM (#11891274)
I've found Jesse Ruderman's Lithium very useful for this: http://www.squarefree.com/lithium/

It actually works on pretty much any filetype too (with the --chars flag)

Re:Structureshrink: Structured shrinking of unknown file for... by DRMacIver on Monday June 13, 2016 @04:25AM (#11892352)
For certain values of works, that's true. It will take a long time and won't produce very good results.

structureshrink more or less came out of frustration with what a bad job most of the existing shrinkers do. In particular the algorithm that lithium uses is more or less structureshrinks last ditch "Welp, everything else has failed, might as well try this" approach.

Re:Structureshrink: Structured shrinking of unknown file for... by bazzargh on Monday June 13, 2016 @01:31PM (#11895602)
Lithium'll fail on anything where you need to make correlated deletions, true. But you'd have similar issues with eg input that contains sizes, pointers, checksums...which aren't going to work with a generic strategy.

As to speed...well the kind of problem I was using it on was reducing an excessive dataset that was used by the entire test suite of an app; so each iteration was a complete test run of a minute or two. I was under no illusions that this was going to be fast, so I left the script to do its thing and came back to check on it after lunch. In terms of time I didn't have to waste hacking that data myself, it was a win.

Re:Structureshrink: Structured shrinking of unknown file for... by TempleOS on Sunday June 12, 2016 @07:22PM (#11890831)
In simstructure I had a default element type. I recorded differences from the default.

TempleOS has LZW compression. http://www.templeos.org/Wb/Kernel/Compress.html#l1

Re:Structureshrink: Structured shrinking of unknown file for... by cyphar on Monday June 13, 2016 @02:10AM (#11891981)
I've often wondered. What is the license for TempleOS, is it free software?
Re:Structureshrink: Structured shrinking of unknown file for... by icebraining on Monday June 13, 2016 @02:11PM (#11895908)
The home page says it's in the public domain.