Re:Echoprint: Open-source music fingerprinting
by brianwhitman on Thursday June 23, 2011 @11:42AM
(#2688250)
the dumps are in a format that other code understands (fastingest.py)
The code data is compressed using zlib (and then base64'd.) It's all on s3-- in our experience, big data dumps like this get relatively little traffic after the original hype dies down and a torrent doesn't make sense. We're pretty sure amazon can handle the load :)
Re:Echoprint: Open-source music fingerprinting
by JonnieCache on Thursday June 23, 2011 @01:28PM
(#2688809)
S3 has bittorrent support built in, it's trivial to enable. But you probably knew that.
Also, I understand json is very easy to use, etc. But those big dumps cry for a binary format. Or at least add zlib/lzma compression so people don't waste bandwidth on uuencoded binary data in json.