News for hackers. Stuff that matters.
Re:Metaprogramming Python For Big Data by Fede_V on Thursday December 12, 2013 @06:50AM (#6893969)
Excellent. For sparse storage, do you use Scipy Sparse, or you have your own custom built solution?

I know continuum was working on a version of memmapped numpy (blaze, iirc) arrays which looked really interesting.

Re:Metaprogramming Python For Big Data by vtuulos on Thursday December 12, 2013 @08:54AM (#6894371)
I started with Scipy Sparse. I ditched it for a custom solution so I could support variable-length integers, run-length encoding etc.