News for hackers. Stuff that matters.
Re:Pointfree style in Python by nakkiel on Monday November 14, 2011 @10:55AM (#3234425)
I wrote an ETL thing recently based on generators. It's quite similar in concept to the paper[1] that David Beazley wrote (without ever hearing about the paper though). Source's available at https://bitbucket.org/saalaa/sauceboat

When I'll have time, I'll implement a web WSGI Web UI to provide visualization capability. My goal is to provide a programmer-friendly replacement to Pentaho Kettle.

[1] http://www.dabeaz.com/generators/Generators.pdf

Re:Pointfree style in Python by oscilloscope on Monday November 14, 2011 @04:06PM (#3235691)
I'd like to hear more about this. I'm working on a javascript CSV reader that displays parallel coordinates + a data grid:

http://exposedata.com/parallel/upload.html http://exposedata.com/parallel/ (if upload fails, this is what it looks like)

Once I get the CSV uploader more robust, I'll add additional charts that respond to interactive filters/aggregators, just as the table responds to the chart above.

The goal is a data exploration tool for non-programmers, but I'm keen to extend it for programmers who need more sophisticated ETL and are willing to do a little scripting.

Re:Pointfree style in Python by nakkiel on Tuesday November 15, 2011 @01:34AM (#3237287)
I'm not sure you should provide ETL capabilities.. Usually, ETL and visualization are separate steps in the workflow and sometimes even in a team. If it's too limited in scope it won't be very useful anyway.