News for hackers. Stuff that matters.
Re:Ask HN: What should I learn if i want to manage and parse... by pcowans on Sunday March 31, 2013 @06:16PM (#5470386)
Can you be more specific about how large 'large' is?

Edit: without knowing the specifics, you might like to look at Elasticsearch (http://www.elasticsearch.org/). That'll give you an HTTP/JSON API into your data, so you might be able to do all the UI work you need client side, e.g. with Backbone.js (http://backbonejs.org/) or similar.

Re:Ask HN: What should I learn if i want to manage and parse... by sixQuarks on Sunday March 31, 2013 @07:54PM (#5470693)
the csv files are not that big. a few thousand rows. But there are lots of duplicates rows I need to get rid of
Re:Ask HN: What should I learn if i want to manage and parse... by pcowans on Monday April 01, 2013 @04:48AM (#5472073)
Exact duplicate rows? If you have access to standard Unix tools, try this on a command line:

cat input_file.csv | sort | uniq > output_file.csv