News for hackers. Stuff that matters.
Re:Ask HN: What should I learn if i want to manage and parse... by sixQuarks on Sunday March 31, 2013 @07:54PM (#5470693)
the csv files are not that big. a few thousand rows. But there are lots of duplicates rows I need to get rid of
Re:Ask HN: What should I learn if i want to manage and parse... by pcowans on Monday April 01, 2013 @04:48AM (#5472073)
Exact duplicate rows? If you have access to standard Unix tools, try this on a command line:

cat input_file.csv | sort | uniq > output_file.csv