jondegenhardt
Re:Specification for the D Programming Language
on Thursday January 09, 2020 @03:38AM (#21999502)
eBay's tsv-utils author here. A fair bit of performance benchmarking was done on the tools with the goal of exploring this type of use (data crunching). D did really well (tsv-utils are fast!). There's more info on the benchmarks page in the github repo. Perhaps the best summary is the slides from a talk I did at 2018 DConf. Links:
- tsv-utils repo: https://github.com/eBay/tsv-utils
- Performance studies: https://github.com/eBay/tsv-utils/blob/master/docs/Performan...
- Talk slides: https://github.com/eBay/tsv-utils/blob/master/docs/dconf2018...
Re:TSV Utilities: Command line tools for large, tabular data files
on Monday September 02, 2019 @02:36PM (#20860996)
Thank you both! I too like the Unix philosophy of small tools that do a specific job. In a package like this, people may find they only care about one or two tools. They can ignore the rest and mix and match with other tools as they see fit.
Re:TSV Utilities: Command line tools for large, tabular data files
on Saturday August 31, 2019 @09:21PM (#20849938)
Thanks for the feedback. I agree, the performance table would benefit from better formatting.
Re:TSV Utilities: Command line tools for large, tabular data files
on Saturday August 31, 2019 @08:14PM (#20849653)
Hi all, Primary tsv-utils author here. Thanks for checking out the tools! I hope some of you find them beneficial.
Re:Ask HN: Best way to do heavy csv processing?
on Sunday October 21, 2018 @04:24PM (#18269999)
Not a specific approach to your problem, but a resource that may be useful is https://github.com/dbohdan/structured-text-tools. It lists an extensive set of command line tools useful for working with this class of files.