Re:Strings Are Evil
by benmanbs on Wednesday June 20, 2018 @12:30PM
(#17356886)
Call me crazy, but for something as simple as taking a CSV file and shoving its data into a database, why wouldn't you just use a combination of shell tools? Don't get me wrong, I'm a Java programmer, but sometimes you don't need the overhead of the JVM, and something like awk would save you lots of time and energy (and memory).
[ Parent
| on HN ]
Re:Strings Are Evil
by rhombocombus on Wednesday June 20, 2018 @12:42PM
(#17356995)
That was my first thought, I do ETL work at a large insurance company and we use shell tools almost exclusively unless we need to do more complex transformations. Unix tools are really low overhead and work extremely well for this task. Also, you can parallelize a lot of them with xargs: https://adamdrake.com/command-line-tools-can-be-235x-faster-...