Re:What you need may be “pipeline +Unix commands” only
by hashhar on Sunday March 03, 2019 @07:19AM
(#19294121)
I have a simple bash script composed of 6 sed commands piped together to convert >100GB csvs (table dumps of recommendation data) into Redis binary protocol which are then ingested into a Redis Cluster using redis-cli --pipe. It takes somewhere around 15 minutes running on a modest bare metal server.
[ Parent
| on HN ]
There are no comments on this comment yet.