News for hackers. Stuff that matters.
Re:Friends don't let friends export to CSV by Certhas on Tuesday March 26, 2024 @04:15AM (#39825287)
If I run a simulation workload it's pretty easy to generate gigabytes of data per second. CSV encoding adds a huge overhead space and time wise, so saving trajectories to disc for later analysis can easily become the bottleneck.

I have had many other situations where CSV was the bottleneck.

I still would default to CSV first in many situations because it's robust and easily inspected by hand.

There are no comments on this comment yet.