News for hackers. Stuff that matters.
Re:Ask HN: Big Data 10x tips and tricks by sjducb on Tuesday November 08, 2022 @04:28AM (#33517459)
Agreed. Im 80% sure CSV is best for his use case. Maybe even JSON line files. I think that he's working with regular data (a few hundred MB) because he's considering memory mapping it.

I have a rule that no-one is allowed to use the words big,small,fast or slow. You must quantify.

I've met too many people who think that 100MB is big data or that 1 Gbps is a fast internet connection.

There are no comments on this comment yet.