News for hackers. Stuff that matters.

A comment on Remove first 300M lines from 700 GB file on 1TB disk. Parent comment

Re:Remove first 300M lines from 700 GB file on 1TB disk by helltone on Tuesday September 22, 2020 @05:09PM (#24559928)
While filesystem block is usually 4k, I think ssd blocks are in the 256k-4mb range. So 4k is probably a bad choice.
[ Parent | on HN ]
Re:Remove first 300M lines from 700 GB file on 1TB disk by dspillett on Wednesday September 23, 2020 @04:26AM (#24564458)
Aye, I mentioned that a bit further down.

Also if working with network attached storage you have an extra set of considerations that will change the optimal block size to work with.

[ Parent | on HN ]