Re:XFS online filesystem check and repair
by ericbarrett on Monday July 10, 2023 @10:19PM
(#36675700)
ext4 also blocks for a long time when deleting a large file, which can be bad in a production environment (think DROP TABLE in a database).
this has a nasty side-effect with NFS, at least <= version 3. ext4 immediately makes the file being unlinked invisible in the filesystem namespace, and then blocks while it does the work of deallocating the space.
the NFS client will issue the unlink() call, not hear anything back from the NFS server as it's blocking doing the unlink(), and then eventually time out and retry the operation. at which point the server immediately will return ENOENT as the is no visible file at that path.
the annoying thing is that this interaction leaks through into userland programs, and then to users, who see "no such file or directory" errors which cause great confusion. I've seen this multiple times in HPC environments.
Re:XFS online filesystem check and repair
by ori_prior on Tuesday July 11, 2023 @06:42AM
(#36679078)
I've found ext4 to be generally unsuitable to HPC environments due to the 16TB filesize limitation. So it is the wrong tool for the job anyways. xfs all the way!
Re:XFS online filesystem check and repair
by compsciphd on Tuesday July 11, 2023 @03:02AM
(#36677398)
and much worse when fragmented on raid5.
ext4 gives me questionable performance with writing a huge amount (like 50k+) of small files, but other than that its great.