News for hackers. Stuff that matters.
Re:Show HN: Bvckup 2 – Fast File Replicator for Windows by mises on Monday July 08, 2019 @03:26PM (#20385897)
I'm going to defer to you on this one, but my hunch is that NTFS being stupid and crusty is a limiting factor? In my experience, it's dog-slow (particularly on small files). Have you tested on ReFS and compared performance?
Re:Show HN: Bvckup 2 – Fast File Replicator for Windows by apankrat on Monday July 08, 2019 @03:38PM (#20386012)
No, I have not.

From what I've seen NTFS is a really well-made file system. There is indeed a fixed per-file overhead that becomes an issue when working through lots of small files, but NTFS handles multi-threaded access very efficiently, so that's a very easy workaround.

Re:Show HN: Bvckup 2 – Fast File Replicator for Windows by mehrdadn on Monday July 08, 2019 @04:03PM (#20386247)
It's not NTFS that's slow, it's something in the Windows I/O subsystem common across file systems. And it's not that it's slow on small files (the I/O performance is fine), but that there's a large overhead for repeatedly opening and closing files, especially by paths. Apparently Linux gets around this with some sort of inode cache (hashtable?) whereas Windows doesn't implement this for whatever reasons. (Possibly the filter drive model used to support virus scanning etc. doesn't allow it, though I don't quite understand the details of why.) Not even sure Mac is as fast as Linux in this regard.
Re:Show HN: Bvckup 2 – Fast File Replicator for Windows by rodgerd on Monday July 08, 2019 @11:06PM (#20388688)
On the other hand we have, over the years, seen plenty of fights between application and Linux kernel devs over the degree to which the POSIX spec makes it OK for Linux to discard application data, so perhaps that speed comes at a cost.