News for hackers. Stuff that matters.
Re:TFS: A file system built for performance, space efficienc... by rsync on Sunday May 21, 2017 @01:04PM (#14388092)
I searched the github page and this HN comment thread for the string "frag" and got nothing ...

I don't know if the authors are here, but if they are - would you comment on fragmentation and the dangers of growing a filesystem past 95-98% full ?

In the world of ZFS, performance can become significantly degraded with as low as 90% space filled. Further, our experience has been that you can permanently degrade filesystem performance by churning the usage above 95% for any significant amount of time. Which is to say, even if you reduce usage back down to 80%, the zpool maintains poor performance until it is destroyed and recreated.

This is exactly what you would expect to see with a fragmenting filesystem that has no defrag tool.

Unfortunately, creating a defrag tool for ZFS is a very daunting technical hurdle and it appears that nobody is interested in pursuing it.

How does TFS behave ? Does it have, or do you plan for it to have, a defrag utility ?

Re:TFS: A file system built for performance, space efficienc... by ticki_ on Sunday May 21, 2017 @04:01PM (#14388947)
Author here.

> I don't know if the authors are here, but if they are - would you comment on fragmentation and the dangers of growing a filesystem past 95-98% full ?

Fragmentation isn't an issue in TFS, at all. Because it is a cluster-based file system. Essentially that means that files aren't stored contagiously, but instead in small chunks. The allocation is done entirely on the basis of unrolled freelists.

This does cause a slight space overhead (only slight, coming from the fact that metadata of the file is stored in the full form), but it completely eliminates any fragmentation.

Re:TFS: A file system built for performance, space efficienc... by gpm on Sunday May 21, 2017 @04:24PM (#14389073)
I only have a basic understanding of harddisks/filesystems, but won't that slow down reading/writing on harddisks since the chunks won't be in order and close together?
Re:TFS: A file system built for performance, space efficienc... by ticki_ on Monday May 22, 2017 @01:50AM (#14391279)
With modern hard disks, no. They work in sectors.
Re:TFS: A file system built for performance, space efficienc... by amadvance on Monday May 22, 2017 @11:30AM (#14394365)
I suppose you mean SSD disks.

Rotating disks are surely affected by not contiguous operations, even if done with sector granularity.

Re:TFS: A file system built for performance, space efficienc... by asymmetric on Sunday May 21, 2017 @06:04PM (#14389496)
> files aren't stored contagiously

I think you mean contiguously.