Re:Post mortem on mastodon outage with 30k users (hachyderm)
by evankanderson on Monday December 05, 2022 @10:50AM
(#33867183)
I suspect distributed NFS won't help here when the problem is that a server gets slow / overloaded. In particular, this setup was actually I/O bound and there wasn't more I/O to be had.
Re:Post mortem on mastodon outage with 30k users (hachyderm)
by throw0101c on Monday December 05, 2022 @01:05PM
(#33869228)
> In particular, this setup was actually I/O bound and there wasn't more I/O to be had.
No more I/O to be had from that particular NFS server. If your mounts are distributed over 4+ servers, then you have potentially 4x the available operations available.
It is not NFS that is a SPOF, it is a single NFS server that is a SPOF. There exists distributed NFS systems (OneFS, Panasas) that can tolerate the loss of up to N servers before the service gets disrupted.