Re:Intel Shuts Down Lustre File System Business
by pinewurst on Friday April 21, 2017 @04:42PM
(#14169275)
If I walked you through the Lustre metadata state machine you wouldn't be surprised by Lustre latency any longer. It's a veritable Rube Goldberg machine without the amusement.
[ Parent
| on HN ]
Re:Intel Shuts Down Lustre File System Business
by lo_stronzo on Friday April 21, 2017 @06:37PM
(#14169971)
I believe it.
At least the Lustre developers (pre-Intel) had the foresight to enable extremely good debugging - you could simply enable a few procfs settings and easily find the offenders.
It's still amusing to me however, that the biggest offenders of Lustre slow-downs were single core processes. I'd check the RPC counts per node, find the violator, and then check per PID statistics; it was always (95%+) a single core application performing thousands of calls.
We never did experiment with the 2.x branch of the software. I recall one of our co-workers stating that even the developers did not believe the dual MDS set-up was production ready at that time.