Re:The Linux Scheduler: A Decade of Wasted Cores (2016) [pdf]
by alyandon on Wednesday December 13, 2023 @02:11PM
(#38632605)
Ran into similar pathological behavior on servers with huge amounts of ram (>1 TiB). Negative dentries builds up until the kernel decides it is time to reclaim and locks up the server for >60 seconds scanning pages. :-/
[ Parent
| on HN ]
Re:The Linux Scheduler: A Decade of Wasted Cores (2016) [pdf]
by anonacct37 on Wednesday December 13, 2023 @04:51PM
(#38634664)
I also ran into spooky negative dentry issues. On a fleet of seemingly identical physical machines one machine would constantly check for files that didn't exist (iirc it was somehow part of nss and a quick Google search seems to confirm https://lwn.net/Articles/894098/ ).
I'm okayish at systems level debugging but I never figured that one out. It caused the kernel to use alot of memory. Arguable whether or not it impacted performance since it was a cache.
Re:The Linux Scheduler: A Decade of Wasted Cores (2016) [pdf]
by tremon on Wednesday December 13, 2023 @02:20PM
(#38632761)
Yes, indeed. The more ram available, the more pages are available as buffer cache, the more pronounced the system stalls are. Though in my example, the determining factor is available_memory/disk_write_troughput, while in your example it is available_memory/single_core_throughput (assuming the page scan is a single-thread process).
Re:The Linux Scheduler: A Decade of Wasted Cores (2016) [pdf]
by mkhnews on Wednesday December 13, 2023 @07:12PM
(#38636109)
Does disabling transparent huge pages help any here ?
Re:The Linux Scheduler: A Decade of Wasted Cores (2016) [pdf]
by tremon on Thursday December 14, 2023 @01:38PM
(#38645207)
Have not tried it, but I would not expect any difference. FAFAIK, transparent huge pages are only about organizing free/unused/allocated memory; in both mine and the parent's example, the issue isn't about memory management per se but about synchronous operations on data taking too long (I/O write in my case, cache cleanup for the GP).