News for hackers. Stuff that matters.
Re:Linux Load Averages: Solving the Mystery by btilly on Tuesday August 08, 2017 @01:48PM (#14960432)
This comment makes perfect sense if load is a smooth function. But it is not. It tends to be a step function.

The most recent 2 data points give you is whether the problem is currently getting worse, getting better or steady. The third gives you a sense of whether it has been doing on a while.

Re:Linux Load Averages: Solving the Mystery by brendangregg on Tuesday August 08, 2017 @01:52PM (#14960485)
FWIW, here's a quote from the Bobrow 1972 TENEX paper that I did not include (as the post was getting too long):

"Three figures are better than just the last one, because from these the user can predict the trend as well as note local variation."

Re:Linux Load Averages: Solving the Mystery by Florin_Andrei on Tuesday August 08, 2017 @02:03PM (#14960644)
> This comment makes perfect sense if load is a smooth function. But it is not. It tends to be a step function.

I think that depends on the sampling frequency, doesn't it? (given a modern OS with lots and lots of threads and processes)

Re:Linux Load Averages: Solving the Mystery by lkrubner on Tuesday August 08, 2017 @03:18PM (#14961501)
No. Check out this video by Zach Tellman. He talks about queues and how they break down under load. One of the least intuitive things he points out is that when you have more processors, the breakdown tends to be more of a step function: everything is running smoothly till the moment that it isn't.

https://www.youtube.com/watch?v=1bNOO3xxMc0

The point he makes arises from basic queue theory and is applicable to all kinds of systems, and how those systems react to load. It's got little to due with particular hardware and everything to do with basic math.

Re:Linux Load Averages: Solving the Mystery by hackits on Thursday August 10, 2017 @10:03AM (#14979749)
That was a great talk and really sound recommendations he makes.
Re:Linux Load Averages: Solving the Mystery by btilly on Tuesday August 08, 2017 @02:30PM (#14960966)
No. It depends on the fact that when something decides to go wrong, it frequently goes south fast. So, for example, a busy lock in a database goes from 99% of capacity (using very little resources) to 101%, processes start backing up, and the system goes haywire.

Think of it as being like traffic. Analytically it is easy to think of smoothly varying speeds. Reality is that there is a car accident, then a sudden traffic jam. We are poking around to figure out where and when that traffic jam happened. And sometimes the cars get cleared off the road and by the time we begin looking the jam is already evaporating.

So comparing the 1 min and 5 min load averages tell us whether the jam is getting worse, holding steady, or improving on its own. Looking at the 15 minute one tells us whether this happened recently.

Re:Linux Load Averages: Solving the Mystery by TylerE on Tuesday August 08, 2017 @03:54PM (#14961838)
See aksiL swap

Performance tends to degrade rather...rapidly when you start to actually meaningfully swap actual working memory. With modern quantitys of RAM I'd almost prefer to just run swapless and let the system OOM so it can just be rebooted and get on with it...

Re:Linux Load Averages: Solving the Mystery by rcxdude on Wednesday August 09, 2017 @05:54AM (#14967026)
Linux doesn't handle this case well. You'll eventually get the OOM, but the thrashing is actually worse than you get via swap (it arrives more suddenly and causes more severe slowdown than swap thrashing, making it difficult to manually fix the problem). I think this is because the disk cache gets severely squeezed before the OOM killer actually gets invoked, but I'm not sure.