News for hackers. Stuff that matters.
Re:Azure Functions vs. AWS Lambda – Scaling Face Off by dmitriid on Monday January 08, 2018 @04:06PM (#16100576)
Never ever use averages in your stats. Use medians and percentiles.

Averages are a meaningless stat especially if you benchmark.

Re:Azure Functions vs. AWS Lambda – Scaling Face Off by wilgertvelinga on Monday January 08, 2018 @04:15PM (#16100663)
I would say leave the average in but also show standard deviation and 95th percentile average. Of course it is still very unlikely that Azure Functions would come out on top in this case.
Re:Azure Functions vs. AWS Lambda – Scaling Face Off by currysoup_t on Monday January 08, 2018 @04:53PM (#16101007)
What leads you to believe performance follows a normal distribution?

For a given especially slow request would you expect a corresponding especially fast request?

Re:Azure Functions vs. AWS Lambda – Scaling Face Off by DenisM on Monday January 08, 2018 @05:46PM (#16101532)
Standard deviation applies to all distributions, not just the normal distribution.
Re:Azure Functions vs. AWS Lambda – Scaling Face Off by teej on Monday January 08, 2018 @10:54PM (#16103466)
You are arguing against yourself here. Having the mean and 95th/99th percentile is going to give you a better picture of the distribution than mean alone. Mean alone actually doesn’t give you ANY idea of the distribution. I don’t know why OP is being downvoted, managing to 95th percentile is very common practice and I also thought was a missing addition to the article.
Re:Azure Functions vs. AWS Lambda – Scaling Face Off by mr_toad on Monday January 08, 2018 @04:11PM (#16100637)
Never use the best linear unbiased estimator? That's a strong statement.
Re:Azure Functions vs. AWS Lambda – Scaling Face Off by dmitriid on Tuesday January 09, 2018 @12:32AM (#16103860)
It’s not the best. There’s a Russian joke that goes “One person is cooling in the morgue, the other is running a high fever. The average temperature in the hospital is 36.6 C though”

Averages are very susceptible to outliers and don’t give a proper insight into your data. What you really want is: how did half of my requests perform, 90% of requests perform, 95% of requests perform, 99% of requests perform

Re:Azure Functions vs. AWS Lambda – Scaling Face Off by screaminghawk on Monday January 08, 2018 @04:12PM (#16100647)
Median is a type of average. You are confusing "average" with "mean".

To be fair, it's not clear which form of average is used in the article and your assumption that it is the mean is likely correct.

Re:Azure Functions vs. AWS Lambda – Scaling Face Off by blueline on Monday January 08, 2018 @04:53PM (#16101009)
I have never seen median referred to as a "type of average" in any context.

Is there any foundation to this?

Re:Azure Functions vs. AWS Lambda – Scaling Face Off by niteshade on Monday January 08, 2018 @04:59PM (#16101076)
Quite literally the first result in Google: http://www.dummies.com/education/math/pre-algebra/the-three-...
Re:Azure Functions vs. AWS Lambda – Scaling Face Off by e12e on Monday January 08, 2018 @05:21PM (#16101303)
Also, from webster's:

"av·er·age\ˈa-v(ə-)rij\ noun

: a number that is calculated by adding quantities together and then dividing the total by the number of quantities

: a level that is typical of a group, class, or series : a middle point between extremes

Full Definition

1 a : a single value (as a mean, mode, or median) that summarizes or represents the general significance of a set of unequal values b : mean 1b 2 a : an estimation of or approximation to an arithmetic mean (...)"

It's common to see arithmetic mean and average to be treated as synonyms - but the mean is really just a type of average.

Re:Azure Functions vs. AWS Lambda – Scaling Face Off by claytonjy on Monday January 08, 2018 @05:36PM (#16101451)
You might like this blog post from John Myles White: http://www.johnmyleswhite.com/notebook/2013/03/22/modes-medi...

It compares mode, median, and mean as each being specific implementations of a more general concept of discrepancy.

Re:Azure Functions vs. AWS Lambda – Scaling Face Off by phamilton on Monday January 08, 2018 @05:47PM (#16101554)
Colloquially, median and mode are used as average more than you'd expect. For example, we might say "the average joe is right handed", which is most likely the mode.