News for hackers. Stuff that matters.
Re:Nassim Taleb: We should retire the notion of standard dev... by thaumasiotes on Wednesday January 15, 2014 @08:27PM (#7067457)
> The STD is far more easy to analyze in a mathematical way. That is the huge value it brings

This is also what I have read (I have essentially no experience with statistics).

> squaring is an operation you can take the derivative of, but absolute value you cannot

We can talk without wild, obviously false hyperbole. It's trivial to take the derivative of the absolute value function. Working with it is more difficult, but taking the derivative is as easy as anything in math:

    f'(x) = -1 (when x < 0); 1 (when x > 0)
Re:Nassim Taleb: We should retire the notion of standard dev... by dimatura on Thursday January 16, 2014 @01:39AM (#7068380)
"Easy as anything in math"? Now that's "obviously false hyperbole". You can't just brush away that discontinuity, specially when it's on the minimum (which is what people most often care about). Anyway, this is formalized in the notion of subderivative. http://en.wikipedia.org/wiki/Subderivative
Re:Nassim Taleb: We should retire the notion of standard dev... by thaumasiotes on Thursday January 16, 2014 @03:16AM (#7068590)
You'll learn to take the derivative of |x| in high school calculus, shortly after learning how to take derivatives in general. It's not complex, and the fact that it's not defined at the origin doesn't mean there's a problem in taking it; it just means the function behaves "badly" there. I don't understand the focus on the discontinuity anyway; in working with the function, I'd be more concerned about the fact that it's piecewise defined.

Consider a variant on the absolute value function:

    f(x) = x (when x >= 0); sin x (when x <= 0)
It and its first and second derivatives are all continuous (after which it comes apart at the origin), but if you were working with the derivative, even though it's differentiable everywhere, you'd have to constantly be aware of whether the origin was in your domain. The great advantage of working with x^2 instead is that it behaves the same way everywhere, not that its derivative is continuous.
Re:Nassim Taleb: We should retire the notion of standard dev... by thaumasiotes on Thursday January 16, 2014 @11:39AM (#7070382)
This occurred to me after the editing window for my other reply passed, but...

The tangent function has discontinuities at x = pi/2 and every interval of pi from it. When taking the derivative, is it more fruitful to say "you can't just brush away those discontinuities", or "sec^2 x"? And this is a derivative all calculus students are required to know!

Re:Nassim Taleb: We should retire the notion of standard dev... by photojosh on Wednesday January 15, 2014 @08:52PM (#7067554)
That little discontinuity at the origin is kind of a pain though.
Re:Nassim Taleb: We should retire the notion of standard dev... by thaumasiotes on Wednesday January 15, 2014 @09:11PM (#7067619)
Oh, completely agreed. I was enlightened when I read that standard deviations were defined the way they were in order to make analysis easier; it seems more than reasonable to me. But there's no difficulty in just taking the derivative of |x|, and I hate seeing random misinformation out there.

http://xkcd.com/386/