News for hackers. Stuff that matters.
Re:The Unreasonable Effectiveness of Conditional Probabilities by LudwigNagasena on Saturday February 25, 2023 @07:19PM (#34941836)
I am not sure what you mean by moments, but in probability theory “the n-th moment” means E[X^n]; and you’ve clearly used them.

In probability theory the Radon-Nikodym is used to justify existence of random variables. But it cannot be used to show that any variable has an expected value (ie has a moment, ie is integrable). The Cauchy distribution is a traditional counter example to such assertion.

> For Y it is enough that it has an expectation

That is false. Just look at your “simple example”. You arrive to E[Y^2]. An expectation is not enough. It should be clear intuitively because MSE is a minimization of the second moment of a certain rv, so you are bound to have at least some constraints for second-order relationships for the variables you’ve used to construct that certain rv.

I think you may need to re-read Rudin and Neveau and refresh your knowledge. (Though I can say nothing about Neveau, I studied using the textbook by Shao.)

Re:The Unreasonable Effectiveness of Conditional Probabilities by graycat on Sunday February 26, 2023 @11:34AM (#34946804)
For any real valued random variable,

     E[Y^2]
always exists although it might be infinity.

You mentioned moments -- as I recall some writing in statistics uses that work, but I never have.

Your description of the Radon-Nikodym result does not look right. Again, I won't want to write a lecture in graduate probability, but from memory the usual description of that result goes:

Given real valued, integrable function f and sigma algebra s, there exists real value function g measurable with respect to sigma algebra s so that g integrates like f over all sets in s. So, with real valued random variable Y in place of function f, we let

     E[Y|s]
be the function g. If s is the sigma algebre generated by real random variable X, then we write
Re:The Unreasonable Effectiveness of Conditional Probabilities by LudwigNagasena on Sunday February 26, 2023 @04:03PM (#34949435)
> Given real valued, integrable function f

Of course that makes it possible. Note that it doesn’t say that f is simply measurable. By definition being integrable means E[f] < infinity. (And being square-integrable means E[f^2] < infinity, an even stronger condition).

Consider Y = Z/X where Z, X iid ~ N(0,1). Try to calculate E[Y|X], and try to minimize E[ (Y - f(X))^2 ]. Neither will make sense. I am sure both Rudin and Neveu were aware of this trivial result.

Re:The Unreasonable Effectiveness of Conditional Probabilities by graycat on Wednesday March 01, 2023 @01:03AM (#34979268)
> Of course that makes it possible. Note that it doesn’t say that f is simply measurable.

Irrelevant.

Again, once again, over again, yet again, for real valued random variable Y,

     E[Y^2] 
always exists.

> By definition being integrable means E[|f|] < infinity.

Wrong.

Correcting you is a waste of my time.

Re:The Unreasonable Effectiveness of Conditional Probabilities by LudwigNagasena on Wednesday March 01, 2023 @05:42AM (#34980854)
You are not correcting me, you are correcting Rudin :)