News for hackers. Stuff that matters.
Re:The Truth About Linear Regression (2015) by Ntrails on Tuesday July 30, 2024 @02:55PM (#41112865)
> There are just too few samples and too much noise per sample.

Call it 2000 liquid products on the US exchanges. Many years of data. Even if you approximate it down from per tick to 1 minutely, that doesn't feel like you're struggling for a large in sample period?

Re:The Truth About Linear Regression (2015) by bormaj on Tuesday July 30, 2024 @04:35PM (#41113862)
They may have been referring to (for example) reported financial results or news events which are more infrequent/rare but may have outsized impact on market prices.
Re:The Truth About Linear Regression (2015) by energy123 on Tuesday July 30, 2024 @07:51PM (#41115229)
If the distribution changes enough, multiple years of data may as well be no data.
Re:The Truth About Linear Regression (2015) by kqr on Wednesday July 31, 2024 @03:21AM (#41117055)
It sounds like you are assuming the joint distribution of returns in the future is equal to that of the past, and assuming away potential time dependence.

These may be valid assumptions, but even if they are, "sample size" is always relative to between-sample unit variance, and that variance can be quite large for financial data. In some cases even infinite!

Regarding relativity of sample size, see e.g. this upcoming article: https://two-wrongs.com/sample-unit-engineering