Re:Ask HN: Best place to start learning about Markov Chains?
by larrydag on Thursday April 11, 2019 @10:12AM
(#19634700)
While I agree with the progression of knowledge listed here I don't think it requires 3 years of foundation to math. If you have a basic understanding of math already you should be able to pick up the theory fairly well in a couple of months of research and application.
Re:Ask HN: Best place to start learning about Markov Chains?
by usgroup on Thursday April 11, 2019 @11:53AM
(#19635880)
I think when you get out of the basic linear algebra and calculus prerequisite and into the analysis and measure theory prerequisite nothing takes a few months anymore :)
Re:Ask HN: Best place to start learning about Markov Chains?
by joker3 on Thursday April 11, 2019 @12:17PM
(#19636160)
You don't need much math to pick up the very basic theory, but after a certain point you're going to hit a hard wall unless you have a strong background in analysis.
Re:Ask HN: Best place to start learning about Markov Chains?
by soVeryTired on Thursday April 11, 2019 @11:35AM
(#19635641)
Poisson processes are continuous time though. If you're interested in Markov chains you only need the discrete-time theory.
In discrete time and discrete space, it mostly just reduces to linear algebra.
Re:Ask HN: Best place to start learning about Markov Chains?
by graycat on Thursday April 11, 2019 @01:22PM
(#19636914)
No, can do continuous time discrete state space theory -- the jumps in the discrete state space are at the arrival times of the Poisson process -- that works out easily enough, especially if using Monte-Carlo. See my other post here on Red/Blue stuff.
Re:Ask HN: Best place to start learning about Markov Chains?
by usgroup on Thursday April 11, 2019 @11:52AM
(#19635862)
Unless you’re interested in continuous markov chains, infinite state spaces, renewal theory, excessive functions, and so on.
Re:Ask HN: Best place to start learning about Markov Chains?
by exelius on Thursday April 11, 2019 @10:18AM
(#19634746)
That whole math sequence was part of my MBA program that culminated in Markov chains for synthetic options pricing after like, 9 months. And this is for business school students; not engineers :)
Re:Ask HN: Best place to start learning about Markov Chains?
by usgroup on Thursday April 11, 2019 @11:55AM
(#19635923)
Sure, and for any given application it’ll be possible to explain Markov chains as they apply to it. I recently did a financial valuation course where we did an “intuitive derivation of Itos formula” so that we could skip the measure theory prerequisites. We also skipped talking about Reimann integrals and just accepted that sums are integrals at a limit ... we also glossed the separating hyperplane theorem so that we could say “no arb iff risk neutral measure exists”, and so on.
However, if you actually want a background in the theory of Markov chains, I don’t think this approach works.
2. Poisson processes.
3. The Markov property.
4. Stochastic processes.
5. Realise that you’re missing a background in analysis, therefore you don’t know sh?t about measure theory but you actually need it to know anything deeper . Wonder to yourself if you really want to spend the next 3 years getting a maths background you don’t have.
6. Convince yourself that it’s all just engineering and middle through by picking a project involving non trivial markov chain.
7. Go back and spend 3 years doing foundational maths then repeat point 1-5.