Re:List of probability distributions
by yummyfajitas on Saturday May 25, 2013 @09:18AM
(#5767185)
The beta distribution is fantastically useful for modelling conversion rates. I'll take this opportunity to shamelessly plug a blog post I wrote about it last week.
http://www.chrisstucchio.com/blog/2013/bayesian_analysis_con...
If you do that a lot, Adaptive Rejection Sampling (or some variant if it's not log-concave) may be useful; it builds up the rejection envelope while trying to sample and often succeed in 5-10 evaluations.
My thoughts on the matter are affected by nonparametric and Bayesian methods. Binomial and beta rule, most others drool.
What I can say is more than half the time that people are messing around with parametric statistics they don't quite understand what they're doing and they end up voiding the warrantee on at least one of the distributions or methods that they use.
If you aren't reading probability from a textbook, this article isn't going to tell you which distributions are the most useful. The Beta Distribution receives half the amount of space as the Dirac delta function, but for you folks who want to take a Bayesian approach to A/B testing, the beta is going to be far more useful (The beta is the conjugate prior to the binomial) than the dirac, though one might argue that the Dirac is interesting from a mathematical perspective, it being a degenerate distribution and all...
It turns out though that many of the "useful" distributions (by which I mean the ones that many classical problems were devoted to) share very similar properties. If your aim is to get familiar with the most common distributions encountered in the wild, the article on the exponential family will serve you better than this overwhelming article.
http://en.wikipedia.org/wiki/Exponential_family