Re:Sukhotin's Algorithm
by tudorachim on Wednesday July 07, 2010 @05:33PM
(#1495563)
There is a much more straightforward and principled way: the Metropolis algorithm (http://en.wikipedia.org/wiki/Metropolis%E2%80%93Hastings_alg...). You are basically sampling from the distribution of n-gram likelihoods by following a markov chain. Here is a javascript implementation: http://www.andrew.cmu.edu/user/tachim/page.html
[ Parent
| on HN ]
Re:Sukhotin's Algorithm
by abecedarius on Wednesday July 07, 2010 @08:22PM
(#1496027)
See also http://norvig.com/ngrams/ for Python. Random-restart hillclimbing instead of Metropolis.