News for hackers. Stuff that matters.
Re:The Multi-Armed Bandit Problem by mcpherrinm on Saturday April 06, 2013 @10:22PM (#5505856)
Eugh, this website has custom behavior for the left-right arrow keys, which breaks the back keyboard shortcut in Firefox (alt+left arrow key). Non-standard navigation on a page that IMHO doesn't need it.
Re:The Multi-Armed Bandit Problem by triplesec on Saturday April 06, 2013 @11:08PM (#5505942)
spacebar scrolling also broken in ff. grrrrr
Re:The Multi-Armed Bandit Problem by zenburnmyface on Sunday April 07, 2013 @12:33AM (#5506118)
haha ironically left-arrow right-arrow replace space-bar scroll.
Re:The Multi-Armed Bandit Problem by mailshanx on Sunday April 07, 2013 @08:06AM (#5506920)
Just had a look at your book, and it looks amazing! Hope you will complete it:D

On a separate note, im surprised that in the many discussion of the MAB problem on HN, the Gittins index was never mentioned. Under certain (mild) assumptions on reward distributions, the GI gives a provably optimal solution to the MAB problem...

Re:The Multi-Armed Bandit Problem by bun-neh on Saturday April 06, 2013 @08:56PM (#5505672)
One thing to expand upon: This is just the classic formulation of the Multi-Armed Bandit Problem. There are countless variations to the formula which have slightly different underlying assumptions.
Re:The Multi-Armed Bandit Problem by spitfire on Saturday April 06, 2013 @07:21PM (#5505438)
Good article.

I'd like to know what he used to output those graphs.

Re:The Multi-Armed Bandit Problem by zenburnyourface on Saturday April 06, 2013 @07:45PM (#5505504)
It uses Python's Matplotlib with a custom styling, available here: https://github.com/CamDavidsonPilon/Probabilistic-Programmin...
Re:The Multi-Armed Bandit Problem by spitfire on Saturday April 06, 2013 @08:34PM (#5505620)
Thanks! I quite like the output. Are you the author?

If soI took a quick look at your book and it looks excellent.

https://github.com/CamDavidsonPilon/Probabilistic-Programmin...

Re:The Multi-Armed Bandit Problem by zenburnmyface on Saturday April 06, 2013 @08:42PM (#5505644)
I am the author. Thanks, I appreciate that!