News for hackers. Stuff that matters.

natufunu

Re:Tree Search Distillation for Language Models Using PPO on Sunday March 15, 2026 @02:20AM (#47384806)
Great post! I wonder why MCTS is not more popular as a test time compute harness. Did you compare performance of MCTS (without distillation) against other methods (eg best of N) with the same compute budget?
One thing I learned from this is that my prompts are much less detailed than what author has been using.

Very cool work and great write up.

Re:Hex: A Strategy Guide on Thursday March 24, 2022 @05:01AM (#30787568)
I wrote a hex AI with a couple of friends a few years back based on reinforcement learning.

https://cleeff.github.io/hex/

You move first and the ai might swap meaning that it steals your first move and you swap colors. This enforces you to pick an even opening.

I'm very bad at hex but it still was an awesome experience to observe the ai surpass my performance.