s-casci
Show HN: Train a GPT to write like Shakespeare-from scratch, in one Python file
Re:Show HN: Easily train AlphaZero-like agents on any environment you ...
on Wednesday December 20, 2023 @03:28PM (#38713196)
The policy function outputs the probability of taking every possible (legal or illegal) action. Once you have a way of indexing those actions, both the policy and the game need to refer to the same thing when indexing the same number
Re:Show HN: Easily train AlphaZero-like agents on any environment you ...
on Wednesday December 20, 2023 @01:17PM (#38711774)
Good catches, I've added the missing information. Thanks
Re:Show HN: Easily train AlphaZero-like agents on any environment you ...
on Wednesday December 20, 2023 @12:05PM (#38710878)
AlphaZero has been made for perfect information games. That said, the Monte Carlo Tree Search in the library can be run with any agent that implements a value and policy function. So, while the AlphaZeroAgent in agents.py wouldn't fit the problem you are describing, implementing something like Meta's ReBeL (https://ai.meta.com/blog/rebel-a-general-game-playing-ai-bot...) shouldn't be an impossible task. The Monte Carlo Tree Search algorithm in mcts.py has been written to be modular from the start exactly to do something like this!
Re:Show HN: Easily train AlphaZero-like agents on any environment you ...
on Wednesday December 20, 2023 @11:57AM (#38710774)
Interesting, I didn't know about it... Modifying the existing environments' interfaces shouldn't be too difficult. Feel free to submit a PR!
Re:Show HN: Easily train AlphaZero-like agents on any environment you ...
on Wednesday December 20, 2023 @11:35AM (#38710496)
There certainly are other projects around AlphaZero, I'd say this is simpler and much more basic
Re:Show HN: Easily train AlphaZero-like agents on any environment you ...
on Wednesday December 20, 2023 @11:29AM (#38710414)
If you do that, please submit a PR!