Re:Show HN: Fast Deep Reinforcement Learning Course
by sul_tasto on Friday June 03, 2022 @11:35PM
(#31616722)
Any references you have would be greatly appreciated.
Re:Show HN: Fast Deep Reinforcement Learning Course
by mywaifuismeta on Friday June 03, 2022 @11:47PM
(#31616791)
IMO the best intro book is Sutton's [1], it's extremely accessible (little math background needed) and covers all basic concepts. Work through David Silver's course (search youtube, it overlaps heavily with the book above) and then you are ready for something more advanced like [2] and you can start reading and implementing research papers.
Re:Show HN: Fast Deep Reinforcement Learning Course
by sul_tasto on Saturday June 04, 2022 @06:46AM
(#31618890)
this is exactly what i was hoping for- thank you!
Re:Show HN: Fast Deep Reinforcement Learning Course
by gh1 on Saturday June 04, 2022 @04:06AM
(#31618075)
I think the idea is not to replace learning the theory or math, but rather to just postpone it. Learning the practical aspects of an engineering discipline can provide the necessary motivation to study the theory/math, and this is the oft ignored factor. I also think there is some benefit in learning a topic using the tool that you will actually use in production (if that is possible without adding unnecessary complexity in the syllabus).
I personally learned DRL from David Silver's course and Sutton & Burto back in the days. They were the only good resources around and I liked them very much. But I think that with the advent of high-level frameworks in DRL, there are better learning paths.
I do intend to teach the theory/math in a later installment of this series, but I wanted to do it by showing students how to implement the various classes of algorithms e.g. Q-learning (DQN/Rainbow), policy gradients (PPO) and model-based (AlphaZero) using RLlib. This would kill two birds with one stone: you can simultaneously pick up the theory/math and the lower level API of the tool that you will be using in the future anyway.
These courses teach you how to call a library and use an API. You get nearly the same thing from just looking at the docs. Please don't say you "know RL" after this.