Policy Gradient Algorithms
Lilian Weng
A blog post documents policy gradient algorithms, a class of reinforcement learning methods, with updates tracking the addition of new algorithms including SAC, D4PG, TD3, SVPG, IMPALA, and PPG between 2018 and 2021. The post was translated into Korean and Chinese versions. This is a technical reference document on machine learning research rather than reporting on a specific development or discovery.
Why it matters
[Updated on 2018-06-30: add two new policy gradient methods, SAC and D4PG.] [Updated on 2018-09-30: add a new policy gradient method, TD3.] [Updated on 2019-02-09: add SAC with automatically adjusted temperature]. [Updated on 2019-06-26: Thanks to Chanseok, we have a version of this post in Korean]. [Updated on 2019-09-12: add a new policy gradient method SVPG.] [Updated on 2019-12-22: add a new policy gradient method IMPALA.] [Updated on 2020-10-15: add a new policy gradient method PPG & some new discussion in PPO.] [Updated on 2021-09-19: Thanks to Wenhao & 爱吃猫的鱼, we have this post in Chinese1 & Chinese2].
