OpenAI Baselines: ACKTR & A2C

OpenAI · 9 years ago · 39

OpenAI released two new reinforcement learning algorithm implementations: A2C, a synchronous version of A3C that performs equally well, and ACKTR, which improves sample efficiency over both TRPO and A2C. ACKTR requires only marginally more computation per update than A2C while achieving better sample efficiency. These implementations are now available in OpenAI Baselines, giving researchers easier access to these algorithms for training reinforcement learning agents.