A Deep Dive Into Policy Gradient Methods



Policy gradient methods are the current state-of-the art reinforcement learning algorithms. However, it’s not always easy to parse all of the mathematics. In this long post, I will do a deep dive into policy gradients methods, culminating in the derivation and implementation of the state-of-the-art TRPO and PPO algorithms.