Faulty reward functions in the wild

Reinforcement Learning Can Break in Surprising Ways

Reinforcement learning algorithms can break in surprising, counterintuitive ways. In this post we’ll explore one failure mode, which is where you misspecify your reward function.