optimistic follow-the-regularized-leader

Fast Last-Iterate Convergence of Learning in Games Requires Forgetful Algorithms
arxiv