Self-Play Catapults Dota 2 Performance to Superhuman Levels
Our Dota 2 result shows that self-play can catapult the performance of machine learning systems from far below human level to superhuman, given sufficient compute.
In the span of a month, our system went from barely matching a high-ranked player to beating the top pros and has continued to improve since then.
Key Insight: Beyond Supervised Learning
Supervised deep learning systems can only be as good as their training datasets, but in self-play systems, the available data improves automatically as the agent gets better.