Background and Challenges
Long-horizon decision-making under sustained competition requires large language models (LLMs) to balance immediate investment with future resource needs. However, local success in multi-step interactions can not adequately capture cumulative decision effects or demonstrate long-term goal achievement under resource constraints and sustained competition.
Introduction to GM Bench
To address this gap, we introduce GM Bench, a benchmark for managing professional sports teams across seasons under resource constraints and competition among teams.
Environment Setup and Evaluation
We build the environment simulators for four sports and add financial constraints, player demands, and market mechanisms to establish a unified task across sports.
We evaluate competitive performance, cash reserves, and cross-season improvement across four sports.
Evaluation and Results
Diverse rosters of comparable strength are constructed from real-world player data, and each LLM is evaluated as a team general manager to assess its long-term management capabilities.
Over five NBA seasons, Claude Opus 5.5 ranks first among 29 LLMs, while GPT-6 Astra and GPT-6.1 Sol combine strong performance with larger cash reserves.