首页 > AI前沿 > Two stealth models just appeared on the leaderboard, both ahead of Fable 5.2

Two stealth models just appeared on the leaderboard, both ahead of Fable 5.2

Hacker News 2026-11-19 19:03 24 阅读 查看原文
Deconstructing Real World Creativity. Exploring the frontier of AI design capabilities through real client briefs from Contra’s marketplace, golden designs and model comparisons. Leaderboard How frontier models rank in blind head-to-head votes on real client briefs from Contra’s marketplace. Elo ratingElo Design critiqueCritique Slop DetectorSlop Frontier Design Benchmark Elo rating from blind head-to-head votes Gestalt Human golden Claude Fable 5.2 Claude Opus 5.5 GPT-6.1 Sol Claude Sonnet 5.5 Kimi K3.1 Pro GPT-6 Astra Qwen3.8 Max Kimi K3 GLM-5.3 Prime Gemini 4 Carbon Muse Spark 1.3 Muse Wonder Grok 4.7 Gemini 4 Argon DeepSeek V4 Pro contralabs.com/frontierdesign Real design projects, judged by designers and scored by rubrics Frontier Design Benchmark is the first benchmark built on real world, high value, and complex design projects. It is judged by professional designers in the Contra Labs network, ensuring the quality of evaluation. In the benchmark, we also built a design critique rubric and a list of AI slop patterns. The rubric scores are highly correlated with the designers’ ratings of the models (r = 0.94). These additional metrics provide explainable design quality judgement on top of pairwise preferences. Golden Gallery Real client briefs, each with its golden: the design set beside the models’ outputs as the bar. Read the research Frontier Design: Evaluating AI on Real World Design Tasks How design jobs are set, reviewed, and evaluated Pairwise, design rubrics, and AI slop patterns Your vote ranks the models Two model outputs for the same brief, live and side by side, without the models’ names. Pick the better one, or call a tie. Drag the details Deconstructing Real World Creativity. Exploring the frontier of AI design capabilities through real client briefs from Contra’s marketplace, golden designs and model comparisons. Leaderboard How frontier models rank in blind head-to-head votes on real client briefs from Contra’s marketplace. Real design projects, judged by designers and scored by rubrics Frontier Design Benchmark is the first benchmark built on real world, high value, and complex design projects. It is judged by professional designers in the Contra Labs network, ensuring the quality of evaluation. In the benchmark, we also built a design critique rubric and a list of AI slop patterns. The rubric scores are highly correlated with the designers’ ratings of the models (r = 0.94). These additional metrics provide explainable design quality judgement on top of pairwise preferences. Golden Gallery Real client briefs, each with its golden: the design set beside the models’ outputs as the bar. Read the research Frontier Design: Evaluating AI on Real World Design Tasks How design jobs are set, reviewed, and evaluated Pairwise, design rubrics, and AI slop patterns