首页 > AI前沿 > DISCOVER: Online Variance-Guided Data Discovery for Budgeted Multimodal GRPO

DISCOVER: Online Variance-Guided Data Discovery for Budgeted Multimodal GRPO

arXiv机器学习 2026-11-08 13:27 3 阅读 查看原文

Recent advances in reinforcement learning have made verifiable rewards a central post-training paradigm for improving multimodal reasoning. However, methods such as GRPO remain data- and compute-inefficient, spending rollout and annotation budget on prompts that provide little learning signal.

We propose DISCOVER, an online data-discovery framework for budgeted multimodal GRPO that enables vision-language models to dynamically identify prompts that are most useful for the current policy.

DISCOVER first organizes the multimodal sample pool into