首页 > AI前沿 > Black-Box Uncertainty Quantification for Large Language Models via Ensemble-of-Ensembles

Black-Box Uncertainty Quantification for Large Language Models via Ensemble-of-Ensembles

arXiv机器学习 2026-11-14 01:26 21 阅读 查看原文

Reliable use of large language models (LLMs) requires uncertainty estimates that separate ambiguity intrinsic to a prompt from genuine knowledge gaps. Bayesian and deep-ensemble methods deliver this aleatoric/epistemic decomposition in principle, but are computationally prohibitive at LLM scale and require white-box access. Existing black-box methods, in contrast, summarize to a single scalar that cannot make the distinction. We introduce a two-level ensemble that bridges this gap. Stochastic decoding of a fixed prompt forms the inner ensemble; meaning-preserving