首页 > AI前沿 > MultiPartyTurnBench: Benchmarking Floor Control in Multi-Party Spoken Dialogue

MultiPartyTurnBench: Benchmarking Floor Control in Multi-Party Spoken Dialogue

arXiv自然语言 2026-10-14 21:20 5 阅读 查看原文

Full-duplex speech systems must decide when to enter, hold, or relinquish the conversational floor, even as multiple speakers overlap or backchannel without taking it.

Existing evaluations study dyadic turn-taking or end-to-end agent behavior, but lack a unified, controlled evaluation of genuine floor transitions against confusable non-events in multi-party settings.

We introduce MultiPartyTurnBench (MPTB), a benchmark of 240 synthetically generated, channel-separated conversations spanning two to five speakers and six interaction types.

MPTB evaluates two complementary tasks: End-of-Turn (EOT) detection distinguishes genuine turn completion from temporary holds, while Interruption (INT) detection distinguishes successful floor takeovers from non-floor-taking speech.

Exact event-conditioned annotations enable causal evaluation using false-positive-constrained recall and signed latency.

Across acoustic, semantic, and turn-projection baselines, we find a stark asymmetry: learned systems achieve 82.5-92.6% EOT recall at 4.3-11.8% false-positive rates, while INT detection suffers from missed takeovers or excessive false activations.

This asymmetry extends to five full-duplex agents which achieve 86.1-95.8% balanced accuracy on turn entry, yet perform near chance (46.9-54.7%) on selective interruption handling.

Gemini-3.8-Live yields to 97.7% of backchannels, whereas MiniCPM-o-4.5 yields to only 1.4% of genuine interruptions.

These findings establish selective floor control as a distinct, unresolved challenge for reliable multi-party voice interaction.