背景与动机
The decoding order...how useful revealing that position will be for subsequent decoding.
方法:Cord策略
We propose Cord...evolving partial response.
Rather than sampling...backbone updates.
实验结果
Across three dLLMs...best per-domain fixed residual.
行为审计与效率
Behavioral audits show...inference latency overhead.
但等一下,要求是“保留原文所有信息,不得增删改内容”,加h2的标题算不算增?不对,规则2说“长文用/
划分小节”,但原文没有小节标题,那是不是可以不加?或者因为原文是长段落,需要拆分?不对,再看规则2:“每个自然段落用
包裹,长文用
/
划分小节”,也就是说,如果原文有自然的长文,用h2/h3,但原文没有小节,所以可能直接拆成几个p?不对,原文是一个连贯的段落,但可以按内容拆分p吗?比如:
The decoding order of masked diffusion language models (dLLMs) can substantially affect generation quality, yet common decoders typically apply the same reveal rule throughout generation. Confidence provides a strong default, but it measures how decisively a position can be predicted now, not how useful revealing that position will be for subsequent decoding.
We propose Cord, a lightweight prompt-conditioned policy that retains confidence decoding as a stable reference and learns when and how to depart from it through geometric residuals over generation direction, proximity to revealed context, and two-sided infilling. The residuals adapt to both the prompt and the evolving partial response.
Rather than sampling a new policy action at every decoding step, Cord samples a single low-dimensional coefficient matrix per rollout, which induces an entire state-dependent reveal trajectory. This yields a contextual-bandit formulation trained directly from sequence-level rewards, without step-level credit assignment or backbone updates.
Across three dLLMs and five reasoning, code, and constraint-satisfaction benchmarks, Cord improves average task success from 32.0% under confidence decoding to 48.2%, and further improves over the best per-domain fixed residual. Behavioral audits show that the learned residuals induce substantial, task-dependent changes in reveal locality and two-sided infilling.
Cord adds only $0.53$M trainable parameters, requires no additional backbone forward passes, and incurs only 5.39% inference latency overhead.
这样拆分是按内容逻辑,每个p是一个小的主题,符合要求。然后检查有没有需要用其他标签的地方:比如重要句子用strong,比如“substantially affect generation quality”“Confidence provides a strong default”“Cord”第一次出现可以加strong吗?规则3说重要句子可用strong,所以比如第一次出现Cord可以加Cord,还有“retains confidence decoding as a stable reference”“samples a single low-dimensional coefficient matrix per rollout”“contextual-bandit formulation”“sequence-level rewards”“improves average task success from 32.0% under confidence decoding to 48.2%”“substantial, task-dependent changes in reveal locality and two-sided infilling”“only $0.53$M trainable parameters”“no additional backbone forward passes”“only 5.39% inference latency overhead”这些重要的点可以用strong。比如: 第一个p里:The decoding order of masked diffusion language models (dLLMs) can substantially affect generation quality, yet common decoders typically apply the same reveal rule throughout generation. Confidence provides a strong default, but it measures how decisively a position can be predicted now, not how useful revealing that position will be for subsequent decoding. 第二个p里:We propose Cord, a lightweight prompt-conditioned policy that retains confidence decoding as a stable reference and learns when and how to depart from it through geometric residuals over generation direction, proximity to revealed context, and two-sided infilling. The residuals adapt to both the prompt and the evolving partial response. 第三个p里:Rather than sampling a new policy action at every decoding step, Cord samples a single low-dimensional coefficient matrix per rollout, which induces an entire state-dependent reveal trajectory. This yields a contextual-bandit formulation trained directly from sequence-level rewards, without step-level credit assignment or backbone updates. 第四个p里:Across three dLLMs and five reasoning, code, and constraint-satisfaction benchmarks, Cord improves average task success from 32.0% under confidence decoding to 48.2%, and further improves over the best per-domain fixed residual. Behavioral audits show that the learned residuals induce substantial, task-dependent changes in reveal locality and two-sided infilling. 第五个p里:Cord adds only $0.53$M trainable parameters, requires no additional backbone forward passes, and incurs only 5.39% inference latency overhead. 这样符合规则3的重要句子用strong。然后检查有没有列表、引用、代码,这里没有,所以不用。最后组合起来就是:The decoding order of masked diffusion language models (dLLMs) can substantially affect generation quality, yet common decoders typically apply the same reveal rule throughout generation. Confidence provides a strong default, but it measures how decisively a position can be predicted now, not how useful revealing that position will be for subsequent decoding.
We propose Cord, a lightweight prompt-conditioned policy that retains confidence decoding as a stable reference and learns when and how to depart from it through geometric residuals over generation direction, proximity to revealed context, and two-sided infilling. The residuals adapt to both the prompt and the evolving partial response.
Rather than sampling a new policy action at every decoding step, Cord samples a single low-dimensional coefficient matrix per rollout, which induces an entire state-dependent reveal trajectory. This yields a