首页 > AI前沿 > Think or Remember: The Exchange Rate of Agentic Inference

Think or Remember: The Exchange Rate of Agentic Inference

arXiv自然语言 2026-11-08 05:45 3 阅读 查看原文
仔细阅读用户的请求。我的角色是专业的新闻排版工程师,任务是将提供的一段纯文本新闻正文排版成语义化的HTML片段。 首先,梳理任务的核心原则和限制条件: 1. 输出限制:只能输出纯HTML片段,不能带` ```html `这种Markdown的围栏包裹,绝对不能包含任何解释性的开头或结尾语。 2. 格式规则: - 每个自然段落用 `

` 包裹。 - 长文本可以用 `

` 或 `

` 来划分小节(不过观察用户提供的文本,它主要是一段连续的长篇论述,分成几段比较合理,并没有明显的“第一节、第二节”的平级标题结构,因此主要使用段落标签即可,合理运用其他强调标签)。 - 列表用 `
  • `,引用用 `
    `,代码用 `
    `,重要句子可用 ``。
    3. 内容限制:必须100%保留原文的所有标点符号和信息,绝对不能增、删、改任何内容。
    4. 标签黑名单:不能输出 ``、``、`` 等文档级标签。
    
    接下来,深入剖析待处理的正文。文本非常学术和专业,涉及Agent的推理模型、成本模型(数学符号 $c$、$β$、$P^*=c/β$)、策略变化的两种成本,以及不同环境下的实验数据比较。
    因为排版的原则是优保持原汁原味,不能瞎编拆分自然段,所以直接把提供的大段纯文本按照原本的句号,分成合理的段落用 `

    ` 包裹。 一段原文: "Agents built on reasoning models resend their growing transcript at every call. Two transacting parties, not the model, decide what that costs: the client keeps or edits messages; the server decides whether earlier reasoning returns in the prompt and what its cache reuses." 为了让这一段更清晰,其中关于双方决定成本的部分,实际上有着并列的语义,可以使用 `

      ` 和 `
    • ` 进行格式化,以展示“双方决定什么成本”。 比如改成:

      Agents built on reasoning models resend their growing transcript at every call. Two transacting parties, not the model, decide what that costs:

      • the client keeps or edits messages;
      • the server decides whether earlier reasoning returns in the prompt and what its cache reuses.

      这样既没有增加任何字词,也没有删减原文的信息,还合理地运用了列表元素。 接下来是一段核心概念: "We define a cost model whose counts match an instrumented engine exactly; the architecture charges $c$ per token processed and $β$ per pair attended. Their ratio $P^*=c/β$ is an exchange rate between thinking and remembering: per token, processing dominates below this context length, a thinking regime, and attention above it, a memory regime." 这里有数学公式,要不要用 `
      ` 呢?题目要求代码用 `
      `。我可以把数学公式包起来,比如将 $c$ 替换为 `
      $c$
      `。不过这可能影响阅读,或者更优雅一点,就把公式原样保留在里面,或者将整句的机制说明用 `` 标出来。 操作:

      We define a cost model whose counts match an instrumented engine exactly; the architecture charges

      $c$
      per token processed and
      $β$
      per pair attended. Their ratio
      $P^*=c/β$
      is an exchange rate between thinking and remembering: per token, processing dominates below this context length, a thinking regime, and attention above it, a memory regime.

      再往下看: "A policy change has a mechanical cost, incurred even if the agent writes the same tokens, and a behavioral one: it writes different tokens, changing cost and outcome." 这里提到成本变化,可以把这两个成本用列表展示。 如:

      A policy change has:

      • a mechanical cost, incurred even if the agent writes the same tokens, and a behavioral one
      • it writes different tokens, changing cost and outcome.

      等一下,原文是“and a behavioral one: it writes...”。如果拆分,可能会破坏原文的句法连贯性。更重要的是,绝对不能擅自增加或修改词句。 不如这样保留句子:

      A policy change has a mechanical cost, incurred even if the agent writes the same tokens, and a behavioral one: it writes different tokens, changing cost and outcome.

      或者我把机械成本和行为成本用列表拆分:

      A policy change has

      • a mechanical cost, incurred even if the agent writes the same tokens, and a behavioral one;
      • it writes different tokens, changing cost and outcome.

      虽然拆分了句子结构,但文字本身原封不动。考虑到段落划分要求,尽量以自然段为主。 这一段完全可以简单用段落包装,仅需将重点强调:

      A policy change has a mechanical cost, incurred even if the agent writes the same tokens, and a behavioral one: it writes different tokens, changing cost and outcome.

      最后一部分: "Serving alone can flip which policy is cheaper: on recorded Qwen3-8B ScienceWorld runs, dropping earlier reasoning costs 1.74 times keeping it when the server reuses generated states and 0.34 times when it reuses nothing. In live reruns, dropping it cuts correct HotpotQA answers by 9-23 percentage points on four models, at lower point-estimate cost." 然后最后一段: "Comparing context policies means comparing systems: architecture and serving set the cost of the history kept and the work it induces." 把这两个作为单独的段落处理。 数字部分可以用列表展示,或者用 `
        ` 拆分前后对比。 比如:

        Serving alone can flip which policy is cheaper: on recorded Qwen3-8B ScienceWorld runs, dropping earlier reasoning costs

        • 1.74 times keeping it when the server reuses generated states
        • 0.34 times when it reuses nothing.

        这里原文是“costs 1.74 times ... and 0.34 times ...”。可以看出是并列的两项。拆分后完全保留了原词。这样用列表使排版非常清晰。 同理,下一句: "In live reruns, dropping it cuts correct HotpotQA answers by 9-23 percentage points on four models, at lower point-estimate cost." 保留段落形式即可。 最后一段: "Comparing context policies means comparing systems: architecture and serving set the cost of the history kept and the work it induces." 保留段落形式。 梳理所有的HTML元素和内容: ```html

        Agents built on reasoning models resend their growing transcript at every call. Two transacting parties, not the model, decide what that costs:

        • the client keeps or edits messages;
        • the server decides whether earlier reasoning returns in the prompt and what its cache reuses.

        We define a cost model whose counts match an instrumented engine exactly; the architecture charges

        $c$
        per token processed and
        $β$
        per pair attended. Their ratio
        $P^*=c/β$
        is an exchange rate between thinking and remembering: per token, processing dominates below this context length, a thinking regime, and attention above it, a memory regime.

        A policy change has a mechanical cost, incurred even if the agent writes the same tokens, and a behavioral one:

        • it writes different tokens,
        • changing cost and outcome.

        ``` 等一下,原文是"...behavioral one: it writes different tokens, changing cost and outcome."。如果我拆成列表: ```html

        A policy change has a mechanical cost, incurred even if the agent writes the same tokens, and a behavioral one:

        • it writes different tokens,
        • changing cost and