首页 > AI前沿 > Retrieve What Helps, Only When It Helps: Agentic Reinforcement Learning for Selective Retrieval-Augmented Machine Translation

Retrieve What Helps, Only When It Helps: Agentic Reinforcement Learning for Selective Retrieval-Augmented Machine Translation

arXiv自然语言 2026-10-14 11:45 4 阅读 查看原文

Retrieving external knowledge can improve large language model (LLM) translation by providing supplementary information such as idiom interpretations and terminology.

However, existing retrieval-augmented machine translation systems typically apply predefined retrieval strategies uniformly across all inputs.

We argue that translation operates in a partial-evidence regime: LLM's parametric knowledge suffices for many inputs, while external evidence benefits a subset and usually supports rather than directly provides the desired translation.

This creates two challenges: deciding when to retrieve and what evidence to acquire.

Introducing Selective Retrieval-Augmented Translation (SRAT)

We introduce Selective Retrieval-Augmented Translation (SRAT), an agentic reinforcement learning framework that learns when to translate directly or retrieve, what to retrieve, and how to integrate these decisions by optimizing final translation quality.

To align evidence retrieval with downstream translation quality rather than simple semantic similarity, we further develop joint Plackett--Luce optimization and translation-quality contrastive training for retriever-training.

Experiments and Results

Experiments on idiom, knowledge-intensive, and document-level translation with offline or online retrieval show that SRAT consistently outperforms never- and always-retrieve baselines.

Quality-aligned retriever training provides further gains when similarity-based retrieval is insufficient.

The results demonstrate the benefit of treating retrieval as a learnable translation action rather than fixed preprocessing.