首页 > AI前沿 > Hallucination-R1: Robustness-Oriented Paraphrase Generation for Factual Consistency

Hallucination-R1: Robustness-Oriented Paraphrase Generation for Factual Consistency

arXiv自然语言 2026-09-18 10:16 11 阅读 查看原文

Factual hallucination is commonly defined by incorrect factual outputs.

We study a paraphrase-induced hallucination setting, where a model answers a factual question correctly in its original form but generates an incorrect answer under a semantically equivalent paraphrase.

Such inconsistencies expose latent factual instability under semantic invariance.

However, general-purpose paraphrases are often insufficient as robustness-oriented supervision: near-copy paraphrases provide weak signals, while overly diverse paraphrases may break semantic equivalence.

In this paper, we propose HALLUCINATION-R1, a robustness-oriented paraphrase generation framework that learns to produce semantically faithful yet robustness-challenging paraphrases for factual consistency.

Through two-stage optimization, it first stabilizes meaning-preserving and diverse paraphrasing, then rewards paraphrases that reveal factual consistency degradation in downstream QA models.

Experiments

Experiments on SimpleQuestions, PopQA, and TruthfulQA show that HALLUCINATION-R1 achieves a strong consistency--diversity trade-off and exposes robustness failures across multiple model families and datasets.

Further analyses indicate that these failures are not reducible to surface-level artifacts or semantic drift, but reveal non-trivial factual instability under meaning-preserving variation.

Lightweight Fine-tuning Study

A lightweight fine-tuning study also shows that HALLUCINATION-R1-generated data improves robust accuracy under paraphrase variations, suggesting its utility for robustness-oriented training.

Our code and models are publicly available at https://github.com/yuwenhan07/Hallucination-R1.