首页 > AI前沿 > Suppressing Misaligned Behaviors in Language Models, Durably

Suppressing Misaligned Behaviors in Language Models, Durably

arXiv自然语言 2026-11-04 02:54 4 阅读 查看原文

Undesired model behaviors can emerge or re-emerge at any stage of training. Once observed, how effectively can we suppress them? To study this question, we first construct two model organisms--language models deliberately trained to exhibit a specific misalignment--that differ in what triggers the behavior. The narrow-trigger organism misbehaves only when the prompt contains a specific cue: it cheats on multiple-choice questions by following a planted hint that points to a wrong answer, and behaves normally