首页 > AI前沿 > What Changed? Drift Detection with Real, Virtual, and Incomparable Diagnosis

What Changed? Drift Detection with Real, Virtual, and Incomparable Diagnosis

arXiv机器学习 2026-08-20 18:59 6 阅读 查看原文

Sharing a deep encoder does not, by itself, fix the central confound of task-comparison scores.

We show that cross-evaluated heads on a frozen shared representation inherit the extrapolation confound of shallow exchange scores:

  • pure input rotations with fixed labels inflate a deep exchange score from about 0 to 0.80,
  • while representation-novelty scores are blind in the complementary direction (flat under label permutations that change the task completely).

Transplanting a conditional two-discriminator discrepancy into the embedding space resolves both blind spots:

  • the functional axis stays within +-0.001 under rotations and tracks label-permutation drift mass monotonically.

Built into a mixture-of-heads lifecycle, the two-axis gate attains better decision quality with fewer heads than exchange or novelty triggers at a matched training budget.

On generalized category discovery, the same chunk-level functional axis separates semantic novelty from photometric shift with AUROC 0.98-0.99 where per-input OOD scores (MSP, Energy, Mahalanobis, KNN) sit near chance for that distinction.

All findings replicate across frozen ImageNet-21k ViT-B/16 and self-supervised DINOv2 backbones on CIFAR-100, and extend to residual adapter pools with recurrence, where a null-calibrated novelty trigger never fires on mechanism changes while the two-axis gate handles them with full recurrence reuse.

We state explicitly the common-factoring condition under which embedding-space conclusions transfer to the original mechanism.