#distillation

• 4 Aug 2026 · Paper summary

  Paper summary: DAPD: Dual-Anchored Policy Distillation

  On-policy self-distillation with a privileged teacher can cause "privilege illusion": the student acts as if it still had information it can't see at inference. DAPD anchors training along matched-information paths to prevent this.