#post-training
- 4 Aug 2026 · Paper summary
Paper summary: DAPD: Dual-Anchored Policy Distillation
On-policy self-distillation with a privileged teacher can cause "privilege illusion": the student acts as if it still had information it can't see at inference. DAPD anchors training along matched-information paths to prevent this.
- 29 Jan 2025 · Paper summary
Paper summary: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
On a card-arithmetic game and a real-world navigation task, models post-trained with RL generalise to unseen rule and visual variants, while SFT tends to memorise the training data.