#distributed-training

• 10 Sept 2025 · Paper summary

  Paper summary: Sharing is Caring: Efficient LM Post-Training with Collective RL Experience Sharing

  SAPO is a fully decentralised, asynchronous RL post-training method in which many heterogeneous nodes train their own models but share rollouts, reporting up to 94% higher cumulative reward in controlled tests.