GSPO: Group Sequence Policy Optimization for stable RL scaling

Qwen published GSPO (Group Sequence Policy Optimization), a new reinforcement learning algorithm designed to address training instability in existing RL methods like GRPO. The paper identifies that existing algorithms exhibit severe instability during long training runs leading to irreversible model collapse, and proposes GSPO as a more stable alternative for scaling RL-based language model training.