SU-01, a 30B-A3B model, achieves gold-medal-level olympiad reasoning through a three-stage pipeline (SFT, RL, test-time scaling). It reaches 35 points on IMO 2025 and USAMO 2026, matching the IMO gold line and exceeding USAMO gold by 10 points—matching the highest human score among 340 competitors.
论文原始摘要
Recent progress in reasoning models has substantially advanced long-horizon mathematical and scientific problem solving, with several systems now reaching gold-medal-level performance on International Mathematical Olympiad (IMO) and International Physics Olympiad (IPhO) problems. In this paper, we introduce a simple and unified recipe for converting a post-trained reasoning backbone into a rigorous olympiad-level solver. The recipe first uses a reverse-perplexity curriculum for SFT to instill rigorous proof-search and self-checking behaviors, then scales these behaviors through a two-stage RL pipeline that progresses from RL with verifiable rewards to more delicate proof-level RL, and finally boosts solving performance with test-time scaling. Applying this recipe, we train a 30B-A3B backbone with SFT on around 340K sub-8K-token trajectories followed by 200 RL steps. The resulting model, SU-01, supports stable reasoning on difficult problems with trajectories exceeding 100K tokens, while achieving gold-medal-level performance on mathematical and physical olympiad competitions, including IMO 2025/USAMO 2026 and IPhO 2024/2025. It also demonstrates strong generalization of scientific reasoning to domains beyond mathematics and physics.
Paper Collector 中文速览
提出统一训练配方实现奥数金牌级推理
方法概述
先通过逆向困惑度课程SFT灌输证明搜索和自检行为,再用两阶段RL从可验证奖励扩展到证明级RL,最后测试时扩展提升性能
核心贡献
提出逆向困惑度SFT课程+两阶段RL+测试时扩展的统一配方,训练出稳定支持100K+token推理的金牌级竞赛模型
原始来源与核验范围
核验仅覆盖论文正文中的主张、证据片段和参考文献关系。NGJOO 未独立运行作者代码、重做实验或验证真实部署效果;页面中的可复现性分数是文档完整度评估,不是复现实验结果。
核心问题
Can a compact 30B-A3B model achieve gold-medal-level performance on mathematical olympiad problems through a simple, unified training pipeline?
核心方法
The authors develop a three-stage pipeline starting from P1-30B-A3B: (1) Supervised Fine-Tuning with reverse-perplexity curriculum on 338K trajectories to reshape reasoning behavior, (2) Reinforcement Learning split into coarse RL using GSPO for answer-seeking and refined RL with generative proof rewards for proof quality, and (3) Test-Time Scaling with iterative solve-verify-refine loops allocating additional inference compute.
方法组件
- Inference is organized as an iterative solve-verify-refine procedure with maximum generation length of 160,000 tokens.
- Explicit stopping rules include 5 consecutive verification passes for acceptance and 10 consecutive failures for early termination.
- Each problem allows at most 10 independent runs with 30 solve-verify-refine cycles per run.
- The DeepSeekMath-V2 reward server uses speculative decoding with 3-step scheme and 4 draft tokens per step.
- Different maximum generation lengths are used for different benchmarks, ranging from 131K to 256K tokens.
- The comparison uses public technical reports, official model cards, and official benchmark reports.
- The larger-model group contains DeepSeek-V3.2, GPT-5.5, and Gemini 3.1 Pro Thinking.
- The similar-size group contains GLM-4.7-Flash, Nemotron-Cascade-2-30B-A3B, Qwen3.6-35B-A3B, Gemma-4-31B, and SU-01.
- GPT-5.5-High is the high-reasoning variant of GPT-5.5, and Gemini 3.1 Pro Thinking is from the Gemini 3.1 Pro family.
- The section lists model-generated solutions for human-expert scoring in Table 4.
论点验证
The reverse-perplexity curriculum is fully specified in Section 2.3 and empirically validated in Section 6.3 with controlled comparisons showing descending-PPL ordering outperforms random and low-PPL-first orderings with specific numerical results.
Specific numerical results are provided: 35 points on both IMO 2025 and USAMO 2026 with TTS, meeting the IMO gold line exactly and exceeding USAMO gold line by 10 points. The paper provides context for these achievements.
The paper provides specific context: USAMO 2026 had 340 competitors with maximum score of 35, and SU-01's TTS score of 35 matches this highest reported human total. This is a concrete, verifiable claim with specific numbers.
This is a design choice with referenced justification. The paper cites Chen et al. 2025 for P1-30B-A3B's competitive performance in scientific reasoning. As a design choice with external citation, this is adequately supported.
The paper states this as an empirical finding but provides no controlled experiment comparing SFT on post-trained vs. base model. No ablation study or comparative data is shown. This is an assertion without supporting experimental evidence.
This is a straightforward design choice with specific numbers stated in multiple locations. The 338K trajectories and 8K token limit are clearly specified.
This is a design choice with clear justification. The filtering criteria (noisy generations, >8192 tokens) and rationale (focused signal, avoiding truncation/instability) are explicitly stated.
The paper states this as an empirical finding but provides no controlled experiment comparing different epoch counts. No ablation showing performance at 1, 2, 3, 4+ epochs is presented. This is an assertion without supporting experimental data.
The reverse-perplexity curriculum is a methodological contribution that is fully specified with mathematical formulation and empirically validated through controlled comparison in Section 6.3.
This is a design choice that is fully specified. The two-level RL structure (coarse and refined) is described in detail with specific objectives and mechanisms for each level.
This is a straightforward design choice with specific numbers clearly stated.
... 共 53 个论点
可复现性评估
较低可复现性 (0%)
缺失的复现细节
- Training hyperparameters (learning rate, batch size, number of training steps/epochs, optimizer settings, weight decay, warmup schedule)
- Model architecture details for SU-01 (layer configuration, hidden dimensions, attention mechanism, parameter count)
- Training data details (dataset composition, size, preprocessing steps, data sources for refined RL)
- Random seeds for reproducibility of experiments
- Complete hardware specifications for training (GPU type, number of nodes, memory requirements)
- Training duration and computational cost
- Model weights/checkpoints availability
- Exact implementation details of the refined RL algorithm (reward function formulation, RL objective, policy gradient specifics)
- Verification model architecture and training details (DeepSeekMath-V2 reward server setup beyond deployment specs)
- Data splits for training/validation/test sets
局限与证据边界
- The failures show a clear limitation: the model can miss subtle structural constraints, as in the invalid column-permutation reduction in IMO P6, or leave gaps in delicate global strategy arguments, as in USAMO P2.
- Overall, the model performs well when a problem admits a rigid formal representation, but is less reliable when the core challenge is preserving combinatorial structure or proving a finely tuned process invariant.
本分析由 PDF 阅读助手 自动生成,仅供参考,不构成学术评审意见。验证结论和可复现性评估基于论文文本自动分析,可能存在偏差。原始论文请参阅 arXiv。
分析时间:2026-05-15T13:18:26+00:00 · 数据来源:Paper Collector