


Training Dynamics with Low-Dimensional Inductive BIas.
pre-training, SFT, & RL
Selected Recent Work:
-
"ISO: An RLVR-Native Optimization Stack", arXiv 2026
-
"Neon: Negative Extrapolation From Self-Training Improves Generation”, ICLR 2026 [Oral]
-
"The path not taken: RLVR provably learns off the principals", arXiv 2025
-
“APOLLO: SGD-like Memory, AdamW-level Performance”, MLSys 2025 (Outstanding Paper Honorable Mention)
-
"Drag-and-drop LLMs: Zero-shot prompt-to-weights", NeurIPS 2025
-
“Why Neural Network Can Discover Symbolic Structures with Gradient-based Training: An Algebraic and Geometric Foundation for Neurosymbolic Reasoning”, NeuS 2025 (DAPRA Disruptive Idea Paper Award)
-
"From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications", ICML 2025
-
“GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection”, ICML 2024 [Oral]









