Agents at Scale: Inside MiniMax's Model and the Infrastructure Behind It — Dan Fu and Olive Song
Jul 31, 2026 · 20:14
Olive Song, RL lead at MiniMax, and Dan, Together AI's VP of Kernels, argue that open-weight MiniMax M3 is closing the gap to frontier labs via community feedback and inference optimization. Dan details the day-zero stack: GPU kernels for M3's sparse attention, KV cache at million-token contexts, and adapting to agentic workloads that upload codebases. Song says M3 trains multimodal from scratch to prevent text-vision collapse, and uses RL with environment design and rewards for long-horizon tasks like replicating a 12-hour iClear paper, plus validation/test splits to avoid hacking. Together's Parallel Kernel Bench holds unsolved problems, so overfitting it yields kernels the company deploys. Both see self-evolution and better GPU utilization as why open models keep accelerating.
