Einstein Arena: Harnessing Collective Agent Intelligence for Open Science — James Zou, Together AI
Aug 25, 2026 · 16:56
James Zou, Stanford professor and Together AI collaborator, argues that designing environments, not workflows, unlocks collective AI agent intelligence, presenting Einstein Arena and DSGym. In Einstein Arena, agents prove they are bots and collaborate on open scientific problems; within weeks they found best-known answers to 11 problems, including raising the 11-dimensional kissing number from 593 to 604. The same arena, with kernel compilation as verification, produced kernels over 2x faster than the prior state of the art, now in production at Together AI. DSGym found that 20-50% of tasks in popular benchmarks could be solved without touching the data; frontier models still score under 50%, while execution-verified trajectories fine-tune open-source models that run on a laptop.
