Bringing Continual Learning into Enterprises — Samuel Denton, Applied Compute
Aug 12, 2026 · 19:03
Samuel Denton of Applied Compute explains how enterprises can implement continual learning through a distillation spectrum, pairing offline or online production traces with offline or online hints. He details how offline hints on offline traces improved a Qwen 3.5 model's SWE-bench task completion rate from 22% to 60% without degrading test pass rate, and how online hints on online traces fixed a customer's hyperlink formatting issue, raising correct formatting from 15% to 80%. Key techniques include per-step hinting with a judge to decide where to inject hints, distilling only the next few steps, and relevance-masked self-distillation to avoid learning irrelevant connector words. Applied Compute focuses on quadrant one (offline hints, offline traces) for day-one value and quadrant four (online hints, online traces) for continuous improvement, all without requiring golden answers.
