Applied Compute

Bringing Continual Learning into Enterprises — Samuel Denton, Applied Compute

Aug 12, 2026 · 19:03

Samuel Denton of Applied Compute explains how enterprises can implement continual learning through a distillation spectrum, pairing offline or online production traces with offline or online hints. He details how offline hints on offline traces improved a Qwen 3.5 model's SWE-bench task completion rate from 22% to 60% without degrading test pass rate, and how online hints on online traces fixed a customer's hyperlink formatting issue, raising correct formatting from 15% to 80%. Key techniques include per-step hinting with a judge to decide where to inject hints, distilling only the next few steps, and relevance-masked self-distillation to avoid learning irrelevant connector words. Applied Compute focuses on quadrant one (offline hints, offline traces) for day-one value and quadrant four (online hints, online traces) for continuous improvement, all without requiring golden answers.

Efficient Reinforcement Learning – Rhythm Garg & Linden Li, Applied Compute

Dec 9, 2025 · 20:19

Rhythm Garg and Linden Li, co-founders of Applied Compute, describe how their company uses efficient reinforcement learning (RL) to specialize large language models for enterprise tasks. They explain that synchronous RL wastes GPU time waiting on straggler samples—99% of arithmetic problems complete in ~40 seconds, but the tail takes 80 more seconds—so they adopt asynchronous pipeline RL. This method dedicates fixed GPUs to sampling and training, allowing continuous inference but introducing stale tokens (up to a tolerated staleness threshold) that require importance ratio corrections. To balance speed and stability, they model the system mathematically: using a roofline-based latency curve for sampling, per-GPU training throughput, and constraints on staleness and KV cache memory. Their simulations, parameterized by response length distributions, reveal an optimal GPU allocation that yields ~60% speedup over synchronous RL while keeping staleness within ML limits. This modeling lets them predict runtime and configure runs without expensive trial-and-error.