A product discussed on AI Engineer.

FinOps for AI Agents: Who Spent All the Tokens? — Tisha Chawla & Susheem Koul, Microsoft
Aug 22, 2026 · 21:24
Microsoft engineers Tisha Chawla and Susheem Koul present TokenOps, a runaway token governance control plane for AI agents, arguing the agentic era's missing control surface sits between code and model calls, not at request-level gateways. The design has an out-of-band SDK with boundary annotations, a ledger, and a governor, plus a control plane that groups runs into segments, sets budgets, and applies policies. Enforcement comes in two flavors: halt is a circuit breaker, while steer uses a cost guard that watches budget consumed and token velocity and, predicting an overrun, injects an instruction to keep outputs succinct instead of killing the run. They show preview mode with enforcement off, then enforced halt and steering. Benchmarked on Browser Use and MetaGPT, the full policy suite cut average agent spend by about 78% and lifted run completion from 67% to roughly 96% versus throttling.

The Current State of Browser Agents - Jerry Wu and Wyatt Marshall
Jun 3, 2025 · 21:13
Jerry Wu and Wyatt Marshall of Halluminate evaluate browser agents with WebBench, a benchmark of 5,000 tasks across 500+ websites. They find read tasks succeed at ~80%, but write tasks drop below 40% for autonomous agents, with failures often due to infrastructure like CAPTCHAs rather than agent intelligence. They advise AI engineers to choose read over write use cases, test multiple browser infrastructure providers, and combine agents with deterministic Playwright workflows for production. Notable emergent behaviors include an agent bypassing Cloudflare by searching Google and an agent posting a top-liked Medium comment.
Powered by PodHood