Harness Engineering is not Enough: Why Software Factories Fail — Dex Horthy, HumanLayer
Jul 23, 2026 · 19:18
Dex Horthy argues that the failure of lights-off software factories, including his own July 2025 experiment, is not a skill issue but a model training problem: coding models are reinforced only on passing tests, not on maintaining codebase quality, leading to slop code and outages. He explains that Claude Code succeeded where earlier CLI agents did not because it was the first model trained against the harness it ships in, optimizing for tool calls in an agentic loop. However, maintainability cannot be verified by current benchmarks like SWE-bench, which use binary test-pass rewards and ignore architectural degradation that only appears months later. Horthy advocates turning the lights back on—keeping human code review—but moving faster by investing upfront in product review, system architecture, program design (types and call graphs), and vertical slices. He claims thirty minutes of alignment saves hours of review, turning PR review from slop into a joy, and that this approach lets engineers still ship fast while owning code quality.
