We Vetted 2000 AI Skills Before They Reached Developers — Lucas Palma, Nubank
Jul 29, 2026 · 16:24
Lucas Palma, product security manager at Nubank, explains how his team built Skill Vector to vet AI skills as supply chain risks inside a regulated bank, scanning over 2,000 skills before they reached developers. The tool uses a hybrid approach: deterministic checks catch destructive shell commands and credential requests, then an LLM reviews behavioral context missed by patterns. Across 2,000 skills, the system identified more than 1,500 risks, with 1,000 remediated immediately and a few blocked entirely from the internal marketplace. Key lessons include treating skills like any dependency, running local scans alongside CI enforcement, and requiring proper human-in-the-loop approval rather than AI self-confirmation. Palma also applies the same gates to MCP servers, rules, and third-party plugins, pushing for a trusted canonical marketplace where every entry is scanned before distribution.
