A company discussed on AI Engineer.

The Rise of CaaS: Context-as-a-Service for Agentic AI — Omer Primor, Bright Data
Aug 14, 2026 · 22:20
Omer Primor of Bright Data argues that rented AI search and context-as-a-service (CaaS) lose to a self-built pipeline once query volume passes a tipping point. The web is context, not data, and it decays: social content goes stale within a day, news/finance/retail within 30 days, so context is never a one-time snapshot. His test enriching 100 sponsor companies across 25 fields found general search beat dedicated CaaS vendors on coverage, because CaaS only answers from data it already holds; costs were similar, but frequency is the real killer — every repeated query costs the same when nothing changed. He built scrapers for LinkedIn, jobs, and Crunchbase in a day, priced setup at $5,000, and put the crossover just over 15,000 entities. Owned context compounds while rented decays.

Your Agent's Biggest Lie: "I Searched the Web" — Rafael Levi, Bright Data
Jun 17, 2026 · 15:49
Rafael Levi from Bright Data argues that LLMs often hallucinate and provide fake citations because they fail to actually access live web data, getting blocked by anti-bot systems like CAPTCHAs and Cloudflare's AI labyrinth. He demonstrates this with a comparison: without Bright Data's MCP, GPT-5 failed all five tasks accessing sites like LinkedIn and Amazon; with the MCP's 66 tools—including a CAPTCHA-solving browser that mimics human behavior—four succeeded. Levi explains that agents enter an invisible failure loop where they get blocked or served fake data but still answer confidently, making up numbers or non-existent URLs. He emphasizes that 20% of the web is blocked by Cloudflare from AI crawling, and that fake data fed to bots increases hallucinations. The episode covers how Bright Data's MCP provides real web access with search, scraping, and remote browsers, offering a free tier of 5,000 requests per month for experimentation.

From MCP to Scale: Pipelines That Build Themselves — Rafael Levi, Bright Data
Jun 7, 2026 · 25:26
Rafael Levi from Bright Data shows how LLMs combined with Bright Data's MCP and infrastructure turn web scraping into self-healing pipelines. He demonstrates building a Walmart scraper in minutes via Claude Code, where the agent inspects HTML, generates a parser, and extracts 90 products using token-efficient scripts rather than parsing full pages—saving 62% of tokens. Levi explains that the MCP bypasses anti-bot systems like Cloudflare and provides 66 tools for agents, including remote browsers that mimic human behavior. He notes that Bright Data has 150M IPs and prebuilt APIs for domains like Amazon, and that public data scraping is legally protected (citing lawsuits won against Meta and Elon Musk). Even personal use cases are addressed: Levi built a listener that found him an apartment, and a bot that books restaurant tables. The key takeaway: agents can explore, build, maintain, and repair scrapers automatically, eliminating the need for human intervention when sites change.
Powered by PodHood