AI agents blocked at the WAF
Homepage GET returned HTTP 429 from every fetch path we tried — plain HTTP request, browser-style user agent, AND a real headless Chromium browser. The block is at the WAF / TLS layer, not user-agent-based filtering.
→ Allowlist known AI-agent user agents (GPTBot, ChatGPT-User, OAI-SearchBot, ClaudeBot, Claude-Web, anthropic-ai, PerplexityBot, Perplexity-User, Google-Extended, Applebot-Extended, Bytespider) and their published IP ranges in your WAF (Akamai/Cloudflare). Ease bot-protection rules for /.well-known/* and /robots.txt at minimum. Publish /llms.txt and /.well-known/agent-skills/index.json so agents can find a machine-readable map of your site.