# robots.txt for jesselanderson.com. # This site is built to be read by humans and agents. Major AI crawlers # are allowed explicitly. Aggressive scrapers are denied. User-agent: * Allow: / # AI assistants. Read-and-cite use cases. User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: meta-externalagent Allow: / # Aggressive scrapers. Not a fit. User-agent: Bytespider Disallow: / Sitemap: https://jesselanderson.com/sitemap.xml