# Block OpenAI’s crawlers User-agent: GPTBot Disallow: / # Also block the ChatGPT browser fetcher (if you want) User-agent: ChatGPT-User Disallow: / # Optional: block other AI scrapers User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / # Leave everyone else alone User-agent: * Allow: /