# AI training crawlers: blocked User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: CCBot User-agent: Applebot-Extended User-agent: meta-externalagent Disallow: / # Search engines and AI answer engines (citations): allowed. # A bot matching a named group ignores `*`, so the rules are repeated here. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: * Content-Signal: ai-train=no, search=yes, ai-input=yes Disallow: /fr/social/* Disallow: /fr/formation/modules* Disallow: /social/* Disallow: /training/modules* Allow: / Sitemap: https://www.cyber101.com/sitemap.xml