User-agent: Applebot User-agent: Applebot-Extended User-agent: CCBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: Google-Extended User-agent: Omgilibot User-agent: Omgili User-agent: anthropic-ai User-agent: FacebookBot User-agent: AdsBot-Google User-agent: Amazonbot User-agent: cohere-ai User-agent: Teoma User-agent: Gigabot User-agent: Robozilla User-agent: Nutch User-agent: psbot User-agent: SentiBot User-agent: sentibot User-agent: python-requests User-agent: prefetch-proxy User-agent: AhrefsBot User-agent: PerplexityBot User-agent: ImagesiftBot User-agent: Bytespider User-agent: Diffbot User-agent: ClaudeBot Disallow: / Disallow: * Disallow: /exactly/ Disallow: /a/