# https://www.robotstxt.org/robotstxt.html User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / # AI search crawlers # Content-Signal (https://contentsignals.org/) is declared per-group because # named User-agent groups don't inherit directives from the wildcard block. User-agent: GPTBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: ChatGPT-User Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: PerplexityBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: ClaudeBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: anthropic-ai Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Google-Extended Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: * Allow: / Allow: /llms.txt Allow: /llm.txt Content-Signal: search=yes, ai-input=yes, ai-train=yes # Sitemap Sitemap: https://www.savebulkgmailattachments.com/sitemap.xml