# The Bread Code — robots.txt # # We want this content cited. Search engines and conversational AI # agents are both explicitly welcome. Attribution to "Hendrik # Kleinwächter, The Bread Code" with a link back is appreciated. # See also: /llms.txt (machine-readable index for AI crawlers) User-agent: * Allow: / # Content Signals (https://contentsignals.org/): how the content may be # used once crawled. A crawler reads only the group that names it, so the # line is repeated in every named group below. Content-Signal: search=yes, ai-input=yes, ai-train=yes # Major AI crawlers, named individually so we can adjust policy # per-agent later without touching the wildcard above. User-agent: GPTBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: ChatGPT-User Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: OAI-SearchBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: ClaudeBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: anthropic-ai Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Claude-Web Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Google-Extended Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: CCBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: PerplexityBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Applebot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Applebot-Extended Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Bytespider Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Amazonbot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Diffbot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: cohere-ai Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: FacebookBot Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes User-agent: Meta-ExternalAgent Allow: / Content-Signal: search=yes, ai-input=yes, ai-train=yes Sitemap: https://www.the-bread-code.io/sitemap.xml