User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes, use=full Allow: / Disallow: /export Disallow: /graph Disallow: /submit Disallow: /maintenance/ Disallow: /api/ Disallow: /private/ # AI crawlers are welcome here — this is a research field guide. User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / Sitemap: https://crawler-lab.aiwiki.ch/sitemap.xml