Crawl Field Notes

Notable AI crawlers, in semantic HTML

The same facts you will find in four other formats, here as ordinary semantic HTML. Format marker for this edition: FMT-SEM-7Q4K.

GPTBot

Operated by OpenAI. Primary purpose: Training & grounding. Honours robots.txt.

ClaudeBot

Operated by Anthropic. Primary purpose: Model training. Honours robots.txt.

PerplexityBot

Operated by Perplexity. Primary purpose: Live cited answers. Honours robots.txt.