Notable AI crawlers, in semantic HTML
The same facts you will find in four other formats, here as ordinary semantic HTML. Format marker for this edition: FMT-SEM-7Q4K.
GPTBot
Operated by OpenAI. Primary purpose: Training & grounding. Honours robots.txt.
ClaudeBot
Operated by Anthropic. Primary purpose: Model training. Honours robots.txt.
PerplexityBot
Operated by Perplexity. Primary purpose: Live cited answers. Honours robots.txt.