Anthropic's Crawlers: ClaudeBot, Claude-SearchBot, Claude-User
Anthropic runs ClaudeBot (training), Claude-SearchBot (search) and Claude-User (user-fetch). All three honour robots.txt, including Crawl-delay, which is why a blanket Disallow also stops Claude opening your page for a user.
#ai-crawlers #anthropic #claudebot