What is ClaudeBot?
ClaudeBot is a ai or training crawler operated by Anthropic. Use this crawler profile to identify user-agent tokens, operator signals, platform hints, and recommended handling.
ClaudeBot
Anthropic · Data collection crawler
- Version
- 1.0
- First seen
- May 20, 2026
- Confidence
- Known user-agent token
Crawler tags
Directory facts
- AI model training
- Listed as training
- Acts on behalf of user
- No, autonomous
- Obeys directives
- Yes, listed as obeying robots.txt
What is ClaudeBot?
ClaudeBot is a ai or training crawler operated by Anthropic. ClaudeBot is likely used by Anthropic to collect or evaluate public web content for AI, language, or training systems.
ClaudeBot matched a known crawler token in the user-agent string, but this page alone does not prove IP ownership.
How to identify ClaudeBot in logs
Search server logs for ClaudeBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
Use this as a web-crawler lookup reference for identifying how this user-agent presents itself in server logs. After you identify crawler traffic, run the WebMCP Compatibility Checker to confirm whether AI crawlers and agents can understand your site.
User-agent signals
- Product tokens
- Mozilla/5.0, AppleWebKit/537.36, Gecko, ClaudeBot/1.0
- Documentation
- None found in user-agent
- Contact
- +claudebot@anthropic.com
- Platform
- Unknown · Unknown
- Browser profile
- Unknown · WebKit
- Browser-like UA
- Yes
- HTTP library
- Unknown
- Spoof risk
- Medium
Questions answered by this crawler profile
What is ClaudeBot?
ClaudeBot is likely used by Anthropic to collect or evaluate public web content for AI, language, or training systems.
Who operates ClaudeBot?
ClaudeBot is associated with Anthropic.
How do I identify ClaudeBot in logs?
Search server logs for ClaudeBot. Matching those tokens is useful for discovery, but IP verification is still recommended before trusting the identity.
Should I allow ClaudeBot?
Verify IP ownership or behavior before making security decisions because user-agent strings can be spoofed. Review your robots.txt and AI crawler policies, then allow, block, or rate-limit it based on your content usage preferences.
Does ClaudeBot respect robots.txt?
Robots.txt compliance cannot be proven from a user-agent string alone. Check the crawler operator documentation and your own logs before assuming behavior.